Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 2387 in Layer 34

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.6771. Min Act: -0.1700

Data Index: 5607407 (Open Web Text)

Max Activating Token Index: 894

Text #1

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.6146. Min Act: -0.1700

Data Index: 3572932 (Open Web Text)

Max Activating Token Index: 1020

Text #2

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.4584. Min Act: -0.1700

Data Index: 6635097 (Open Web Text)

Max Activating Token Index: 471

Text #3

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.3334. Min Act: -0.1700

Data Index: 1695420 (Open Web Text)

Max Activating Token Index: 616

Text #4

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.3334. Min Act: -0.1700

Data Index: 708594 (Open Web Text)

Max Activating Token Index: 523

Text #5

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.3021. Min Act: -0.1700

Data Index: 2241879 (Open Web Text)

Max Activating Token Index: 388

Text #6

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.3021. Min Act: -0.1700

Data Index: 1643474 (Open Web Text)

Max Activating Token Index: 909

Text #7

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.2084. Min Act: -0.1700

Data Index: 6500887 (Open Web Text)

Max Activating Token Index: 913

Text #8

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.1146. Min Act: -0.1700

Data Index: 3481511 (Open Web Text)

Max Activating Token Index: 586

Text #9

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.1459. Min Act: -0.1700

Data Index: 6631039 (Open Web Text)

Max Activating Token Index: 58

Text #10

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.1771. Min Act: -0.1700

Data Index: 1500784 (Open Web Text)

Max Activating Token Index: 381

Text #11

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.0834. Min Act: -0.1700

Data Index: 6059396 (Open Web Text)

Max Activating Token Index: 464

Text #12

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.0521. Min Act: -0.1700

Data Index: 4366954 (Open Web Text)

Max Activating Token Index: 433

Text #13

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.0521. Min Act: -0.1700

Data Index: 4030543 (Open Web Text)

Max Activating Token Index: 737

Text #14

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.0521. Min Act: -0.1700

Data Index: 8310998 (Open Web Text)

Max Activating Token Index: 534

Text #15

Max Range: 7.6771. Min Range: -7.6771

Max Act: 7.0209. Min Act: -0.1700

Data Index: 1689437 (Open Web Text)

Max Activating Token Index: 53

Text #16

Max Range: 7.6771. Min Range: -7.6771

Max Act: 6.9896. Min Act: -0.1700

Data Index: 3639521 (Open Web Text)

Max Activating Token Index: 512

Text #17

Max Range: 7.6771. Min Range: -7.6771

Max Act: 6.9896. Min Act: -0.1700

Data Index: 1438163 (Open Web Text)

Max Activating Token Index: 426

Text #18

Max Range: 7.6771. Min Range: -7.6771

Max Act: 6.9896. Min Act: -0.1700

Data Index: 1937129 (Open Web Text)

Max Activating Token Index: 285

Text #19

Max Range: 7.6771. Min Range: -7.6771

Max Act: 6.9896. Min Act: -0.1700

Data Index: 5127079 (Open Web Text)

Max Activating Token Index: 784