Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 454 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5727. Min Act: -0.1700

Data Index: 7088194 (Open Web Text)

Max Activating Token Index: 982

Text #1

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5809. Min Act: -0.1700

Data Index: 7149992 (Open Web Text)

Max Activating Token Index: 8

Text #2

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5902. Min Act: -0.1700

Data Index: 7566339 (Open Web Text)

Max Activating Token Index: 170

Text #3

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5610. Min Act: -0.1700

Data Index: 4628572 (Open Web Text)

Max Activating Token Index: 506

Text #4

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5682. Min Act: -0.1700

Data Index: 2155126 (Open Web Text)

Max Activating Token Index: 20

Text #5

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5390. Min Act: -0.1700

Data Index: 6731004 (Open Web Text)

Max Activating Token Index: 528

Text #6

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5428. Min Act: -0.1700

Data Index: 6141813 (Open Web Text)

Max Activating Token Index: 39

Text #7

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5317. Min Act: -0.1700

Data Index: 2333635 (Open Web Text)

Max Activating Token Index: 821

Text #8

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5444. Min Act: -0.1700

Data Index: 5744104 (Open Web Text)

Max Activating Token Index: 723

Text #9

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5533. Min Act: -0.1700

Data Index: 125979 (Open Web Text)

Max Activating Token Index: 38

Text #10

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5613. Min Act: -0.1700

Data Index: 8463295 (Open Web Text)

Max Activating Token Index: 829

Text #11

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5411. Min Act: -0.1700

Data Index: 8305155 (Open Web Text)

Max Activating Token Index: 644

Text #12

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5514. Min Act: -0.1700

Data Index: 8002936 (Open Web Text)

Max Activating Token Index: 30

Text #13

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5299. Min Act: -0.1700

Data Index: 7327742 (Open Web Text)

Max Activating Token Index: 15

Text #14

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5361. Min Act: -0.1700

Data Index: 2918540 (Open Web Text)

Max Activating Token Index: 348

Text #15

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5092. Min Act: -0.1700

Data Index: 5747340 (Open Web Text)

Max Activating Token Index: 448

Text #16

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5012. Min Act: -0.1700

Data Index: 5858353 (Open Web Text)

Max Activating Token Index: 10

Text #17

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5055. Min Act: -0.1700

Data Index: 658538 (Open Web Text)

Max Activating Token Index: 929

Text #18

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5122. Min Act: -0.1700

Data Index: 2333639 (Open Web Text)

Max Activating Token Index: 208

Text #19

Max Range: 3.5902. Min Range: -3.5902

Max Act: 3.5093. Min Act: -0.1700

Data Index: 6449757 (Open Web Text)

Max Activating Token Index: 80