Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2312 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.6751. Min Act: -0.1696

Data Index: 3807054 (Open Web Text)

Max Activating Token Index: 5

Text #1

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.6314. Min Act: -0.1700

Data Index: 341821 (Open Web Text)

Max Activating Token Index: 6

Text #2

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.6271. Min Act: -0.1700

Data Index: 1969453 (Open Web Text)

Max Activating Token Index: 4

Text #3

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.6081. Min Act: -0.1698

Data Index: 6507265 (Open Web Text)

Max Activating Token Index: 7

Text #4

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.6088. Min Act: -0.1700

Data Index: 5413368 (Open Web Text)

Max Activating Token Index: 5

Text #5

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5917. Min Act: -0.1700

Data Index: 3784395 (Open Web Text)

Max Activating Token Index: 7

Text #6

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5850. Min Act: -0.1700

Data Index: 1373585 (Open Web Text)

Max Activating Token Index: 9

Text #7

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5821. Min Act: -0.1700

Data Index: 621710 (Open Web Text)

Max Activating Token Index: 5

Text #8

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5653. Min Act: -0.1700

Data Index: 4203521 (Open Web Text)

Max Activating Token Index: 8

Text #9

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5676. Min Act: -0.1699

Data Index: 5789987 (Open Web Text)

Max Activating Token Index: 553

Text #10

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5620. Min Act: -0.1700

Data Index: 5548277 (Open Web Text)

Max Activating Token Index: 3

Text #11

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5620. Min Act: -0.1699

Data Index: 3592121 (Open Web Text)

Max Activating Token Index: 3

Text #12

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5637. Min Act: -0.1700

Data Index: 7807941 (Open Web Text)

Max Activating Token Index: 6

Text #13

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5626. Min Act: -0.1700

Data Index: 669434 (Open Web Text)

Max Activating Token Index: 821

Text #14

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5589. Min Act: -0.1700

Data Index: 1027161 (Open Web Text)

Max Activating Token Index: 5

Text #15

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5620. Min Act: -0.1700

Data Index: 4869713 (Open Web Text)

Max Activating Token Index: 3

Text #16

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5486. Min Act: -0.1681

Data Index: 3900545 (Open Web Text)

Max Activating Token Index: 200

Text #17

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5435. Min Act: -0.1700

Data Index: 804359 (Open Web Text)

Max Activating Token Index: 9

Text #18

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5541. Min Act: -0.1700

Data Index: 3460488 (Open Web Text)

Max Activating Token Index: 5

Text #19

Max Range: 1.6751. Min Range: -1.6751

Max Act: 1.5416. Min Act: -0.1700

Data Index: 6477423 (Open Web Text)

Max Activating Token Index: 5