Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1455 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.7166. Min Act: -0.1700

Data Index: 6896180 (Open Web Text)

Max Activating Token Index: 424

Text #1

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.5560. Min Act: -0.1700

Data Index: 171984 (Open Web Text)

Max Activating Token Index: 283

Text #2

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.4215. Min Act: -0.1700

Data Index: 4601501 (Open Web Text)

Max Activating Token Index: 196

Text #3

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.4246. Min Act: -0.1700

Data Index: 6237361 (Open Web Text)

Max Activating Token Index: 788

Text #4

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.3902. Min Act: -0.1700

Data Index: 5751561 (Open Web Text)

Max Activating Token Index: 386

Text #5

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.3835. Min Act: -0.1700

Data Index: 1967522 (Open Web Text)

Max Activating Token Index: 740

Text #6

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.3122. Min Act: -0.1700

Data Index: 8423782 (Open Web Text)

Max Activating Token Index: 548

Text #7

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.3011. Min Act: -0.1700

Data Index: 3446505 (Open Web Text)

Max Activating Token Index: 501

Text #8

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.2710. Min Act: -0.1700

Data Index: 7171230 (Open Web Text)

Max Activating Token Index: 824

Text #9

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.2589. Min Act: -0.1700

Data Index: 1376813 (Open Web Text)

Max Activating Token Index: 621

Text #10

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.2485. Min Act: -0.1700

Data Index: 8628499 (Open Web Text)

Max Activating Token Index: 317

Text #11

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.2049. Min Act: -0.1700

Data Index: 3776079 (Open Web Text)

Max Activating Token Index: 1013

Text #12

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.2314. Min Act: -0.1700

Data Index: 1575437 (Open Web Text)

Max Activating Token Index: 903

Text #13

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.1902. Min Act: -0.1700

Data Index: 2616724 (Open Web Text)

Max Activating Token Index: 177

Text #14

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.2182. Min Act: -0.1700

Data Index: 669975 (Open Web Text)

Max Activating Token Index: 809

Text #15

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.1883. Min Act: -0.1700

Data Index: 2082545 (Open Web Text)

Max Activating Token Index: 612

Text #16

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.1885. Min Act: -0.1700

Data Index: 4992953 (Open Web Text)

Max Activating Token Index: 964

Text #17

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.1600. Min Act: -0.1700

Data Index: 647106 (Open Web Text)

Max Activating Token Index: 716

Text #18

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.2035. Min Act: -0.1700

Data Index: 3848772 (Open Web Text)

Max Activating Token Index: 678

Text #19

Max Range: 4.7166. Min Range: -4.7166

Max Act: 4.1698. Min Act: -0.1700

Data Index: 6517371 (Open Web Text)

Max Activating Token Index: 757