Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2392 in Layer 4

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.3362. Min Act: -0.1700

Data Index: 542294 (Open Web Text)

Max Activating Token Index: 909

Text #1

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.1730. Min Act: -0.1700

Data Index: 6164585 (Open Web Text)

Max Activating Token Index: 137

Text #2

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0923. Min Act: -0.1700

Data Index: 611812 (Open Web Text)

Max Activating Token Index: 988

Text #3

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0601. Min Act: -0.1700

Data Index: 8383309 (Open Web Text)

Max Activating Token Index: 547

Text #4

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0350. Min Act: -0.1700

Data Index: 6317661 (Open Web Text)

Max Activating Token Index: 992

Text #5

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0444. Min Act: -0.1700

Data Index: 3035051 (Open Web Text)

Max Activating Token Index: 509

Text #6

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0592. Min Act: -0.1700

Data Index: 896571 (Open Web Text)

Max Activating Token Index: 162

Text #7

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0387. Min Act: -0.1700

Data Index: 3145943 (Open Web Text)

Max Activating Token Index: 965

Text #8

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0430. Min Act: -0.1700

Data Index: 6292231 (Open Web Text)

Max Activating Token Index: 66

Text #9

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0363. Min Act: -0.1700

Data Index: 4089080 (Open Web Text)

Max Activating Token Index: 648

Text #10

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0459. Min Act: -0.1700

Data Index: 4358069 (Open Web Text)

Max Activating Token Index: 502

Text #11

Max Range: 3.3362. Min Range: -3.3362

Max Act: 2.9994. Min Act: -0.1700

Data Index: 435320 (Open Web Text)

Max Activating Token Index: 924

Text #12

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0252. Min Act: -0.1700

Data Index: 2617089 (Open Web Text)

Max Activating Token Index: 573

Text #13

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0266. Min Act: -0.1700

Data Index: 6715095 (Open Web Text)

Max Activating Token Index: 926

Text #14

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0206. Min Act: -0.1700

Data Index: 3938369 (Open Web Text)

Max Activating Token Index: 337

Text #15

Max Range: 3.3362. Min Range: -3.3362

Max Act: 2.9560. Min Act: -0.1700

Data Index: 3795125 (Open Web Text)

Max Activating Token Index: 870

Text #16

Max Range: 3.3362. Min Range: -3.3362

Max Act: 2.9937. Min Act: -0.1700

Data Index: 1153036 (Open Web Text)

Max Activating Token Index: 850

Text #17

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0189. Min Act: -0.1700

Data Index: 7551482 (Open Web Text)

Max Activating Token Index: 347

Text #18

Max Range: 3.3362. Min Range: -3.3362

Max Act: 2.9918. Min Act: -0.1700

Data Index: 6916701 (Open Web Text)

Max Activating Token Index: 332

Text #19

Max Range: 3.3362. Min Range: -3.3362

Max Act: 3.0249. Min Act: -0.1700

Data Index: 1064240 (Open Web Text)

Max Activating Token Index: 573