Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 1119 in Layer 31

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.8320. Min Act: -0.1700

Data Index: 7285826 (Open Web Text)

Max Activating Token Index: 690

Text #1

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.7695. Min Act: -0.1700

Data Index: 6424112 (Open Web Text)

Max Activating Token Index: 932

Text #2

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.7070. Min Act: -0.1700

Data Index: 3361334 (Open Web Text)

Max Activating Token Index: 238

Text #3

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.6445. Min Act: -0.1700

Data Index: 8556905 (Open Web Text)

Max Activating Token Index: 363

Text #4

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.6757. Min Act: -0.1700

Data Index: 2194196 (Open Web Text)

Max Activating Token Index: 216

Text #5

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.6757. Min Act: -0.1700

Data Index: 5269507 (Open Web Text)

Max Activating Token Index: 524

Text #6

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.5820. Min Act: -0.1700

Data Index: 6066125 (Open Web Text)

Max Activating Token Index: 483

Text #7

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.5820. Min Act: -0.1700

Data Index: 8095757 (Open Web Text)

Max Activating Token Index: 435

Text #8

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.5507. Min Act: -0.1700

Data Index: 1528661 (Open Web Text)

Max Activating Token Index: 634

Text #9

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.5507. Min Act: -0.1700

Data Index: 681105 (Open Web Text)

Max Activating Token Index: 624

Text #10

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.5507. Min Act: -0.1700

Data Index: 4153777 (Open Web Text)

Max Activating Token Index: 70

Text #11

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.5195. Min Act: -0.1700

Data Index: 38614 (Open Web Text)

Max Activating Token Index: 843

Text #12

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.5195. Min Act: -0.1700

Data Index: 4181881 (Open Web Text)

Max Activating Token Index: 852

Text #13

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.5195. Min Act: -0.1700

Data Index: 4209456 (Open Web Text)

Max Activating Token Index: 198

Text #14

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.5195. Min Act: -0.1700

Data Index: 25286 (Open Web Text)

Max Activating Token Index: 923

Text #15

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.4882. Min Act: -0.1700

Data Index: 8587441 (Open Web Text)

Max Activating Token Index: 135

Text #16

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.4882. Min Act: -0.1700

Data Index: 2079181 (Open Web Text)

Max Activating Token Index: 317

Text #17

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.4882. Min Act: -0.1700

Data Index: 950600 (Open Web Text)

Max Activating Token Index: 920

Text #18

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.4570. Min Act: -0.1700

Data Index: 863639 (Open Web Text)

Max Activating Token Index: 941

Text #19

Max Range: 4.8320. Min Range: -4.8320

Max Act: 4.4570. Min Act: -0.1700

Data Index: 1858119 (Open Web Text)

Max Activating Token Index: 359