Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2915 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.7253. Min Act: -0.1700

Data Index: 3741591 (Open Web Text)

Max Activating Token Index: 1007

Text #1

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.7299. Min Act: -0.1697

Data Index: 8251557 (Open Web Text)

Max Activating Token Index: 956

Text #2

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.7103. Min Act: -0.1700

Data Index: 4657792 (Open Web Text)

Max Activating Token Index: 247

Text #3

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.7049. Min Act: -0.1560

Data Index: 3548557 (Open Web Text)

Max Activating Token Index: 8

Text #4

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6938. Min Act: -0.1700

Data Index: 990868 (Open Web Text)

Max Activating Token Index: 381

Text #5

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6708. Min Act: -0.1700

Data Index: 8013107 (Open Web Text)

Max Activating Token Index: 623

Text #6

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6903. Min Act: -0.1700

Data Index: 6041745 (Open Web Text)

Max Activating Token Index: 829

Text #7

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6759. Min Act: -0.1696

Data Index: 1359211 (Open Web Text)

Max Activating Token Index: 16

Text #8

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6616. Min Act: -0.1700

Data Index: 6647586 (Open Web Text)

Max Activating Token Index: 152

Text #9

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6709. Min Act: -0.1700

Data Index: 2293814 (Open Web Text)

Max Activating Token Index: 564

Text #10

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6597. Min Act: -0.1700

Data Index: 4497116 (Open Web Text)

Max Activating Token Index: 907

Text #11

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6533. Min Act: -0.1700

Data Index: 3430802 (Open Web Text)

Max Activating Token Index: 690

Text #12

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6547. Min Act: -0.1697

Data Index: 471048 (Open Web Text)

Max Activating Token Index: 680

Text #13

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6482. Min Act: -0.1700

Data Index: 5106994 (Open Web Text)

Max Activating Token Index: 223

Text #14

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6431. Min Act: -0.1700

Data Index: 7931144 (Open Web Text)

Max Activating Token Index: 76

Text #15

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6266. Min Act: -0.1700

Data Index: 4761450 (Open Web Text)

Max Activating Token Index: 1015

Text #16

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6336. Min Act: -0.1700

Data Index: 5058872 (Open Web Text)

Max Activating Token Index: 928

Text #17

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6318. Min Act: -0.1700

Data Index: 6545985 (Open Web Text)

Max Activating Token Index: 160

Text #18

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6320. Min Act: -0.1700

Data Index: 7646737 (Open Web Text)

Max Activating Token Index: 714

Text #19

Max Range: 1.7299. Min Range: -1.7299

Max Act: 1.6217. Min Act: -0.1674

Data Index: 5032884 (Open Web Text)

Max Activating Token Index: 551