Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2364 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.1447. Min Act: -0.0403

Data Index: 1707860 (Open Web Text)

Max Activating Token Index: 322

Text #1

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0345. Min Act: -0.1425

Data Index: 7417430 (Open Web Text)

Max Activating Token Index: 48

Text #2

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0402. Min Act: -0.0390

Data Index: 7417428 (Open Web Text)

Max Activating Token Index: 609

Text #3

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0441. Min Act: -0.0542

Data Index: 318350 (Open Web Text)

Max Activating Token Index: 729

Text #4

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0428. Min Act: -0.0269

Data Index: 1041111 (Open Web Text)

Max Activating Token Index: 40

Text #5

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0323. Min Act: -0.0305

Data Index: 5865542 (Open Web Text)

Max Activating Token Index: 1010

Text #6

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0312. Min Act: -0.0708

Data Index: 7241677 (Open Web Text)

Max Activating Token Index: 695

Text #7

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0175. Min Act: -0.0955

Data Index: 2704344 (Open Web Text)

Max Activating Token Index: 705

Text #8

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0259. Min Act: -0.0943

Data Index: 8743928 (Open Web Text)

Max Activating Token Index: 598

Text #9

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0264. Min Act: -0.0618

Data Index: 8450802 (Open Web Text)

Max Activating Token Index: 722

Text #10

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0271. Min Act: -0.0450

Data Index: 1546636 (Open Web Text)

Max Activating Token Index: 704

Text #11

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0164. Min Act: -0.0775

Data Index: 8642543 (Open Web Text)

Max Activating Token Index: 34

Text #12

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0169. Min Act: 0.0020

Data Index: 2311584 (Open Web Text)

Max Activating Token Index: 234

Text #13

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0194. Min Act: -0.0654

Data Index: 6048223 (Open Web Text)

Max Activating Token Index: 679

Text #14

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0204. Min Act: -0.0995

Data Index: 734953 (Open Web Text)

Max Activating Token Index: 184

Text #15

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0174. Min Act: -0.0301

Data Index: 2630327 (Open Web Text)

Max Activating Token Index: 912

Text #16

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0235. Min Act: -0.0266

Data Index: 2901182 (Open Web Text)

Max Activating Token Index: 582

Text #17

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0169. Min Act: -0.0895

Data Index: 1892621 (Open Web Text)

Max Activating Token Index: 522

Text #18

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0093. Min Act: 0.0130

Data Index: 6357271 (Open Web Text)

Max Activating Token Index: 716

Text #19

Max Range: 1.1447. Min Range: -1.1447

Max Act: 1.0115. Min Act: 0.0441

Data Index: 6357291 (Open Web Text)

Max Activating Token Index: 671