Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2851 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.7769. Min Act: -0.1700

Data Index: 826875 (Open Web Text)

Max Activating Token Index: 895

Text #1

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.7462. Min Act: -0.1700

Data Index: 2284348 (Open Web Text)

Max Activating Token Index: 166

Text #2

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6978. Min Act: -0.1700

Data Index: 2977917 (Open Web Text)

Max Activating Token Index: 1011

Text #3

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6916. Min Act: -0.1700

Data Index: 4308433 (Open Web Text)

Max Activating Token Index: 312

Text #4

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6702. Min Act: -0.1700

Data Index: 682670 (Open Web Text)

Max Activating Token Index: 254

Text #5

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6624. Min Act: -0.1700

Data Index: 7883117 (Open Web Text)

Max Activating Token Index: 75

Text #6

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6721. Min Act: -0.1700

Data Index: 4461848 (Open Web Text)

Max Activating Token Index: 717

Text #7

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6475. Min Act: -0.1700

Data Index: 3016496 (Open Web Text)

Max Activating Token Index: 383

Text #8

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6456. Min Act: -0.1700

Data Index: 2885479 (Open Web Text)

Max Activating Token Index: 191

Text #9

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6418. Min Act: -0.1700

Data Index: 2168039 (Open Web Text)

Max Activating Token Index: 330

Text #10

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6276. Min Act: -0.1700

Data Index: 843394 (Open Web Text)

Max Activating Token Index: 1014

Text #11

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6340. Min Act: -0.1700

Data Index: 4011662 (Open Web Text)

Max Activating Token Index: 76

Text #12

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6196. Min Act: -0.1700

Data Index: 1889778 (Open Web Text)

Max Activating Token Index: 128

Text #13

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6266. Min Act: -0.1700

Data Index: 8193632 (Open Web Text)

Max Activating Token Index: 166

Text #14

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6286. Min Act: -0.1700

Data Index: 5142808 (Open Web Text)

Max Activating Token Index: 997

Text #15

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6237. Min Act: -0.1700

Data Index: 8119727 (Open Web Text)

Max Activating Token Index: 206

Text #16

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6159. Min Act: -0.1700

Data Index: 1754936 (Open Web Text)

Max Activating Token Index: 412

Text #17

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6202. Min Act: -0.1700

Data Index: 4221149 (Open Web Text)

Max Activating Token Index: 540

Text #18

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6135. Min Act: -0.1700

Data Index: 6232566 (Open Web Text)

Max Activating Token Index: 196

Text #19

Max Range: 1.7769. Min Range: -1.7769

Max Act: 1.6199. Min Act: -0.1700

Data Index: 3400871 (Open Web Text)

Max Activating Token Index: 1010