Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2572 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.6138. Min Act: -0.1700

Data Index: 4888065 (Open Web Text)

Max Activating Token Index: 93

Text #1

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5955. Min Act: -0.1700

Data Index: 5344682 (Open Web Text)

Max Activating Token Index: 35

Text #2

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5964. Min Act: -0.1700

Data Index: 4741100 (Open Web Text)

Max Activating Token Index: 602

Text #3

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5938. Min Act: -0.1700

Data Index: 4336918 (Open Web Text)

Max Activating Token Index: 517

Text #4

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5809. Min Act: -0.1690

Data Index: 3022277 (Open Web Text)

Max Activating Token Index: 568

Text #5

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5594. Min Act: -0.1700

Data Index: 2340343 (Open Web Text)

Max Activating Token Index: 728

Text #6

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5638. Min Act: -0.1695

Data Index: 5993817 (Open Web Text)

Max Activating Token Index: 520

Text #7

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5573. Min Act: -0.1700

Data Index: 3537680 (Open Web Text)

Max Activating Token Index: 677

Text #8

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5517. Min Act: -0.1700

Data Index: 5833636 (Open Web Text)

Max Activating Token Index: 103

Text #9

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5392. Min Act: -0.1700

Data Index: 5476807 (Open Web Text)

Max Activating Token Index: 199

Text #10

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5475. Min Act: -0.1700

Data Index: 2069615 (Open Web Text)

Max Activating Token Index: 945

Text #11

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5388. Min Act: -0.1700

Data Index: 7870202 (Open Web Text)

Max Activating Token Index: 57

Text #12

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5422. Min Act: -0.1700

Data Index: 1737292 (Open Web Text)

Max Activating Token Index: 93

Text #13

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5435. Min Act: -0.1700

Data Index: 7444541 (Open Web Text)

Max Activating Token Index: 70

Text #14

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5389. Min Act: -0.1700

Data Index: 1223623 (Open Web Text)

Max Activating Token Index: 186

Text #15

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5357. Min Act: -0.1700

Data Index: 362655 (Open Web Text)

Max Activating Token Index: 705

Text #16

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5307. Min Act: -0.1700

Data Index: 4369215 (Open Web Text)

Max Activating Token Index: 405

Text #17

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5308. Min Act: -0.1700

Data Index: 2430505 (Open Web Text)

Max Activating Token Index: 538

Text #18

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5394. Min Act: -0.1700

Data Index: 1394649 (Open Web Text)

Max Activating Token Index: 62

Text #19

Max Range: 1.6138. Min Range: -1.6138

Max Act: 1.5403. Min Act: -0.1700

Data Index: 2531101 (Open Web Text)

Max Activating Token Index: 96