Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 1709 in Layer 25

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')

Text #0

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.2555. Min Act: -0.1700

Data Index: 3424404 (Open Web Text)

Max Activating Token Index: 262

Text #1

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.1305. Min Act: -0.1700

Data Index: 8486143 (Open Web Text)

Max Activating Token Index: 982

Text #2

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.1618. Min Act: -0.1700

Data Index: 5768661 (Open Web Text)

Max Activating Token Index: 131

Text #3

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.1305. Min Act: -0.1700

Data Index: 3322170 (Open Web Text)

Max Activating Token Index: 895

Text #4

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0993. Min Act: -0.1700

Data Index: 2423815 (Open Web Text)

Max Activating Token Index: 555

Text #5

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0993. Min Act: -0.1700

Data Index: 360501 (Open Web Text)

Max Activating Token Index: 780

Text #6

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0368. Min Act: -0.1700

Data Index: 4504467 (Open Web Text)

Max Activating Token Index: 594

Text #7

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0680. Min Act: -0.1700

Data Index: 155699 (Open Web Text)

Max Activating Token Index: 226

Text #8

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0680. Min Act: -0.1700

Data Index: 381667 (Open Web Text)

Max Activating Token Index: 252

Text #9

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0680. Min Act: -0.1700

Data Index: 5578477 (Open Web Text)

Max Activating Token Index: 319

Text #10

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0368. Min Act: -0.1700

Data Index: 1739655 (Open Web Text)

Max Activating Token Index: 932

Text #11

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0368. Min Act: -0.1700

Data Index: 2077053 (Open Web Text)

Max Activating Token Index: 877

Text #12

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0368. Min Act: -0.1700

Data Index: 2035995 (Open Web Text)

Max Activating Token Index: 277

Text #13

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0680. Min Act: -0.1700

Data Index: 7204285 (Open Web Text)

Max Activating Token Index: 204

Text #14

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0368. Min Act: -0.1700

Data Index: 7866463 (Open Web Text)

Max Activating Token Index: 742

Text #15

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0055. Min Act: -0.1700

Data Index: 4014866 (Open Web Text)

Max Activating Token Index: 884

Text #16

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0368. Min Act: -0.1700

Data Index: 6753527 (Open Web Text)

Max Activating Token Index: 112

Text #17

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0055. Min Act: -0.1700

Data Index: 3846094 (Open Web Text)

Max Activating Token Index: 269

Text #18

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0055. Min Act: -0.1700

Data Index: 3902718 (Open Web Text)

Max Activating Token Index: 818

Text #19

Max Range: 5.2555. Min Range: -5.2555

Max Act: 5.0055. Min Act: -0.1700

Data Index: 4317160 (Open Web Text)

Max Activating Token Index: 922