Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 171 in Layer 34

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.3130. Min Act: -0.1700

Data Index: 8416895 (Open Web Text)

Max Activating Token Index: 618

Text #1

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.3442. Min Act: -0.1700

Data Index: 6875919 (Open Web Text)

Max Activating Token Index: 885

Text #2

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.3130. Min Act: -0.1700

Data Index: 8786186 (Open Web Text)

Max Activating Token Index: 757

Text #3

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.2192. Min Act: -0.1700

Data Index: 2036039 (Open Web Text)

Max Activating Token Index: 247

Text #4

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.1880. Min Act: -0.1700

Data Index: 7667832 (Open Web Text)

Max Activating Token Index: 431

Text #5

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.1567. Min Act: -0.1700

Data Index: 2741286 (Open Web Text)

Max Activating Token Index: 565

Text #6

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.1567. Min Act: -0.1700

Data Index: 1885405 (Open Web Text)

Max Activating Token Index: 659

Text #7

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.1255. Min Act: -0.1700

Data Index: 6628114 (Open Web Text)

Max Activating Token Index: 45

Text #8

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.1255. Min Act: -0.1700

Data Index: 1965470 (Open Web Text)

Max Activating Token Index: 15

Text #9

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0942. Min Act: -0.1700

Data Index: 2203359 (Open Web Text)

Max Activating Token Index: 591

Text #10

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0630. Min Act: -0.1700

Data Index: 7758835 (Open Web Text)

Max Activating Token Index: 198

Text #11

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0630. Min Act: -0.1700

Data Index: 7162934 (Open Web Text)

Max Activating Token Index: 735

Text #12

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0630. Min Act: -0.1700

Data Index: 1573110 (Open Web Text)

Max Activating Token Index: 529

Text #13

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0630. Min Act: -0.1700

Data Index: 78576 (Open Web Text)

Max Activating Token Index: 680

Text #14

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0630. Min Act: -0.1700

Data Index: 2372381 (Open Web Text)

Max Activating Token Index: 53

Text #15

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0317. Min Act: -0.1700

Data Index: 7929518 (Open Web Text)

Max Activating Token Index: 753

Text #16

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0317. Min Act: -0.1700

Data Index: 7961968 (Open Web Text)

Max Activating Token Index: 151

Text #17

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0317. Min Act: -0.1700

Data Index: 5464136 (Open Web Text)

Max Activating Token Index: 885

Text #18

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0317. Min Act: -0.1700

Data Index: 304627 (Open Web Text)

Max Activating Token Index: 226

Text #19

Max Range: 5.3442. Min Range: -5.3442

Max Act: 5.0317. Min Act: -0.1700

Data Index: 5788463 (Open Web Text)

Max Activating Token Index: 766