Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 5535 in Layer 46

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.7571. Min Act: -0.1700

Data Index: 1793334 (Open Web Text)

Max Activating Token Index: 129

Text #1

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.5383. Min Act: -0.1700

Data Index: 306298 (Open Web Text)

Max Activating Token Index: 440

Text #2

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.4446. Min Act: -0.1700

Data Index: 4769593 (Open Web Text)

Max Activating Token Index: 679

Text #3

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.4446. Min Act: -0.1700

Data Index: 5701005 (Open Web Text)

Max Activating Token Index: 901

Text #4

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.4446. Min Act: -0.1700

Data Index: 5201243 (Open Web Text)

Max Activating Token Index: 1016

Text #5

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.4133. Min Act: -0.1700

Data Index: 8302819 (Open Web Text)

Max Activating Token Index: 145

Text #6

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.4446. Min Act: -0.1700

Data Index: 7638993 (Open Web Text)

Max Activating Token Index: 409

Text #7

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.3508. Min Act: -0.1700

Data Index: 2183975 (Open Web Text)

Max Activating Token Index: 696

Text #8

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.3508. Min Act: -0.1700

Data Index: 4096737 (Open Web Text)

Max Activating Token Index: 313

Text #9

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.3821. Min Act: -0.1700

Data Index: 3115329 (Open Web Text)

Max Activating Token Index: 385

Text #10

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.3508. Min Act: -0.1700

Data Index: 3846872 (Open Web Text)

Max Activating Token Index: 329

Text #11

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2571. Min Act: -0.1700

Data Index: 1020196 (Open Web Text)

Max Activating Token Index: 135

Text #12

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2571. Min Act: -0.1700

Data Index: 6844794 (Open Web Text)

Max Activating Token Index: 863

Text #13

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2571. Min Act: -0.1700

Data Index: 1569847 (Open Web Text)

Max Activating Token Index: 224

Text #14

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2571. Min Act: -0.1700

Data Index: 5976450 (Open Web Text)

Max Activating Token Index: 612

Text #15

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2571. Min Act: -0.1700

Data Index: 7054579 (Open Web Text)

Max Activating Token Index: 472

Text #16

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2258. Min Act: -0.1700

Data Index: 93280 (Open Web Text)

Max Activating Token Index: 776

Text #17

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.1946. Min Act: -0.1700

Data Index: 2672940 (Open Web Text)

Max Activating Token Index: 563

Text #18

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2571. Min Act: -0.1700

Data Index: 4642964 (Open Web Text)

Max Activating Token Index: 337

Text #19

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2571. Min Act: -0.1700

Data Index: 7388320 (Open Web Text)

Max Activating Token Index: 266