Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 1313 in Layer 18

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 3553447 (Open Web Text)

Max Activating Token Index: 578

Text #1

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.0078. Min Act: -0.1700

Data Index: 8469418 (Open Web Text)

Max Activating Token Index: 665

Text #2

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.0078. Min Act: -0.1700

Data Index: 1342005 (Open Web Text)

Max Activating Token Index: 99

Text #3

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9609. Min Act: -0.1700

Data Index: 7235178 (Open Web Text)

Max Activating Token Index: 58

Text #4

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8671. Min Act: -0.1700

Data Index: 4689845 (Open Web Text)

Max Activating Token Index: 695

Text #5

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8515. Min Act: -0.1700

Data Index: 454656 (Open Web Text)

Max Activating Token Index: 124

Text #6

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8359. Min Act: -0.1700

Data Index: 587059 (Open Web Text)

Max Activating Token Index: 184

Text #7

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8202. Min Act: -0.1700

Data Index: 736233 (Open Web Text)

Max Activating Token Index: 817

Text #8

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8046. Min Act: -0.1700

Data Index: 8697261 (Open Web Text)

Max Activating Token Index: 45

Text #9

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8046. Min Act: -0.1700

Data Index: 4705751 (Open Web Text)

Max Activating Token Index: 186

Text #10

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8046. Min Act: -0.1700

Data Index: 5260422 (Open Web Text)

Max Activating Token Index: 123

Text #11

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8046. Min Act: -0.1700

Data Index: 3595361 (Open Web Text)

Max Activating Token Index: 13

Text #12

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.7890. Min Act: -0.1700

Data Index: 7191695 (Open Web Text)

Max Activating Token Index: 524

Text #13

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.7733. Min Act: -0.1700

Data Index: 5411689 (Open Web Text)

Max Activating Token Index: 755

Text #14

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.7733. Min Act: -0.1700

Data Index: 7581281 (Open Web Text)

Max Activating Token Index: 999

Text #15

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.7577. Min Act: -0.1700

Data Index: 1814074 (Open Web Text)

Max Activating Token Index: 452

Text #16

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.7577. Min Act: -0.1700

Data Index: 2891314 (Open Web Text)

Max Activating Token Index: 571

Text #17

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.7577. Min Act: -0.1700

Data Index: 6840905 (Open Web Text)

Max Activating Token Index: 281

Text #18

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.7577. Min Act: -0.1700

Data Index: 1169137 (Open Web Text)

Max Activating Token Index: 480

Text #19

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.7420. Min Act: -0.1700

Data Index: 7860538 (Open Web Text)

Max Activating Token Index: 312