Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 6007 in Layer 37

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.8080. Min Act: -0.1700

Data Index: 6631645 (Open Web Text)

Max Activating Token Index: 1022

Text #1

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.5580. Min Act: -0.1700

Data Index: 8826641 (Open Web Text)

Max Activating Token Index: 811

Text #2

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.5580. Min Act: -0.1700

Data Index: 2591071 (Open Web Text)

Max Activating Token Index: 698

Text #3

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.5268. Min Act: -0.1700

Data Index: 5468302 (Open Web Text)

Max Activating Token Index: 927

Text #4

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.4330. Min Act: -0.1700

Data Index: 3870389 (Open Web Text)

Max Activating Token Index: 1023

Text #5

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.4330. Min Act: -0.1700

Data Index: 7543084 (Open Web Text)

Max Activating Token Index: 775

Text #6

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.4018. Min Act: -0.1700

Data Index: 2202622 (Open Web Text)

Max Activating Token Index: 882

Text #7

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.4018. Min Act: -0.1700

Data Index: 1960260 (Open Web Text)

Max Activating Token Index: 720

Text #8

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.3393. Min Act: -0.1700

Data Index: 4578685 (Open Web Text)

Max Activating Token Index: 795

Text #9

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.3393. Min Act: -0.1700

Data Index: 82695 (Open Web Text)

Max Activating Token Index: 973

Text #10

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.2768. Min Act: -0.1700

Data Index: 611099 (Open Web Text)

Max Activating Token Index: 866

Text #11

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.2455. Min Act: -0.1700

Data Index: 5000802 (Open Web Text)

Max Activating Token Index: 661

Text #12

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.2143. Min Act: -0.1700

Data Index: 7581743 (Open Web Text)

Max Activating Token Index: 973

Text #13

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.2143. Min Act: -0.1700

Data Index: 4599788 (Open Web Text)

Max Activating Token Index: 92

Text #14

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.2143. Min Act: -0.1700

Data Index: 3534601 (Open Web Text)

Max Activating Token Index: 481

Text #15

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.1830. Min Act: -0.1700

Data Index: 1571820 (Open Web Text)

Max Activating Token Index: 99

Text #16

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.1830. Min Act: -0.1700

Data Index: 5513465 (Open Web Text)

Max Activating Token Index: 634

Text #17

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.1518. Min Act: -0.1700

Data Index: 5547407 (Open Web Text)

Max Activating Token Index: 340

Text #18

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.1205. Min Act: -0.1700

Data Index: 7410558 (Open Web Text)

Max Activating Token Index: 204

Text #19

Max Range: 7.8080. Min Range: -7.8080

Max Act: 7.1205. Min Act: -0.1700

Data Index: 7025862 (Open Web Text)

Max Activating Token Index: 908