Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 1199 in Layer 27

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.7571. Min Act: -0.1700

Data Index: 8724965 (Open Web Text)

Max Activating Token Index: 363

Text #1

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.4133. Min Act: -0.1700

Data Index: 6718398 (Open Web Text)

Max Activating Token Index: 821

Text #2

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.3821. Min Act: -0.1700

Data Index: 6430753 (Open Web Text)

Max Activating Token Index: 528

Text #3

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.3821. Min Act: -0.1700

Data Index: 1776286 (Open Web Text)

Max Activating Token Index: 765

Text #4

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.3196. Min Act: -0.1700

Data Index: 5035786 (Open Web Text)

Max Activating Token Index: 559

Text #5

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2883. Min Act: -0.1700

Data Index: 6128524 (Open Web Text)

Max Activating Token Index: 53

Text #6

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2571. Min Act: -0.1700

Data Index: 8753247 (Open Web Text)

Max Activating Token Index: 662

Text #7

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2883. Min Act: -0.1700

Data Index: 5450468 (Open Web Text)

Max Activating Token Index: 209

Text #8

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2571. Min Act: -0.1700

Data Index: 6502926 (Open Web Text)

Max Activating Token Index: 415

Text #9

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2258. Min Act: -0.1700

Data Index: 529778 (Open Web Text)

Max Activating Token Index: 786

Text #10

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2258. Min Act: -0.1700

Data Index: 8012313 (Open Web Text)

Max Activating Token Index: 284

Text #11

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2258. Min Act: -0.1700

Data Index: 4547806 (Open Web Text)

Max Activating Token Index: 956

Text #12

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2258. Min Act: -0.1700

Data Index: 2429075 (Open Web Text)

Max Activating Token Index: 930

Text #13

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2258. Min Act: -0.1700

Data Index: 8238292 (Open Web Text)

Max Activating Token Index: 355

Text #14

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.2258. Min Act: -0.1700

Data Index: 3604024 (Open Web Text)

Max Activating Token Index: 600

Text #15

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.1946. Min Act: -0.1700

Data Index: 5314029 (Open Web Text)

Max Activating Token Index: 221

Text #16

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.1946. Min Act: -0.1700

Data Index: 8648702 (Open Web Text)

Max Activating Token Index: 442

Text #17

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.1633. Min Act: -0.1700

Data Index: 8210776 (Open Web Text)

Max Activating Token Index: 574

Text #18

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.1321. Min Act: -0.1700

Data Index: 585045 (Open Web Text)

Max Activating Token Index: 682

Text #19

Max Range: 7.7571. Min Range: -7.7571

Max Act: 7.1321. Min Act: -0.1700

Data Index: 8033472 (Open Web Text)

Max Activating Token Index: 950