Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 5998 in Layer 24

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.3425. Min Act: -0.1700

Data Index: 6335536 (Open Web Text)

Max Activating Token Index: 692

Text #1

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.3737. Min Act: -0.1700

Data Index: 3853501 (Open Web Text)

Max Activating Token Index: 864

Text #2

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.3737. Min Act: -0.1700

Data Index: 2896842 (Open Web Text)

Max Activating Token Index: 851

Text #3

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.3737. Min Act: -0.1700

Data Index: 515765 (Open Web Text)

Max Activating Token Index: 540

Text #4

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.3112. Min Act: -0.1700

Data Index: 5839990 (Open Web Text)

Max Activating Token Index: 786

Text #5

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.3112. Min Act: -0.1700

Data Index: 4659010 (Open Web Text)

Max Activating Token Index: 503

Text #6

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.3112. Min Act: -0.1700

Data Index: 6523292 (Open Web Text)

Max Activating Token Index: 356

Text #7

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2487. Min Act: -0.1700

Data Index: 3652242 (Open Web Text)

Max Activating Token Index: 822

Text #8

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2800. Min Act: -0.1700

Data Index: 8644747 (Open Web Text)

Max Activating Token Index: 733

Text #9

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2800. Min Act: -0.1700

Data Index: 6961614 (Open Web Text)

Max Activating Token Index: 852

Text #10

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2800. Min Act: -0.1700

Data Index: 1237542 (Open Web Text)

Max Activating Token Index: 778

Text #11

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2800. Min Act: -0.1700

Data Index: 3648931 (Open Web Text)

Max Activating Token Index: 874

Text #12

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2800. Min Act: -0.1700

Data Index: 5196361 (Open Web Text)

Max Activating Token Index: 927

Text #13

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.3112. Min Act: -0.1700

Data Index: 6377782 (Open Web Text)

Max Activating Token Index: 387

Text #14

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2487. Min Act: -0.1700

Data Index: 4157097 (Open Web Text)

Max Activating Token Index: 408

Text #15

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2487. Min Act: -0.1700

Data Index: 4175411 (Open Web Text)

Max Activating Token Index: 982

Text #16

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2487. Min Act: -0.1700

Data Index: 1671848 (Open Web Text)

Max Activating Token Index: 709

Text #17

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2487. Min Act: -0.1700

Data Index: 4459943 (Open Web Text)

Max Activating Token Index: 950

Text #18

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2487. Min Act: -0.1700

Data Index: 5055865 (Open Web Text)

Max Activating Token Index: 707

Text #19

Max Range: 5.3737. Min Range: -5.3737

Max Act: 5.2487. Min Act: -0.1700

Data Index: 3006979 (Open Web Text)

Max Activating Token Index: 581