Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 2063 in Layer 13

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.3390. Min Act: -0.1700

Data Index: 2801637 (Open Web Text)

Max Activating Token Index: 562

Text #1

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.3390. Min Act: -0.1700

Data Index: 8390724 (Open Web Text)

Max Activating Token Index: 753

Text #2

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.3077. Min Act: -0.1700

Data Index: 2636496 (Open Web Text)

Max Activating Token Index: 777

Text #3

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.2140. Min Act: -0.1700

Data Index: 7146379 (Open Web Text)

Max Activating Token Index: 700

Text #4

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1827. Min Act: -0.1700

Data Index: 8260746 (Open Web Text)

Max Activating Token Index: 460

Text #5

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1202. Min Act: -0.1700

Data Index: 7320989 (Open Web Text)

Max Activating Token Index: 239

Text #6

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1202. Min Act: -0.1700

Data Index: 3901308 (Open Web Text)

Max Activating Token Index: 869

Text #7

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1202. Min Act: -0.1700

Data Index: 2485084 (Open Web Text)

Max Activating Token Index: 1022

Text #8

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0890. Min Act: -0.1700

Data Index: 3245798 (Open Web Text)

Max Activating Token Index: 782

Text #9

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0890. Min Act: -0.1700

Data Index: 4116780 (Open Web Text)

Max Activating Token Index: 919

Text #10

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0577. Min Act: -0.1700

Data Index: 7673195 (Open Web Text)

Max Activating Token Index: 633

Text #11

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0577. Min Act: -0.1700

Data Index: 5243166 (Open Web Text)

Max Activating Token Index: 416

Text #12

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0265. Min Act: -0.1700

Data Index: 810056 (Open Web Text)

Max Activating Token Index: 646

Text #13

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0265. Min Act: -0.1700

Data Index: 2403570 (Open Web Text)

Max Activating Token Index: 383

Text #14

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0265. Min Act: -0.1700

Data Index: 7491118 (Open Web Text)

Max Activating Token Index: 428

Text #15

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0577. Min Act: -0.1700

Data Index: 5464740 (Open Web Text)

Max Activating Token Index: 451

Text #16

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9952. Min Act: -0.1700

Data Index: 8433074 (Open Web Text)

Max Activating Token Index: 405

Text #17

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9952. Min Act: -0.1700

Data Index: 1532518 (Open Web Text)

Max Activating Token Index: 933

Text #18

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9952. Min Act: -0.1700

Data Index: 2051305 (Open Web Text)

Max Activating Token Index: 614

Text #19

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9952. Min Act: -0.1700

Data Index: 3863771 (Open Web Text)

Max Activating Token Index: 967