Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 1384 in Layer 13

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')

Text #0

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.3390. Min Act: -0.1700

Data Index: 4361573 (Open Web Text)

Max Activating Token Index: 496

Text #1

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.1819. Min Act: -0.1700

Data Index: 6764745 (Open Web Text)

Max Activating Token Index: 944

Text #2

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.1662. Min Act: -0.1700

Data Index: 750535 (Open Web Text)

Max Activating Token Index: 420

Text #3

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.1505. Min Act: -0.1700

Data Index: 4327324 (Open Web Text)

Max Activating Token Index: 1004

Text #4

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.1662. Min Act: -0.1700

Data Index: 3706068 (Open Web Text)

Max Activating Token Index: 1010

Text #5

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.1662. Min Act: -0.1700

Data Index: 1645666 (Open Web Text)

Max Activating Token Index: 572

Text #6

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.1505. Min Act: -0.1700

Data Index: 3062032 (Open Web Text)

Max Activating Token Index: 847

Text #7

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.1347. Min Act: -0.1700

Data Index: 3714031 (Open Web Text)

Max Activating Token Index: 781

Text #8

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0875. Min Act: -0.1700

Data Index: 4632872 (Open Web Text)

Max Activating Token Index: 758

Text #9

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0717. Min Act: -0.1700

Data Index: 5437716 (Open Web Text)

Max Activating Token Index: 880

Text #10

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0875. Min Act: -0.1700

Data Index: 7243657 (Open Web Text)

Max Activating Token Index: 753

Text #11

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0401. Min Act: -0.1700

Data Index: 1511170 (Open Web Text)

Max Activating Token Index: 754

Text #12

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0559. Min Act: -0.1700

Data Index: 7329717 (Open Web Text)

Max Activating Token Index: 998

Text #13

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0559. Min Act: -0.1700

Data Index: 2670878 (Open Web Text)

Max Activating Token Index: 358

Text #14

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0401. Min Act: -0.1700

Data Index: 1904132 (Open Web Text)

Max Activating Token Index: 572

Text #15

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0401. Min Act: -0.1700

Data Index: 7984503 (Open Web Text)

Max Activating Token Index: 883

Text #16

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0243. Min Act: -0.1700

Data Index: 6790190 (Open Web Text)

Max Activating Token Index: 757

Text #17

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0401. Min Act: -0.1700

Data Index: 1376370 (Open Web Text)

Max Activating Token Index: 951

Text #18

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0401. Min Act: -0.1700

Data Index: 1025378 (Open Web Text)

Max Activating Token Index: 1014

Text #19

Max Range: 3.3390. Min Range: -3.3390

Max Act: 3.0559. Min Act: -0.1700

Data Index: 2117381 (Open Web Text)

Max Activating Token Index: 630