Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 1827 in Layer 12

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')

Text #0

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 526123 (Open Web Text)

Max Activating Token Index: 3

Text #1

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 63467 (Open Web Text)

Max Activating Token Index: 3

Text #2

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 1581857 (Open Web Text)

Max Activating Token Index: 3

Text #3

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 1523719 (Open Web Text)

Max Activating Token Index: 3

Text #4

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 544098 (Open Web Text)

Max Activating Token Index: 3

Text #5

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 544100 (Open Web Text)

Max Activating Token Index: 3

Text #6

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 315504 (Open Web Text)

Max Activating Token Index: 3

Text #7

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 18994 (Open Web Text)

Max Activating Token Index: 3

Text #8

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 103263 (Open Web Text)

Max Activating Token Index: 3

Text #9

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 1589419 (Open Web Text)

Max Activating Token Index: 3

Text #10

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 1424904 (Open Web Text)

Max Activating Token Index: 3

Text #11

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 1284496 (Open Web Text)

Max Activating Token Index: 3

Text #12

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 1448575 (Open Web Text)

Max Activating Token Index: 3

Text #13

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 497227 (Open Web Text)

Max Activating Token Index: 3

Text #14

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 186985 (Open Web Text)

Max Activating Token Index: 3

Text #15

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 14562 (Open Web Text)

Max Activating Token Index: 3

Text #16

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 1101471 (Open Web Text)

Max Activating Token Index: 3

Text #17

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 134171 (Open Web Text)

Max Activating Token Index: 3

Text #18

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 398679 (Open Web Text)

Max Activating Token Index: 3

Text #19

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 1340582 (Open Web Text)

Max Activating Token Index: 3