Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 4856 in Layer 13

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')

Text #0

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.3390. Min Act: -0.1700

Data Index: 7945453 (Open Web Text)

Max Activating Token Index: 430

Text #1

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1827. Min Act: -0.1700

Data Index: 6207219 (Open Web Text)

Max Activating Token Index: 526

Text #2

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1515. Min Act: -0.1700

Data Index: 3150155 (Open Web Text)

Max Activating Token Index: 635

Text #3

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1202. Min Act: -0.1700

Data Index: 3485961 (Open Web Text)

Max Activating Token Index: 3

Text #4

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0577. Min Act: -0.1700

Data Index: 3005331 (Open Web Text)

Max Activating Token Index: 370

Text #5

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0265. Min Act: -0.1700

Data Index: 5679041 (Open Web Text)

Max Activating Token Index: 172

Text #6

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0265. Min Act: -0.1700

Data Index: 3412275 (Open Web Text)

Max Activating Token Index: 697

Text #7

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0265. Min Act: -0.1700

Data Index: 3473382 (Open Web Text)

Max Activating Token Index: 815

Text #8

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9952. Min Act: -0.1700

Data Index: 5501185 (Open Web Text)

Max Activating Token Index: 58

Text #9

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9952. Min Act: -0.1700

Data Index: 2848608 (Open Web Text)

Max Activating Token Index: 477

Text #10

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9640. Min Act: -0.1700

Data Index: 4716969 (Open Web Text)

Max Activating Token Index: 598

Text #11

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9640. Min Act: -0.1700

Data Index: 4335972 (Open Web Text)

Max Activating Token Index: 14

Text #12

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9640. Min Act: -0.1700

Data Index: 5236594 (Open Web Text)

Max Activating Token Index: 288

Text #13

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9640. Min Act: -0.1700

Data Index: 8744414 (Open Web Text)

Max Activating Token Index: 316

Text #14

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9327. Min Act: -0.1700

Data Index: 5188658 (Open Web Text)

Max Activating Token Index: 435

Text #15

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9327. Min Act: -0.1700

Data Index: 5226675 (Open Web Text)

Max Activating Token Index: 786

Text #16

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9327. Min Act: -0.1700

Data Index: 5639515 (Open Web Text)

Max Activating Token Index: 121

Text #17

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9327. Min Act: -0.1700

Data Index: 5219056 (Open Web Text)

Max Activating Token Index: 914

Text #18

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9640. Min Act: -0.1700

Data Index: 5358252 (Open Web Text)

Max Activating Token Index: 981

Text #19

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9327. Min Act: -0.1700

Data Index: 1313498 (Open Web Text)

Max Activating Token Index: 499