Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 3063 in Layer 26

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')

Text #0

Max Range: 7.1016. Min Range: -7.1016

Max Act: 7.1016. Min Act: -0.1700

Data Index: 6569680 (Open Web Text)

Max Activating Token Index: 145

Text #1

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.7891. Min Act: -0.1700

Data Index: 7531796 (Open Web Text)

Max Activating Token Index: 798

Text #2

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.7578. Min Act: -0.1700

Data Index: 2750208 (Open Web Text)

Max Activating Token Index: 986

Text #3

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.7266. Min Act: -0.1700

Data Index: 7861691 (Open Web Text)

Max Activating Token Index: 965

Text #4

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.6328. Min Act: -0.1700

Data Index: 3523244 (Open Web Text)

Max Activating Token Index: 477

Text #5

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.6328. Min Act: -0.1700

Data Index: 1580955 (Open Web Text)

Max Activating Token Index: 882

Text #6

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.5703. Min Act: -0.1700

Data Index: 7365343 (Open Web Text)

Max Activating Token Index: 621

Text #7

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.5078. Min Act: -0.1700

Data Index: 6003201 (Open Web Text)

Max Activating Token Index: 526

Text #8

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.4453. Min Act: -0.1700

Data Index: 2475615 (Open Web Text)

Max Activating Token Index: 225

Text #9

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.4453. Min Act: -0.1700

Data Index: 3916140 (Open Web Text)

Max Activating Token Index: 695

Text #10

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.4141. Min Act: -0.1700

Data Index: 1217916 (Open Web Text)

Max Activating Token Index: 538

Text #11

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.4141. Min Act: -0.1700

Data Index: 6840503 (Open Web Text)

Max Activating Token Index: 258

Text #12

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.4141. Min Act: -0.1700

Data Index: 6590225 (Open Web Text)

Max Activating Token Index: 507

Text #13

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.3828. Min Act: -0.1700

Data Index: 663879 (Open Web Text)

Max Activating Token Index: 167

Text #14

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.3203. Min Act: -0.1700

Data Index: 7571642 (Open Web Text)

Max Activating Token Index: 582

Text #15

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.3516. Min Act: -0.1700

Data Index: 7768154 (Open Web Text)

Max Activating Token Index: 509

Text #16

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.3828. Min Act: -0.1700

Data Index: 283431 (Open Web Text)

Max Activating Token Index: 178

Text #17

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.2891. Min Act: -0.1700

Data Index: 8075149 (Open Web Text)

Max Activating Token Index: 878

Text #18

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.3203. Min Act: -0.1700

Data Index: 841794 (Open Web Text)

Max Activating Token Index: 196

Text #19

Max Range: 7.1016. Min Range: -7.1016

Max Act: 6.2891. Min Act: -0.1700

Data Index: 4601573 (Open Web Text)

Max Activating Token Index: 492