Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 3326 in Layer 33

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')

Text #0

Max Range: 6.1016. Min Range: -6.1016

Max Act: 6.1016. Min Act: -0.1700

Data Index: 6866573 (Open Web Text)

Max Activating Token Index: 219

Text #1

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.7891. Min Act: -0.1700

Data Index: 4484153 (Open Web Text)

Max Activating Token Index: 411

Text #2

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.7578. Min Act: -0.1700

Data Index: 4540627 (Open Web Text)

Max Activating Token Index: 1022

Text #3

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.6641. Min Act: -0.1700

Data Index: 4978957 (Open Web Text)

Max Activating Token Index: 745

Text #4

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.6328. Min Act: -0.1700

Data Index: 7834847 (Open Web Text)

Max Activating Token Index: 452

Text #5

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.5078. Min Act: -0.1700

Data Index: 3665242 (Open Web Text)

Max Activating Token Index: 408

Text #6

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.4453. Min Act: -0.1700

Data Index: 4194990 (Open Web Text)

Max Activating Token Index: 738

Text #7

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.4453. Min Act: -0.1700

Data Index: 6036525 (Open Web Text)

Max Activating Token Index: 602

Text #8

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.4453. Min Act: -0.1700

Data Index: 8619237 (Open Web Text)

Max Activating Token Index: 235

Text #9

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.4141. Min Act: -0.1700

Data Index: 7930674 (Open Web Text)

Max Activating Token Index: 1005

Text #10

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.4141. Min Act: -0.1700

Data Index: 963653 (Open Web Text)

Max Activating Token Index: 937

Text #11

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.4141. Min Act: -0.1700

Data Index: 2822364 (Open Web Text)

Max Activating Token Index: 372

Text #12

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.3516. Min Act: -0.1700

Data Index: 5393290 (Open Web Text)

Max Activating Token Index: 734

Text #13

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.3516. Min Act: -0.1700

Data Index: 2615288 (Open Web Text)

Max Activating Token Index: 750

Text #14

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.3828. Min Act: -0.1700

Data Index: 683241 (Open Web Text)

Max Activating Token Index: 779

Text #15

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.3516. Min Act: -0.1700

Data Index: 5254272 (Open Web Text)

Max Activating Token Index: 539

Text #16

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.3516. Min Act: -0.1700

Data Index: 8668066 (Open Web Text)

Max Activating Token Index: 908

Text #17

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.3516. Min Act: -0.1700

Data Index: 4484683 (Open Web Text)

Max Activating Token Index: 798

Text #18

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.3516. Min Act: -0.1700

Data Index: 1198729 (Open Web Text)

Max Activating Token Index: 85

Text #19

Max Range: 6.1016. Min Range: -6.1016

Max Act: 5.3516. Min Act: -0.1700

Data Index: 2162768 (Open Web Text)

Max Activating Token Index: 325