Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2932 in Layer 4

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.7242. Min Act: -0.1700

Data Index: 8340600 (Open Web Text)

Max Activating Token Index: 976

Text #1

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6906. Min Act: -0.1700

Data Index: 562020 (Open Web Text)

Max Activating Token Index: 904

Text #2

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6755. Min Act: -0.1700

Data Index: 4312672 (Open Web Text)

Max Activating Token Index: 546

Text #3

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6720. Min Act: -0.1700

Data Index: 5299727 (Open Web Text)

Max Activating Token Index: 565

Text #4

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6886. Min Act: -0.1700

Data Index: 5726993 (Open Web Text)

Max Activating Token Index: 892

Text #5

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6624. Min Act: -0.1700

Data Index: 841700 (Open Web Text)

Max Activating Token Index: 506

Text #6

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6780. Min Act: -0.1700

Data Index: 2102665 (Open Web Text)

Max Activating Token Index: 510

Text #7

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6654. Min Act: -0.1700

Data Index: 3699010 (Open Web Text)

Max Activating Token Index: 162

Text #8

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6398. Min Act: -0.1700

Data Index: 134748 (Open Web Text)

Max Activating Token Index: 322

Text #9

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6423. Min Act: -0.1700

Data Index: 1064701 (Open Web Text)

Max Activating Token Index: 377

Text #10

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6369. Min Act: -0.1700

Data Index: 7030839 (Open Web Text)

Max Activating Token Index: 855

Text #11

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6460. Min Act: -0.1700

Data Index: 3234015 (Open Web Text)

Max Activating Token Index: 38

Text #12

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6422. Min Act: -0.1700

Data Index: 2464556 (Open Web Text)

Max Activating Token Index: 938

Text #13

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6323. Min Act: -0.1700

Data Index: 7373712 (Open Web Text)

Max Activating Token Index: 872

Text #14

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6133. Min Act: -0.1700

Data Index: 689531 (Open Web Text)

Max Activating Token Index: 991

Text #15

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6064. Min Act: -0.1700

Data Index: 180671 (Open Web Text)

Max Activating Token Index: 427

Text #16

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6347. Min Act: -0.1700

Data Index: 5467373 (Open Web Text)

Max Activating Token Index: 60

Text #17

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6181. Min Act: -0.1700

Data Index: 5674431 (Open Web Text)

Max Activating Token Index: 556

Text #18

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6353. Min Act: -0.1700

Data Index: 8418242 (Open Web Text)

Max Activating Token Index: 168

Text #19

Max Range: 3.7242. Min Range: -3.7242

Max Act: 3.6422. Min Act: -0.1700

Data Index: 8617970 (Open Web Text)

Max Activating Token Index: 416