Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2372 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.7018. Min Act: -0.1700

Data Index: 805512 (Open Web Text)

Max Activating Token Index: 461

Text #1

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.6190. Min Act: -0.1700

Data Index: 1850589 (Open Web Text)

Max Activating Token Index: 406

Text #2

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.6234. Min Act: -0.1700

Data Index: 8030987 (Open Web Text)

Max Activating Token Index: 80

Text #3

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.6145. Min Act: -0.1700

Data Index: 5886521 (Open Web Text)

Max Activating Token Index: 372

Text #4

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.6231. Min Act: -0.1697

Data Index: 8195919 (Open Web Text)

Max Activating Token Index: 889

Text #5

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.6050. Min Act: -0.1700

Data Index: 5917443 (Open Web Text)

Max Activating Token Index: 50

Text #6

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5987. Min Act: -0.1696

Data Index: 873303 (Open Web Text)

Max Activating Token Index: 487

Text #7

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.6064. Min Act: -0.1700

Data Index: 2896366 (Open Web Text)

Max Activating Token Index: 100

Text #8

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5930. Min Act: -0.1700

Data Index: 4459583 (Open Web Text)

Max Activating Token Index: 8

Text #9

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5878. Min Act: -0.1700

Data Index: 1383714 (Open Web Text)

Max Activating Token Index: 387

Text #10

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5798. Min Act: -0.1700

Data Index: 4532326 (Open Web Text)

Max Activating Token Index: 284

Text #11

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5773. Min Act: -0.1700

Data Index: 1873274 (Open Web Text)

Max Activating Token Index: 840

Text #12

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5814. Min Act: -0.1698

Data Index: 3151122 (Open Web Text)

Max Activating Token Index: 804

Text #13

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5745. Min Act: -0.1700

Data Index: 8632097 (Open Web Text)

Max Activating Token Index: 29

Text #14

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5722. Min Act: -0.1700

Data Index: 1613307 (Open Web Text)

Max Activating Token Index: 652

Text #15

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5789. Min Act: -0.1700

Data Index: 3677538 (Open Web Text)

Max Activating Token Index: 454

Text #16

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5595. Min Act: -0.1700

Data Index: 8418579 (Open Web Text)

Max Activating Token Index: 11

Text #17

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5648. Min Act: -0.1700

Data Index: 4217253 (Open Web Text)

Max Activating Token Index: 109

Text #18

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5710. Min Act: -0.1700

Data Index: 4060024 (Open Web Text)

Max Activating Token Index: 39

Text #19

Max Range: 1.7018. Min Range: -1.7018

Max Act: 1.5710. Min Act: -0.1691

Data Index: 7502192 (Open Web Text)

Max Activating Token Index: 429