Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2445 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.2023. Min Act: -0.1700

Data Index: 690518 (Open Web Text)

Max Activating Token Index: 355

Text #1

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.1753. Min Act: -0.1700

Data Index: 3047941 (Open Web Text)

Max Activating Token Index: 603

Text #2

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.1389. Min Act: -0.1700

Data Index: 823269 (Open Web Text)

Max Activating Token Index: 59

Text #3

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.1367. Min Act: -0.1700

Data Index: 7304451 (Open Web Text)

Max Activating Token Index: 289

Text #4

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.1230. Min Act: -0.1700

Data Index: 6451015 (Open Web Text)

Max Activating Token Index: 454

Text #5

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.1166. Min Act: -0.1700

Data Index: 4533060 (Open Web Text)

Max Activating Token Index: 666

Text #6

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.1106. Min Act: -0.1700

Data Index: 989070 (Open Web Text)

Max Activating Token Index: 440

Text #7

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.1130. Min Act: -0.1700

Data Index: 1608301 (Open Web Text)

Max Activating Token Index: 310

Text #8

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.1102. Min Act: -0.1700

Data Index: 781721 (Open Web Text)

Max Activating Token Index: 586

Text #9

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0839. Min Act: -0.1700

Data Index: 230161 (Open Web Text)

Max Activating Token Index: 96

Text #10

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0818. Min Act: -0.1700

Data Index: 7192220 (Open Web Text)

Max Activating Token Index: 300

Text #11

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0805. Min Act: -0.1700

Data Index: 1330021 (Open Web Text)

Max Activating Token Index: 252

Text #12

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0640. Min Act: -0.1700

Data Index: 4924775 (Open Web Text)

Max Activating Token Index: 737

Text #13

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0643. Min Act: -0.1700

Data Index: 3680693 (Open Web Text)

Max Activating Token Index: 739

Text #14

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0755. Min Act: -0.1700

Data Index: 7321425 (Open Web Text)

Max Activating Token Index: 926

Text #15

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0548. Min Act: -0.1700

Data Index: 5559987 (Open Web Text)

Max Activating Token Index: 471

Text #16

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0385. Min Act: -0.1700

Data Index: 1970691 (Open Web Text)

Max Activating Token Index: 430

Text #17

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0311. Min Act: -0.1700

Data Index: 4326175 (Open Web Text)

Max Activating Token Index: 237

Text #18

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0142. Min Act: -0.1700

Data Index: 4744466 (Open Web Text)

Max Activating Token Index: 355

Text #19

Max Range: 3.2023. Min Range: -3.2023

Max Act: 3.0244. Min Act: -0.1700

Data Index: 3366087 (Open Web Text)

Max Activating Token Index: 454