Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2555 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.3149. Min Act: -0.1700

Data Index: 177552 (Open Web Text)

Max Activating Token Index: 47

Text #1

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.2452. Min Act: -0.1700

Data Index: 6826907 (Open Web Text)

Max Activating Token Index: 16

Text #2

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.2363. Min Act: -0.1700

Data Index: 5511436 (Open Web Text)

Max Activating Token Index: 19

Text #3

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.2232. Min Act: -0.1700

Data Index: 8057110 (Open Web Text)

Max Activating Token Index: 803

Text #4

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.2156. Min Act: -0.1700

Data Index: 17373 (Open Web Text)

Max Activating Token Index: 517

Text #5

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.2109. Min Act: -0.1700

Data Index: 5282828 (Open Web Text)

Max Activating Token Index: 14

Text #6

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.2023. Min Act: -0.1700

Data Index: 1645049 (Open Web Text)

Max Activating Token Index: 357

Text #7

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1862. Min Act: -0.1700

Data Index: 154410 (Open Web Text)

Max Activating Token Index: 415

Text #8

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1997. Min Act: -0.1700

Data Index: 7463992 (Open Web Text)

Max Activating Token Index: 767

Text #9

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1762. Min Act: -0.1700

Data Index: 3852471 (Open Web Text)

Max Activating Token Index: 255

Text #10

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1759. Min Act: -0.1700

Data Index: 6497335 (Open Web Text)

Max Activating Token Index: 859

Text #11

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1690. Min Act: -0.1700

Data Index: 7293627 (Open Web Text)

Max Activating Token Index: 270

Text #12

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1658. Min Act: -0.1700

Data Index: 1689715 (Open Web Text)

Max Activating Token Index: 17

Text #13

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1594. Min Act: -0.1700

Data Index: 1983766 (Open Web Text)

Max Activating Token Index: 23

Text #14

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1596. Min Act: -0.1700

Data Index: 6768196 (Open Web Text)

Max Activating Token Index: 189

Text #15

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1561. Min Act: -0.1700

Data Index: 1925483 (Open Web Text)

Max Activating Token Index: 45

Text #16

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1496. Min Act: -0.1700

Data Index: 6346157 (Open Web Text)

Max Activating Token Index: 391

Text #17

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1472. Min Act: -0.1700

Data Index: 4946348 (Open Web Text)

Max Activating Token Index: 247

Text #18

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1523. Min Act: -0.1700

Data Index: 2704160 (Open Web Text)

Max Activating Token Index: 108

Text #19

Max Range: 3.3149. Min Range: -3.3149

Max Act: 3.1486. Min Act: -0.1700

Data Index: 947752 (Open Web Text)

Max Activating Token Index: 25