Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1951 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.3439. Min Act: -0.1700

Data Index: 987317 (Open Web Text)

Max Activating Token Index: 71

Text #1

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.3116. Min Act: -0.1700

Data Index: 8717528 (Open Web Text)

Max Activating Token Index: 66

Text #2

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.3285. Min Act: -0.1700

Data Index: 3214110 (Open Web Text)

Max Activating Token Index: 89

Text #3

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.2872. Min Act: -0.1700

Data Index: 5740745 (Open Web Text)

Max Activating Token Index: 40

Text #4

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.2823. Min Act: -0.1700

Data Index: 987318 (Open Web Text)

Max Activating Token Index: 87

Text #5

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.2383. Min Act: -0.1700

Data Index: 8383606 (Open Web Text)

Max Activating Token Index: 441

Text #6

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.1980. Min Act: -0.1700

Data Index: 2462841 (Open Web Text)

Max Activating Token Index: 45

Text #7

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.1619. Min Act: -0.1700

Data Index: 8383602 (Open Web Text)

Max Activating Token Index: 126

Text #8

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.1671. Min Act: -0.1700

Data Index: 8383604 (Open Web Text)

Max Activating Token Index: 323

Text #9

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.1237. Min Act: -0.1700

Data Index: 987321 (Open Web Text)

Max Activating Token Index: 170

Text #10

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.1514. Min Act: -0.1700

Data Index: 4547379 (Open Web Text)

Max Activating Token Index: 164

Text #11

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.1044. Min Act: -0.1700

Data Index: 4627981 (Open Web Text)

Max Activating Token Index: 50

Text #12

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.1251. Min Act: -0.1700

Data Index: 582652 (Open Web Text)

Max Activating Token Index: 103

Text #13

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.1049. Min Act: -0.1700

Data Index: 5338240 (Open Web Text)

Max Activating Token Index: 51

Text #14

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.0904. Min Act: -0.1700

Data Index: 3879352 (Open Web Text)

Max Activating Token Index: 85

Text #15

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.0900. Min Act: -0.1700

Data Index: 5686226 (Open Web Text)

Max Activating Token Index: 64

Text #16

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.0898. Min Act: -0.1700

Data Index: 3660843 (Open Web Text)

Max Activating Token Index: 95

Text #17

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.0313. Min Act: -0.1700

Data Index: 4024526 (Open Web Text)

Max Activating Token Index: 43

Text #18

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.0310. Min Act: -0.1700

Data Index: 7796591 (Open Web Text)

Max Activating Token Index: 293

Text #19

Max Range: 6.3439. Min Range: -6.3439

Max Act: 6.0218. Min Act: -0.1700

Data Index: 5717432 (Open Web Text)

Max Activating Token Index: 95