Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1461 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.4091. Min Act: -0.0995

Data Index: 6163414 (Open Web Text)

Max Activating Token Index: 1023

Text #1

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3981. Min Act: -0.0928

Data Index: 2850276 (Open Web Text)

Max Activating Token Index: 1023

Text #2

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3757. Min Act: -0.1603

Data Index: 6359146 (Open Web Text)

Max Activating Token Index: 1023

Text #3

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3787. Min Act: -0.1507

Data Index: 8455719 (Open Web Text)

Max Activating Token Index: 1016

Text #4

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3826. Min Act: -0.1583

Data Index: 7834522 (Open Web Text)

Max Activating Token Index: 1009

Text #5

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3716. Min Act: -0.1419

Data Index: 1735389 (Open Web Text)

Max Activating Token Index: 1023

Text #6

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3693. Min Act: -0.1363

Data Index: 7929544 (Open Web Text)

Max Activating Token Index: 1023

Text #7

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3407. Min Act: -0.1563

Data Index: 353961 (Open Web Text)

Max Activating Token Index: 1023

Text #8

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3583. Min Act: -0.0409

Data Index: 6042788 (Open Web Text)

Max Activating Token Index: 1014

Text #9

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3393. Min Act: -0.0543

Data Index: 143894 (Open Web Text)

Max Activating Token Index: 271

Text #10

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3480. Min Act: -0.0910

Data Index: 943920 (Open Web Text)

Max Activating Token Index: 722

Text #11

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3465. Min Act: -0.1464

Data Index: 1679151 (Open Web Text)

Max Activating Token Index: 1017

Text #12

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3482. Min Act: -0.1272

Data Index: 7739124 (Open Web Text)

Max Activating Token Index: 283

Text #13

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3473. Min Act: -0.0919

Data Index: 6246500 (Open Web Text)

Max Activating Token Index: 1023

Text #14

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3411. Min Act: -0.0772

Data Index: 4507304 (Open Web Text)

Max Activating Token Index: 257

Text #15

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3291. Min Act: -0.1686

Data Index: 5656773 (Open Web Text)

Max Activating Token Index: 1020

Text #16

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3403. Min Act: -0.1105

Data Index: 3586721 (Open Web Text)

Max Activating Token Index: 1022

Text #17

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3363. Min Act: -0.1203

Data Index: 4918577 (Open Web Text)

Max Activating Token Index: 1021

Text #18

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3398. Min Act: -0.1472

Data Index: 6121748 (Open Web Text)

Max Activating Token Index: 286

Text #19

Max Range: 1.4091. Min Range: -1.4091

Max Act: 1.3375. Min Act: -0.1449

Data Index: 2026737 (Open Web Text)

Max Activating Token Index: 190