Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2735 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.9147. Min Act: -0.1700

Data Index: 6497857 (Open Web Text)

Max Activating Token Index: 4

Text #1

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.9025. Min Act: -0.1700

Data Index: 8678598 (Open Web Text)

Max Activating Token Index: 3

Text #2

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.8385. Min Act: -0.1700

Data Index: 7536313 (Open Web Text)

Max Activating Token Index: 621

Text #3

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.8038. Min Act: -0.1700

Data Index: 3140399 (Open Web Text)

Max Activating Token Index: 21

Text #4

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7993. Min Act: -0.1700

Data Index: 6237015 (Open Web Text)

Max Activating Token Index: 8

Text #5

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7836. Min Act: -0.1700

Data Index: 1895532 (Open Web Text)

Max Activating Token Index: 446

Text #6

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7653. Min Act: -0.1700

Data Index: 93701 (Open Web Text)

Max Activating Token Index: 104

Text #7

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7650. Min Act: -0.1700

Data Index: 8301702 (Open Web Text)

Max Activating Token Index: 673

Text #8

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7562. Min Act: -0.1700

Data Index: 2611081 (Open Web Text)

Max Activating Token Index: 596

Text #9

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7649. Min Act: -0.1700

Data Index: 3092851 (Open Web Text)

Max Activating Token Index: 370

Text #10

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7561. Min Act: -0.1700

Data Index: 216803 (Open Web Text)

Max Activating Token Index: 48

Text #11

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7607. Min Act: -0.1700

Data Index: 529653 (Open Web Text)

Max Activating Token Index: 9

Text #12

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7577. Min Act: -0.1700

Data Index: 5229239 (Open Web Text)

Max Activating Token Index: 58

Text #13

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7583. Min Act: -0.1700

Data Index: 268112 (Open Web Text)

Max Activating Token Index: 1000

Text #14

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7472. Min Act: -0.1700

Data Index: 429846 (Open Web Text)

Max Activating Token Index: 2

Text #15

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7419. Min Act: -0.1700

Data Index: 7732670 (Open Web Text)

Max Activating Token Index: 606

Text #16

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7400. Min Act: -0.1700

Data Index: 2951128 (Open Web Text)

Max Activating Token Index: 489

Text #17

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7478. Min Act: -0.1700

Data Index: 5748960 (Open Web Text)

Max Activating Token Index: 503

Text #18

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7374. Min Act: -0.1700

Data Index: 209196 (Open Web Text)

Max Activating Token Index: 26

Text #19

Max Range: 1.9147. Min Range: -1.9147

Max Act: 1.7356. Min Act: -0.1700

Data Index: 6082964 (Open Web Text)

Max Activating Token Index: 200