Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 462 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.8644. Min Act: -0.1700

Data Index: 3419202 (Open Web Text)

Max Activating Token Index: 395

Text #1

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.8154. Min Act: -0.1700

Data Index: 2389035 (Open Web Text)

Max Activating Token Index: 514

Text #2

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.8039. Min Act: -0.1700

Data Index: 1424937 (Open Web Text)

Max Activating Token Index: 737

Text #3

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7861. Min Act: -0.1700

Data Index: 5274688 (Open Web Text)

Max Activating Token Index: 1022

Text #4

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7917. Min Act: -0.1700

Data Index: 2241668 (Open Web Text)

Max Activating Token Index: 272

Text #5

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7905. Min Act: -0.1700

Data Index: 7933813 (Open Web Text)

Max Activating Token Index: 229

Text #6

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7891. Min Act: -0.1700

Data Index: 4373069 (Open Web Text)

Max Activating Token Index: 367

Text #7

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7818. Min Act: -0.1700

Data Index: 6166732 (Open Web Text)

Max Activating Token Index: 88

Text #8

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7731. Min Act: -0.1700

Data Index: 6238091 (Open Web Text)

Max Activating Token Index: 743

Text #9

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7638. Min Act: -0.1700

Data Index: 3401519 (Open Web Text)

Max Activating Token Index: 39

Text #10

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7682. Min Act: -0.1700

Data Index: 3234213 (Open Web Text)

Max Activating Token Index: 274

Text #11

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7637. Min Act: -0.1700

Data Index: 8450110 (Open Web Text)

Max Activating Token Index: 556

Text #12

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7540. Min Act: -0.1700

Data Index: 8827483 (Open Web Text)

Max Activating Token Index: 608

Text #13

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7538. Min Act: -0.1700

Data Index: 4948765 (Open Web Text)

Max Activating Token Index: 732

Text #14

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7506. Min Act: -0.1700

Data Index: 4364854 (Open Web Text)

Max Activating Token Index: 228

Text #15

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7594. Min Act: -0.1700

Data Index: 8281760 (Open Web Text)

Max Activating Token Index: 573

Text #16

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7355. Min Act: -0.1700

Data Index: 6671344 (Open Web Text)

Max Activating Token Index: 548

Text #17

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7408. Min Act: -0.1700

Data Index: 7765117 (Open Web Text)

Max Activating Token Index: 620

Text #18

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7425. Min Act: -0.1700

Data Index: 740674 (Open Web Text)

Max Activating Token Index: 238

Text #19

Max Range: 1.8644. Min Range: -1.8644

Max Act: 1.7359. Min Act: -0.1700

Data Index: 4678899 (Open Web Text)

Max Activating Token Index: 138