Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1489 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.1431. Min Act: -0.1700

Data Index: 250716 (Open Web Text)

Max Activating Token Index: 2

Text #1

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.1587. Min Act: -0.1700

Data Index: 99817 (Open Web Text)

Max Activating Token Index: 5

Text #2

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.1142. Min Act: -0.1700

Data Index: 2464333 (Open Web Text)

Max Activating Token Index: 5

Text #3

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.1334. Min Act: -0.1700

Data Index: 1244067 (Open Web Text)

Max Activating Token Index: 10

Text #4

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.1127. Min Act: -0.1700

Data Index: 1780030 (Open Web Text)

Max Activating Token Index: 9

Text #5

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0793. Min Act: -0.1700

Data Index: 4483633 (Open Web Text)

Max Activating Token Index: 5

Text #6

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0957. Min Act: -0.1700

Data Index: 5201528 (Open Web Text)

Max Activating Token Index: 5

Text #7

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.1045. Min Act: -0.1700

Data Index: 2157232 (Open Web Text)

Max Activating Token Index: 8

Text #8

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0849. Min Act: -0.1700

Data Index: 1422346 (Open Web Text)

Max Activating Token Index: 4

Text #9

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0513. Min Act: -0.1700

Data Index: 6576906 (Open Web Text)

Max Activating Token Index: 4

Text #10

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0606. Min Act: -0.1700

Data Index: 7119391 (Open Web Text)

Max Activating Token Index: 7

Text #11

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0554. Min Act: -0.1700

Data Index: 3222580 (Open Web Text)

Max Activating Token Index: 7

Text #12

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0525. Min Act: -0.1700

Data Index: 3159164 (Open Web Text)

Max Activating Token Index: 8

Text #13

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0658. Min Act: -0.1700

Data Index: 2228822 (Open Web Text)

Max Activating Token Index: 7

Text #14

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0686. Min Act: -0.1700

Data Index: 203443 (Open Web Text)

Max Activating Token Index: 4

Text #15

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0518. Min Act: -0.1700

Data Index: 5313451 (Open Web Text)

Max Activating Token Index: 16

Text #16

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0484. Min Act: -0.1700

Data Index: 2689678 (Open Web Text)

Max Activating Token Index: 2

Text #17

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0443. Min Act: -0.1700

Data Index: 367415 (Open Web Text)

Max Activating Token Index: 24

Text #18

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0395. Min Act: -0.1700

Data Index: 242216 (Open Web Text)

Max Activating Token Index: 11

Text #19

Max Range: 4.1587. Min Range: -4.1587

Max Act: 4.0352. Min Act: -0.1700

Data Index: 3735061 (Open Web Text)

Max Activating Token Index: 26