Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1752 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.2324. Min Act: -0.1700

Data Index: 6209031 (Open Web Text)

Max Activating Token Index: 303

Text #1

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.2355. Min Act: -0.1700

Data Index: 3560466 (Open Web Text)

Max Activating Token Index: 364

Text #2

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.2095. Min Act: -0.1700

Data Index: 2289717 (Open Web Text)

Max Activating Token Index: 323

Text #3

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.1973. Min Act: -0.1700

Data Index: 3560447 (Open Web Text)

Max Activating Token Index: 758

Text #4

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.1432. Min Act: -0.1700

Data Index: 5153891 (Open Web Text)

Max Activating Token Index: 744

Text #5

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.1193. Min Act: -0.1700

Data Index: 5469004 (Open Web Text)

Max Activating Token Index: 627

Text #6

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.1458. Min Act: -0.1700

Data Index: 3099350 (Open Web Text)

Max Activating Token Index: 968

Text #7

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.1339. Min Act: -0.1700

Data Index: 8367962 (Open Web Text)

Max Activating Token Index: 342

Text #8

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.1076. Min Act: -0.1700

Data Index: 8257207 (Open Web Text)

Max Activating Token Index: 690

Text #9

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0892. Min Act: -0.1700

Data Index: 6648671 (Open Web Text)

Max Activating Token Index: 351

Text #10

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0753. Min Act: -0.1700

Data Index: 3931756 (Open Web Text)

Max Activating Token Index: 469

Text #11

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0878. Min Act: -0.1700

Data Index: 5669369 (Open Web Text)

Max Activating Token Index: 944

Text #12

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0998. Min Act: -0.1700

Data Index: 5657907 (Open Web Text)

Max Activating Token Index: 911

Text #13

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0666. Min Act: -0.1700

Data Index: 8367975 (Open Web Text)

Max Activating Token Index: 38

Text #14

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0778. Min Act: -0.1700

Data Index: 953442 (Open Web Text)

Max Activating Token Index: 152

Text #15

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0284. Min Act: -0.1700

Data Index: 3099338 (Open Web Text)

Max Activating Token Index: 485

Text #16

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0394. Min Act: -0.1700

Data Index: 1942462 (Open Web Text)

Max Activating Token Index: 959

Text #17

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0629. Min Act: -0.1700

Data Index: 1383665 (Open Web Text)

Max Activating Token Index: 984

Text #18

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0717. Min Act: -0.1700

Data Index: 868359 (Open Web Text)

Max Activating Token Index: 452

Text #19

Max Range: 4.2355. Min Range: -4.2355

Max Act: 4.0542. Min Act: -0.1700

Data Index: 3099357 (Open Web Text)

Max Activating Token Index: 149