Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1822 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.5845. Min Act: -0.1700

Data Index: 4196955 (Open Web Text)

Max Activating Token Index: 580

Text #1

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.4672. Min Act: -0.1700

Data Index: 7055623 (Open Web Text)

Max Activating Token Index: 392

Text #2

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.4455. Min Act: -0.1700

Data Index: 6913051 (Open Web Text)

Max Activating Token Index: 28

Text #3

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.3584. Min Act: -0.1700

Data Index: 3632376 (Open Web Text)

Max Activating Token Index: 238

Text #4

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.3434. Min Act: -0.1700

Data Index: 3137011 (Open Web Text)

Max Activating Token Index: 541

Text #5

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.3547. Min Act: -0.1700

Data Index: 7143276 (Open Web Text)

Max Activating Token Index: 198

Text #6

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.3465. Min Act: -0.1700

Data Index: 7183771 (Open Web Text)

Max Activating Token Index: 20

Text #7

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.3275. Min Act: -0.1700

Data Index: 1234867 (Open Web Text)

Max Activating Token Index: 243

Text #8

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2976. Min Act: -0.1700

Data Index: 3801528 (Open Web Text)

Max Activating Token Index: 697

Text #9

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2815. Min Act: -0.1700

Data Index: 4025026 (Open Web Text)

Max Activating Token Index: 13

Text #10

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2819. Min Act: -0.1700

Data Index: 7277238 (Open Web Text)

Max Activating Token Index: 139

Text #11

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2687. Min Act: -0.1700

Data Index: 4803618 (Open Web Text)

Max Activating Token Index: 863

Text #12

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2502. Min Act: -0.1700

Data Index: 634824 (Open Web Text)

Max Activating Token Index: 915

Text #13

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2632. Min Act: -0.1700

Data Index: 8772969 (Open Web Text)

Max Activating Token Index: 109

Text #14

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2525. Min Act: -0.1700

Data Index: 954247 (Open Web Text)

Max Activating Token Index: 10

Text #15

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2405. Min Act: -0.1700

Data Index: 600763 (Open Web Text)

Max Activating Token Index: 396

Text #16

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2635. Min Act: -0.1700

Data Index: 3285214 (Open Web Text)

Max Activating Token Index: 746

Text #17

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2424. Min Act: -0.1700

Data Index: 92926 (Open Web Text)

Max Activating Token Index: 501

Text #18

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2350. Min Act: -0.1700

Data Index: 3542907 (Open Web Text)

Max Activating Token Index: 678

Text #19

Max Range: 3.5845. Min Range: -3.5845

Max Act: 3.2320. Min Act: -0.1700

Data Index: 4899052 (Open Web Text)

Max Activating Token Index: 40