Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2388 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.0917. Min Range: -4.0917

Max Act: 4.0917. Min Act: -0.1700

Data Index: 3143240 (Open Web Text)

Max Activating Token Index: 189

Text #1

Max Range: 4.0917. Min Range: -4.0917

Max Act: 4.0323. Min Act: -0.1700

Data Index: 1960682 (Open Web Text)

Max Activating Token Index: 414

Text #2

Max Range: 4.0917. Min Range: -4.0917

Max Act: 4.0214. Min Act: -0.1700

Data Index: 1287422 (Open Web Text)

Max Activating Token Index: 264

Text #3

Max Range: 4.0917. Min Range: -4.0917

Max Act: 4.0240. Min Act: -0.1700

Data Index: 8172495 (Open Web Text)

Max Activating Token Index: 547

Text #4

Max Range: 4.0917. Min Range: -4.0917

Max Act: 4.0041. Min Act: -0.1700

Data Index: 1258583 (Open Web Text)

Max Activating Token Index: 593

Text #5

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9685. Min Act: -0.1700

Data Index: 263786 (Open Web Text)

Max Activating Token Index: 657

Text #6

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9726. Min Act: -0.1700

Data Index: 3143241 (Open Web Text)

Max Activating Token Index: 237

Text #7

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9421. Min Act: -0.1700

Data Index: 2481298 (Open Web Text)

Max Activating Token Index: 290

Text #8

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9431. Min Act: -0.1700

Data Index: 3151615 (Open Web Text)

Max Activating Token Index: 529

Text #9

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9318. Min Act: -0.1700

Data Index: 490450 (Open Web Text)

Max Activating Token Index: 484

Text #10

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9459. Min Act: -0.1700

Data Index: 1460105 (Open Web Text)

Max Activating Token Index: 75

Text #11

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9114. Min Act: -0.1700

Data Index: 6136958 (Open Web Text)

Max Activating Token Index: 327

Text #12

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9062. Min Act: -0.1700

Data Index: 47033 (Open Web Text)

Max Activating Token Index: 881

Text #13

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9206. Min Act: -0.1700

Data Index: 554485 (Open Web Text)

Max Activating Token Index: 223

Text #14

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.8907. Min Act: -0.1700

Data Index: 2893644 (Open Web Text)

Max Activating Token Index: 370

Text #15

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.9120. Min Act: -0.1700

Data Index: 4928626 (Open Web Text)

Max Activating Token Index: 573

Text #16

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.8589. Min Act: -0.1700

Data Index: 5857090 (Open Web Text)

Max Activating Token Index: 418

Text #17

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.8775. Min Act: -0.1700

Data Index: 2465208 (Open Web Text)

Max Activating Token Index: 583

Text #18

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.8839. Min Act: -0.1700

Data Index: 3995689 (Open Web Text)

Max Activating Token Index: 349

Text #19

Max Range: 4.0917. Min Range: -4.0917

Max Act: 3.8764. Min Act: -0.1700

Data Index: 4241757 (Open Web Text)

Max Activating Token Index: 447