Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2751 in Layer 3

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.4379. Min Act: -0.1700

Data Index: 80071 (Open Web Text)

Max Activating Token Index: 198

Text #1

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3496. Min Act: -0.1700

Data Index: 8273535 (Open Web Text)

Max Activating Token Index: 310

Text #2

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3393. Min Act: -0.1700

Data Index: 4358469 (Open Web Text)

Max Activating Token Index: 651

Text #3

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3810. Min Act: -0.1700

Data Index: 5883634 (Open Web Text)

Max Activating Token Index: 813

Text #4

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3428. Min Act: -0.1700

Data Index: 8482462 (Open Web Text)

Max Activating Token Index: 558

Text #5

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3788. Min Act: -0.1700

Data Index: 6815024 (Open Web Text)

Max Activating Token Index: 25

Text #6

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3270. Min Act: -0.1700

Data Index: 6665934 (Open Web Text)

Max Activating Token Index: 202

Text #7

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3639. Min Act: -0.1700

Data Index: 4358476 (Open Web Text)

Max Activating Token Index: 378

Text #8

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3200. Min Act: -0.1700

Data Index: 4358466 (Open Web Text)

Max Activating Token Index: 661

Text #9

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3086. Min Act: -0.1700

Data Index: 3606339 (Open Web Text)

Max Activating Token Index: 259

Text #10

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.2241. Min Act: -0.1700

Data Index: 5808018 (Open Web Text)

Max Activating Token Index: 747

Text #11

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3474. Min Act: -0.1700

Data Index: 287675 (Open Web Text)

Max Activating Token Index: 51

Text #12

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3782. Min Act: -0.1700

Data Index: 5883620 (Open Web Text)

Max Activating Token Index: 821

Text #13

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3138. Min Act: -0.1700

Data Index: 4090854 (Open Web Text)

Max Activating Token Index: 576

Text #14

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3121. Min Act: -0.1700

Data Index: 8489000 (Open Web Text)

Max Activating Token Index: 292

Text #15

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.2905. Min Act: -0.1700

Data Index: 6459555 (Open Web Text)

Max Activating Token Index: 20

Text #16

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.2929. Min Act: -0.1700

Data Index: 8318064 (Open Web Text)

Max Activating Token Index: 6

Text #17

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.2678. Min Act: -0.1700

Data Index: 8177973 (Open Web Text)

Max Activating Token Index: 409

Text #18

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.3082. Min Act: -0.1700

Data Index: 332175 (Open Web Text)

Max Activating Token Index: 675

Text #19

Max Range: 3.4379. Min Range: -3.4379

Max Act: 3.2787. Min Act: -0.1700

Data Index: 8158869 (Open Web Text)

Max Activating Token Index: 7