Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2311 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.2540. Min Act: -0.1700

Data Index: 3288946 (Open Web Text)

Max Activating Token Index: 943

Text #1

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.1958. Min Act: -0.1700

Data Index: 5960537 (Open Web Text)

Max Activating Token Index: 813

Text #2

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.1789. Min Act: -0.1700

Data Index: 6244659 (Open Web Text)

Max Activating Token Index: 142

Text #3

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.1631. Min Act: -0.1700

Data Index: 5153061 (Open Web Text)

Max Activating Token Index: 465

Text #4

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.1210. Min Act: -0.1700

Data Index: 566009 (Open Web Text)

Max Activating Token Index: 799

Text #5

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.0412. Min Act: -0.1700

Data Index: 3820487 (Open Web Text)

Max Activating Token Index: 619

Text #6

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.0376. Min Act: -0.1700

Data Index: 4914957 (Open Web Text)

Max Activating Token Index: 628

Text #7

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.0280. Min Act: -0.1700

Data Index: 2456886 (Open Web Text)

Max Activating Token Index: 182

Text #8

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.0224. Min Act: -0.1700

Data Index: 2456884 (Open Web Text)

Max Activating Token Index: 265

Text #9

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.0291. Min Act: -0.1700

Data Index: 499990 (Open Web Text)

Max Activating Token Index: 81

Text #10

Max Range: 6.2540. Min Range: -6.2540

Max Act: 5.9989. Min Act: -0.1700

Data Index: 5270298 (Open Web Text)

Max Activating Token Index: 409

Text #11

Max Range: 6.2540. Min Range: -6.2540

Max Act: 6.0161. Min Act: -0.1700

Data Index: 86028 (Open Web Text)

Max Activating Token Index: 396

Text #12

Max Range: 6.2540. Min Range: -6.2540

Max Act: 5.9654. Min Act: -0.1700

Data Index: 2463050 (Open Web Text)

Max Activating Token Index: 674

Text #13

Max Range: 6.2540. Min Range: -6.2540

Max Act: 5.9733. Min Act: -0.1700

Data Index: 875528 (Open Web Text)

Max Activating Token Index: 169

Text #14

Max Range: 6.2540. Min Range: -6.2540

Max Act: 5.9359. Min Act: -0.1700

Data Index: 6913319 (Open Web Text)

Max Activating Token Index: 945

Text #15

Max Range: 6.2540. Min Range: -6.2540

Max Act: 5.9596. Min Act: -0.1700

Data Index: 6458520 (Open Web Text)

Max Activating Token Index: 135

Text #16

Max Range: 6.2540. Min Range: -6.2540

Max Act: 5.9623. Min Act: -0.1700

Data Index: 4753757 (Open Web Text)

Max Activating Token Index: 76

Text #17

Max Range: 6.2540. Min Range: -6.2540

Max Act: 5.9466. Min Act: -0.1700

Data Index: 5809226 (Open Web Text)

Max Activating Token Index: 760

Text #18

Max Range: 6.2540. Min Range: -6.2540

Max Act: 5.9309. Min Act: -0.1700

Data Index: 1295619 (Open Web Text)

Max Activating Token Index: 867

Text #19

Max Range: 6.2540. Min Range: -6.2540

Max Act: 5.9369. Min Act: -0.1700

Data Index: 4136035 (Open Web Text)

Max Activating Token Index: 240