Model: GPT-2 Medium: 24 Layers, 4096 Neurons per Layer

Dataset: Open Web Text

Neuron 1199 in Layer 19

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-medium')

Text #0

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.6771. Min Act: -0.1700

Data Index: 3996279 (Open Web Text)

Max Activating Token Index: 716

Text #1

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.5834. Min Act: -0.1700

Data Index: 1670694 (Open Web Text)

Max Activating Token Index: 765

Text #2

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.4271. Min Act: -0.1700

Data Index: 1892264 (Open Web Text)

Max Activating Token Index: 735

Text #3

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3959. Min Act: -0.1700

Data Index: 5392901 (Open Web Text)

Max Activating Token Index: 855

Text #4

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3646. Min Act: -0.1700

Data Index: 4133315 (Open Web Text)

Max Activating Token Index: 891

Text #5

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3646. Min Act: -0.1700

Data Index: 4697954 (Open Web Text)

Max Activating Token Index: 785

Text #6

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3334. Min Act: -0.1700

Data Index: 4196420 (Open Web Text)

Max Activating Token Index: 676

Text #7

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3646. Min Act: -0.1700

Data Index: 378225 (Open Web Text)

Max Activating Token Index: 763

Text #8

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3646. Min Act: -0.1700

Data Index: 5164126 (Open Web Text)

Max Activating Token Index: 379

Text #9

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3959. Min Act: -0.1700

Data Index: 484713 (Open Web Text)

Max Activating Token Index: 822

Text #10

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3646. Min Act: -0.1700

Data Index: 4528800 (Open Web Text)

Max Activating Token Index: 847

Text #11

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.2709. Min Act: -0.1700

Data Index: 5173549 (Open Web Text)

Max Activating Token Index: 54

Text #12

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3334. Min Act: -0.1700

Data Index: 8244755 (Open Web Text)

Max Activating Token Index: 346

Text #13

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.3021. Min Act: -0.1700

Data Index: 4179796 (Open Web Text)

Max Activating Token Index: 530

Text #14

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.2709. Min Act: -0.1700

Data Index: 198987 (Open Web Text)

Max Activating Token Index: 418

Text #15

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.2396. Min Act: -0.1700

Data Index: 7593605 (Open Web Text)

Max Activating Token Index: 701

Text #16

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.2396. Min Act: -0.1700

Data Index: 70133 (Open Web Text)

Max Activating Token Index: 245

Text #17

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.2084. Min Act: -0.1700

Data Index: 6754965 (Open Web Text)

Max Activating Token Index: 445

Text #18

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.1771. Min Act: -0.1700

Data Index: 6164208 (Open Web Text)

Max Activating Token Index: 800

Text #19

Max Range: 5.6771. Min Range: -5.6771

Max Act: 5.1771. Min Act: -0.1700

Data Index: 1832888 (Open Web Text)

Max Activating Token Index: 149