Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2310 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.5658. Min Act: -0.1700

Data Index: 2759142 (Open Web Text)

Max Activating Token Index: 133

Text #1

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.4914. Min Act: -0.1700

Data Index: 7423445 (Open Web Text)

Max Activating Token Index: 294

Text #2

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.5012. Min Act: -0.1700

Data Index: 44792 (Open Web Text)

Max Activating Token Index: 64

Text #3

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.4592. Min Act: -0.1699

Data Index: 1832888 (Open Web Text)

Max Activating Token Index: 82

Text #4

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.4596. Min Act: -0.1700

Data Index: 44793 (Open Web Text)

Max Activating Token Index: 106

Text #5

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.4737. Min Act: -0.1700

Data Index: 6588821 (Open Web Text)

Max Activating Token Index: 717

Text #6

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.4753. Min Act: -0.1700

Data Index: 1117810 (Open Web Text)

Max Activating Token Index: 679

Text #7

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3955. Min Act: -0.1700

Data Index: 604759 (Open Web Text)

Max Activating Token Index: 110

Text #8

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3903. Min Act: -0.1700

Data Index: 2141128 (Open Web Text)

Max Activating Token Index: 599

Text #9

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.4180. Min Act: -0.1700

Data Index: 5654396 (Open Web Text)

Max Activating Token Index: 95

Text #10

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3723. Min Act: -0.1700

Data Index: 6617661 (Open Web Text)

Max Activating Token Index: 966

Text #11

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3790. Min Act: -0.1700

Data Index: 6617662 (Open Web Text)

Max Activating Token Index: 374

Text #12

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3697. Min Act: -0.1700

Data Index: 8275498 (Open Web Text)

Max Activating Token Index: 996

Text #13

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3541. Min Act: -0.1700

Data Index: 980439 (Open Web Text)

Max Activating Token Index: 130

Text #14

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3434. Min Act: -0.1700

Data Index: 6617660 (Open Web Text)

Max Activating Token Index: 992

Text #15

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3212. Min Act: -0.1700

Data Index: 980438 (Open Web Text)

Max Activating Token Index: 501

Text #16

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3345. Min Act: -0.1700

Data Index: 2935289 (Open Web Text)

Max Activating Token Index: 515

Text #17

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.3121. Min Act: -0.1700

Data Index: 400976 (Open Web Text)

Max Activating Token Index: 824

Text #18

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.2747. Min Act: -0.1700

Data Index: 2270466 (Open Web Text)

Max Activating Token Index: 67

Text #19

Max Range: 4.5658. Min Range: -4.5658

Max Act: 4.2766. Min Act: -0.1700

Data Index: 6947915 (Open Web Text)

Max Activating Token Index: 26