Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1316 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8562. Min Act: -0.1700

Data Index: 7615122 (Open Web Text)

Max Activating Token Index: 5

Text #1

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8382. Min Act: -0.1700

Data Index: 3040805 (Open Web Text)

Max Activating Token Index: 5

Text #2

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8244. Min Act: -0.1700

Data Index: 6606846 (Open Web Text)

Max Activating Token Index: 18

Text #3

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8212. Min Act: -0.1700

Data Index: 1902962 (Open Web Text)

Max Activating Token Index: 78

Text #4

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8186. Min Act: -0.1700

Data Index: 5959240 (Open Web Text)

Max Activating Token Index: 17

Text #5

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8164. Min Act: -0.1700

Data Index: 6431482 (Open Web Text)

Max Activating Token Index: 3

Text #6

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8101. Min Act: -0.1700

Data Index: 8657879 (Open Web Text)

Max Activating Token Index: 4

Text #7

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8164. Min Act: -0.1700

Data Index: 6457933 (Open Web Text)

Max Activating Token Index: 3

Text #8

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8164. Min Act: -0.1700

Data Index: 565869 (Open Web Text)

Max Activating Token Index: 3

Text #9

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8092. Min Act: -0.1700

Data Index: 8136598 (Open Web Text)

Max Activating Token Index: 9

Text #10

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8021. Min Act: -0.1700

Data Index: 819805 (Open Web Text)

Max Activating Token Index: 4

Text #11

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.7999. Min Act: -0.1700

Data Index: 1352791 (Open Web Text)

Max Activating Token Index: 530

Text #12

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.7991. Min Act: -0.1700

Data Index: 4112234 (Open Web Text)

Max Activating Token Index: 5

Text #13

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8074. Min Act: -0.1700

Data Index: 1340205 (Open Web Text)

Max Activating Token Index: 156

Text #14

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.7925. Min Act: -0.1700

Data Index: 778931 (Open Web Text)

Max Activating Token Index: 180

Text #15

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.8018. Min Act: -0.1700

Data Index: 3107624 (Open Web Text)

Max Activating Token Index: 7

Text #16

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.7935. Min Act: -0.1700

Data Index: 1658008 (Open Web Text)

Max Activating Token Index: 12

Text #17

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.7876. Min Act: -0.1700

Data Index: 688102 (Open Web Text)

Max Activating Token Index: 3

Text #18

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.7921. Min Act: -0.1700

Data Index: 3416128 (Open Web Text)

Max Activating Token Index: 10

Text #19

Max Range: 1.8562. Min Range: -1.8562

Max Act: 1.7968. Min Act: -0.1700

Data Index: 4607803 (Open Web Text)

Max Activating Token Index: 167