Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2756 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.3512. Min Act: -0.1700

Data Index: 6201815 (Open Web Text)

Max Activating Token Index: 31

Text #1

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.3206. Min Act: -0.1700

Data Index: 1636292 (Open Web Text)

Max Activating Token Index: 554

Text #2

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.3247. Min Act: -0.1700

Data Index: 1283242 (Open Web Text)

Max Activating Token Index: 157

Text #3

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.3117. Min Act: -0.1700

Data Index: 6923657 (Open Web Text)

Max Activating Token Index: 11

Text #4

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.3259. Min Act: -0.1700

Data Index: 1168804 (Open Web Text)

Max Activating Token Index: 346

Text #5

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2957. Min Act: -0.1700

Data Index: 8814460 (Open Web Text)

Max Activating Token Index: 315

Text #6

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.3008. Min Act: -0.1700

Data Index: 6631620 (Open Web Text)

Max Activating Token Index: 42

Text #7

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2999. Min Act: -0.1700

Data Index: 2016307 (Open Web Text)

Max Activating Token Index: 228

Text #8

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2910. Min Act: -0.1700

Data Index: 255648 (Open Web Text)

Max Activating Token Index: 301

Text #9

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2913. Min Act: -0.1700

Data Index: 5605824 (Open Web Text)

Max Activating Token Index: 45

Text #10

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2868. Min Act: -0.1700

Data Index: 7986641 (Open Web Text)

Max Activating Token Index: 271

Text #11

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2759. Min Act: -0.1700

Data Index: 6667248 (Open Web Text)

Max Activating Token Index: 64

Text #12

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2738. Min Act: -0.1700

Data Index: 7632207 (Open Web Text)

Max Activating Token Index: 179

Text #13

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2788. Min Act: -0.1700

Data Index: 4898643 (Open Web Text)

Max Activating Token Index: 285

Text #14

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2691. Min Act: -0.1700

Data Index: 7463246 (Open Web Text)

Max Activating Token Index: 114

Text #15

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2620. Min Act: -0.1700

Data Index: 8279187 (Open Web Text)

Max Activating Token Index: 679

Text #16

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2733. Min Act: -0.1700

Data Index: 1405778 (Open Web Text)

Max Activating Token Index: 102

Text #17

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2633. Min Act: -0.1700

Data Index: 6023920 (Open Web Text)

Max Activating Token Index: 221

Text #18

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2611. Min Act: -0.1700

Data Index: 4216432 (Open Web Text)

Max Activating Token Index: 351

Text #19

Max Range: 3.3512. Min Range: -3.3512

Max Act: 3.2687. Min Act: -0.1700

Data Index: 4365755 (Open Web Text)

Max Activating Token Index: 52