Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2755 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.7193. Min Act: -0.1700

Data Index: 3053748 (Open Web Text)

Max Activating Token Index: 844

Text #1

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.5260. Min Act: -0.1700

Data Index: 8054599 (Open Web Text)

Max Activating Token Index: 978

Text #2

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.5090. Min Act: -0.1700

Data Index: 448910 (Open Web Text)

Max Activating Token Index: 667

Text #3

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.4742. Min Act: -0.1700

Data Index: 3340813 (Open Web Text)

Max Activating Token Index: 598

Text #4

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.4127. Min Act: -0.1700

Data Index: 1522060 (Open Web Text)

Max Activating Token Index: 502

Text #5

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.4084. Min Act: -0.1700

Data Index: 2850679 (Open Web Text)

Max Activating Token Index: 840

Text #6

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3843. Min Act: -0.1700

Data Index: 8096800 (Open Web Text)

Max Activating Token Index: 162

Text #7

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.4002. Min Act: -0.1700

Data Index: 1238216 (Open Web Text)

Max Activating Token Index: 1008

Text #8

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3942. Min Act: -0.1700

Data Index: 252944 (Open Web Text)

Max Activating Token Index: 985

Text #9

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3369. Min Act: -0.1700

Data Index: 7545803 (Open Web Text)

Max Activating Token Index: 829

Text #10

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3539. Min Act: -0.1700

Data Index: 1157360 (Open Web Text)

Max Activating Token Index: 318

Text #11

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3392. Min Act: -0.1700

Data Index: 2286988 (Open Web Text)

Max Activating Token Index: 622

Text #12

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3494. Min Act: -0.1700

Data Index: 188129 (Open Web Text)

Max Activating Token Index: 813

Text #13

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3407. Min Act: -0.1700

Data Index: 4229826 (Open Web Text)

Max Activating Token Index: 622

Text #14

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3526. Min Act: -0.1700

Data Index: 1762914 (Open Web Text)

Max Activating Token Index: 818

Text #15

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3250. Min Act: -0.1700

Data Index: 5057390 (Open Web Text)

Max Activating Token Index: 349

Text #16

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3136. Min Act: -0.1700

Data Index: 2073718 (Open Web Text)

Max Activating Token Index: 886

Text #17

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.3243. Min Act: -0.1700

Data Index: 992454 (Open Web Text)

Max Activating Token Index: 385

Text #18

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.2896. Min Act: -0.1700

Data Index: 5905786 (Open Web Text)

Max Activating Token Index: 304

Text #19

Max Range: 4.7193. Min Range: -4.7193

Max Act: 4.2856. Min Act: -0.1700

Data Index: 5998239 (Open Web Text)

Max Activating Token Index: 863