Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2065 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1917. Min Act: -0.1700

Data Index: 2432569 (Open Web Text)

Max Activating Token Index: 421

Text #1

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1749. Min Act: -0.1700

Data Index: 5392566 (Open Web Text)

Max Activating Token Index: 93

Text #2

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1735. Min Act: -0.1700

Data Index: 4356473 (Open Web Text)

Max Activating Token Index: 208

Text #3

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1668. Min Act: -0.1700

Data Index: 7494224 (Open Web Text)

Max Activating Token Index: 776

Text #4

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1506. Min Act: -0.1700

Data Index: 8573280 (Open Web Text)

Max Activating Token Index: 365

Text #5

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1641. Min Act: -0.1700

Data Index: 7956319 (Open Web Text)

Max Activating Token Index: 561

Text #6

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1048. Min Act: -0.1700

Data Index: 6849882 (Open Web Text)

Max Activating Token Index: 513

Text #7

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1039. Min Act: -0.1700

Data Index: 7676566 (Open Web Text)

Max Activating Token Index: 456

Text #8

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1304. Min Act: -0.1700

Data Index: 8810853 (Open Web Text)

Max Activating Token Index: 670

Text #9

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.0962. Min Act: -0.1700

Data Index: 7778074 (Open Web Text)

Max Activating Token Index: 1017

Text #10

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1226. Min Act: -0.1700

Data Index: 5783905 (Open Web Text)

Max Activating Token Index: 540

Text #11

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.1362. Min Act: -0.1700

Data Index: 1743846 (Open Web Text)

Max Activating Token Index: 505

Text #12

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.0860. Min Act: -0.1700

Data Index: 5525730 (Open Web Text)

Max Activating Token Index: 782

Text #13

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.0903. Min Act: -0.1700

Data Index: 6405168 (Open Web Text)

Max Activating Token Index: 609

Text #14

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.0976. Min Act: -0.1700

Data Index: 1653882 (Open Web Text)

Max Activating Token Index: 272

Text #15

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.0627. Min Act: -0.1700

Data Index: 69075 (Open Web Text)

Max Activating Token Index: 1010

Text #16

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.0719. Min Act: -0.1700

Data Index: 5166277 (Open Web Text)

Max Activating Token Index: 315

Text #17

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.0802. Min Act: -0.1700

Data Index: 2832017 (Open Web Text)

Max Activating Token Index: 750

Text #18

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.0451. Min Act: -0.1700

Data Index: 4275912 (Open Web Text)

Max Activating Token Index: 550

Text #19

Max Range: 4.1917. Min Range: -4.1917

Max Act: 4.0258. Min Act: -0.1700

Data Index: 6428159 (Open Web Text)

Max Activating Token Index: 320