Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2898 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5694. Min Act: -0.1700

Data Index: 7370886 (Open Web Text)

Max Activating Token Index: 1022

Text #1

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5705. Min Act: -0.1700

Data Index: 2406129 (Open Web Text)

Max Activating Token Index: 567

Text #2

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5650. Min Act: -0.1700

Data Index: 6273826 (Open Web Text)

Max Activating Token Index: 194

Text #3

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5725. Min Act: -0.1700

Data Index: 5283744 (Open Web Text)

Max Activating Token Index: 586

Text #4

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5571. Min Act: -0.1700

Data Index: 3460316 (Open Web Text)

Max Activating Token Index: 92

Text #5

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5650. Min Act: -0.1700

Data Index: 5809191 (Open Web Text)

Max Activating Token Index: 198

Text #6

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5412. Min Act: -0.1700

Data Index: 6743050 (Open Web Text)

Max Activating Token Index: 453

Text #7

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5504. Min Act: -0.1700

Data Index: 5279479 (Open Web Text)

Max Activating Token Index: 572

Text #8

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5416. Min Act: -0.1700

Data Index: 3033840 (Open Web Text)

Max Activating Token Index: 710

Text #9

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5430. Min Act: -0.1700

Data Index: 539040 (Open Web Text)

Max Activating Token Index: 593

Text #10

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5338. Min Act: -0.1700

Data Index: 5770097 (Open Web Text)

Max Activating Token Index: 57

Text #11

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5309. Min Act: -0.1700

Data Index: 4433770 (Open Web Text)

Max Activating Token Index: 782

Text #12

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5269. Min Act: -0.1700

Data Index: 2883203 (Open Web Text)

Max Activating Token Index: 495

Text #13

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5291. Min Act: -0.1700

Data Index: 3604236 (Open Web Text)

Max Activating Token Index: 372

Text #14

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5249. Min Act: -0.1700

Data Index: 6578872 (Open Web Text)

Max Activating Token Index: 770

Text #15

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5164. Min Act: -0.1700

Data Index: 2986920 (Open Web Text)

Max Activating Token Index: 904

Text #16

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5152. Min Act: -0.1700

Data Index: 4663486 (Open Web Text)

Max Activating Token Index: 410

Text #17

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5274. Min Act: -0.1700

Data Index: 3530709 (Open Web Text)

Max Activating Token Index: 545

Text #18

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5166. Min Act: -0.1700

Data Index: 3018176 (Open Web Text)

Max Activating Token Index: 546

Text #19

Max Range: 1.5725. Min Range: -1.5725

Max Act: 1.5106. Min Act: -0.1700

Data Index: 859256 (Open Web Text)

Max Activating Token Index: 292