Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2091 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.7133. Min Act: -0.1700

Data Index: 7587410 (Open Web Text)

Max Activating Token Index: 389

Text #1

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6915. Min Act: -0.1700

Data Index: 7514876 (Open Web Text)

Max Activating Token Index: 692

Text #2

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6695. Min Act: -0.1700

Data Index: 3858589 (Open Web Text)

Max Activating Token Index: 401

Text #3

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6694. Min Act: -0.1700

Data Index: 743166 (Open Web Text)

Max Activating Token Index: 507

Text #4

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6516. Min Act: -0.1700

Data Index: 598089 (Open Web Text)

Max Activating Token Index: 931

Text #5

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6572. Min Act: -0.1700

Data Index: 4244019 (Open Web Text)

Max Activating Token Index: 426

Text #6

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6410. Min Act: -0.1700

Data Index: 6435911 (Open Web Text)

Max Activating Token Index: 629

Text #7

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6599. Min Act: -0.1700

Data Index: 2330432 (Open Web Text)

Max Activating Token Index: 508

Text #8

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6592. Min Act: -0.1700

Data Index: 2280587 (Open Web Text)

Max Activating Token Index: 340

Text #9

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6480. Min Act: -0.1700

Data Index: 7389047 (Open Web Text)

Max Activating Token Index: 226

Text #10

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6545. Min Act: -0.1700

Data Index: 5008390 (Open Web Text)

Max Activating Token Index: 372

Text #11

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6392. Min Act: -0.1700

Data Index: 5851352 (Open Web Text)

Max Activating Token Index: 375

Text #12

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6397. Min Act: -0.1700

Data Index: 6419950 (Open Web Text)

Max Activating Token Index: 518

Text #13

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6460. Min Act: -0.1699

Data Index: 6587379 (Open Web Text)

Max Activating Token Index: 359

Text #14

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6458. Min Act: -0.1700

Data Index: 7327701 (Open Web Text)

Max Activating Token Index: 776

Text #15

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6381. Min Act: -0.1700

Data Index: 3194777 (Open Web Text)

Max Activating Token Index: 6

Text #16

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6413. Min Act: -0.1548

Data Index: 4010223 (Open Web Text)

Max Activating Token Index: 41

Text #17

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6285. Min Act: -0.1700

Data Index: 1914819 (Open Web Text)

Max Activating Token Index: 169

Text #18

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6212. Min Act: -0.1700

Data Index: 7008792 (Open Web Text)

Max Activating Token Index: 978

Text #19

Max Range: 1.7133. Min Range: -1.7133

Max Act: 1.6253. Min Act: -0.1700

Data Index: 4601496 (Open Web Text)

Max Activating Token Index: 379