Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1946 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.7437. Min Act: -0.1700

Data Index: 6834756 (Open Web Text)

Max Activating Token Index: 366

Text #1

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6924. Min Act: -0.1700

Data Index: 3555888 (Open Web Text)

Max Activating Token Index: 48

Text #2

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6976. Min Act: -0.1700

Data Index: 405839 (Open Web Text)

Max Activating Token Index: 964

Text #3

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6870. Min Act: -0.1700

Data Index: 1604370 (Open Web Text)

Max Activating Token Index: 46

Text #4

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6719. Min Act: -0.1700

Data Index: 5355596 (Open Web Text)

Max Activating Token Index: 236

Text #5

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6640. Min Act: -0.1700

Data Index: 3586483 (Open Web Text)

Max Activating Token Index: 857

Text #6

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6507. Min Act: -0.1700

Data Index: 4885448 (Open Web Text)

Max Activating Token Index: 81

Text #7

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6392. Min Act: -0.1699

Data Index: 2857367 (Open Web Text)

Max Activating Token Index: 996

Text #8

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6421. Min Act: -0.1700

Data Index: 280084 (Open Web Text)

Max Activating Token Index: 570

Text #9

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6294. Min Act: -0.1700

Data Index: 1501195 (Open Web Text)

Max Activating Token Index: 452

Text #10

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6334. Min Act: -0.1700

Data Index: 5642368 (Open Web Text)

Max Activating Token Index: 119

Text #11

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6344. Min Act: -0.1700

Data Index: 2386187 (Open Web Text)

Max Activating Token Index: 42

Text #12

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6316. Min Act: -0.1700

Data Index: 4322380 (Open Web Text)

Max Activating Token Index: 32

Text #13

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6314. Min Act: -0.1700

Data Index: 2406270 (Open Web Text)

Max Activating Token Index: 1022

Text #14

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6113. Min Act: -0.1700

Data Index: 6556413 (Open Web Text)

Max Activating Token Index: 601

Text #15

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6190. Min Act: -0.1700

Data Index: 2285108 (Open Web Text)

Max Activating Token Index: 995

Text #16

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6152. Min Act: -0.1700

Data Index: 5047744 (Open Web Text)

Max Activating Token Index: 307

Text #17

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6134. Min Act: -0.1700

Data Index: 2963342 (Open Web Text)

Max Activating Token Index: 975

Text #18

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.6085. Min Act: -0.1700

Data Index: 420197 (Open Web Text)

Max Activating Token Index: 51

Text #19

Max Range: 1.7437. Min Range: -1.7437

Max Act: 1.5917. Min Act: -0.1700

Data Index: 1915810 (Open Web Text)

Max Activating Token Index: 83