Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2399 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.8829. Min Act: -0.1700

Data Index: 8503811 (Open Web Text)

Max Activating Token Index: 26

Text #1

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.8105. Min Act: -0.1700

Data Index: 6064150 (Open Web Text)

Max Activating Token Index: 133

Text #2

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7735. Min Act: -0.1700

Data Index: 8745334 (Open Web Text)

Max Activating Token Index: 11

Text #3

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7707. Min Act: -0.1700

Data Index: 566900 (Open Web Text)

Max Activating Token Index: 767

Text #4

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7548. Min Act: -0.1700

Data Index: 7867401 (Open Web Text)

Max Activating Token Index: 355

Text #5

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7377. Min Act: -0.1700

Data Index: 6064152 (Open Web Text)

Max Activating Token Index: 466

Text #6

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7404. Min Act: -0.1700

Data Index: 1713223 (Open Web Text)

Max Activating Token Index: 531

Text #7

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7297. Min Act: -0.1700

Data Index: 1544883 (Open Web Text)

Max Activating Token Index: 85

Text #8

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7226. Min Act: -0.1700

Data Index: 235934 (Open Web Text)

Max Activating Token Index: 348

Text #9

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7160. Min Act: -0.1700

Data Index: 2666758 (Open Web Text)

Max Activating Token Index: 129

Text #10

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7088. Min Act: -0.1700

Data Index: 8503808 (Open Web Text)

Max Activating Token Index: 847

Text #11

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7179. Min Act: -0.1700

Data Index: 4478356 (Open Web Text)

Max Activating Token Index: 26

Text #12

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.6993. Min Act: -0.1700

Data Index: 8218442 (Open Web Text)

Max Activating Token Index: 193

Text #13

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7123. Min Act: -0.1700

Data Index: 1781046 (Open Web Text)

Max Activating Token Index: 1008

Text #14

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7140. Min Act: -0.1700

Data Index: 1271819 (Open Web Text)

Max Activating Token Index: 517

Text #15

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7032. Min Act: -0.1700

Data Index: 1299999 (Open Web Text)

Max Activating Token Index: 388

Text #16

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.7112. Min Act: -0.1700

Data Index: 2082255 (Open Web Text)

Max Activating Token Index: 995

Text #17

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.6923. Min Act: -0.1700

Data Index: 1142996 (Open Web Text)

Max Activating Token Index: 781

Text #18

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.6983. Min Act: -0.1700

Data Index: 7568815 (Open Web Text)

Max Activating Token Index: 62

Text #19

Max Range: 1.8829. Min Range: -1.8829

Max Act: 1.6940. Min Act: -0.1700

Data Index: 3210361 (Open Web Text)

Max Activating Token Index: 1015