Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2244 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.3286. Min Act: -0.1700

Data Index: 5567424 (Open Web Text)

Max Activating Token Index: 2

Text #1

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.2737. Min Act: -0.1700

Data Index: 4876787 (Open Web Text)

Max Activating Token Index: 4

Text #2

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.2006. Min Act: -0.1700

Data Index: 7898720 (Open Web Text)

Max Activating Token Index: 4

Text #3

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1892. Min Act: -0.1700

Data Index: 254658 (Open Web Text)

Max Activating Token Index: 4

Text #4

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1624. Min Act: -0.1700

Data Index: 2861711 (Open Web Text)

Max Activating Token Index: 11

Text #5

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1476. Min Act: -0.1700

Data Index: 5630010 (Open Web Text)

Max Activating Token Index: 4

Text #6

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1178. Min Act: -0.1700

Data Index: 8319877 (Open Web Text)

Max Activating Token Index: 4

Text #7

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1178. Min Act: -0.1700

Data Index: 7677926 (Open Web Text)

Max Activating Token Index: 4

Text #8

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.0959. Min Act: -0.1700

Data Index: 1395921 (Open Web Text)

Max Activating Token Index: 5

Text #9

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1024. Min Act: -0.1700

Data Index: 6330010 (Open Web Text)

Max Activating Token Index: 4

Text #10

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.0923. Min Act: -0.1700

Data Index: 5738737 (Open Web Text)

Max Activating Token Index: 4

Text #11

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1143. Min Act: -0.1700

Data Index: 5094294 (Open Web Text)

Max Activating Token Index: 3

Text #12

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1143. Min Act: -0.1700

Data Index: 1101938 (Open Web Text)

Max Activating Token Index: 3

Text #13

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.0860. Min Act: -0.1700

Data Index: 3041728 (Open Web Text)

Max Activating Token Index: 4

Text #14

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.0999. Min Act: -0.1700

Data Index: 1643743 (Open Web Text)

Max Activating Token Index: 4

Text #15

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1122. Min Act: -0.1700

Data Index: 4858151 (Open Web Text)

Max Activating Token Index: 5

Text #16

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1141. Min Act: -0.1700

Data Index: 4829413 (Open Web Text)

Max Activating Token Index: 12

Text #17

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1222. Min Act: -0.1700

Data Index: 4338296 (Open Web Text)

Max Activating Token Index: 3

Text #18

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1048. Min Act: -0.1700

Data Index: 664065 (Open Web Text)

Max Activating Token Index: 11

Text #19

Max Range: 4.3286. Min Range: -4.3286

Max Act: 4.1222. Min Act: -0.1700

Data Index: 466869 (Open Web Text)

Max Activating Token Index: 3