Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 206 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 3.1109. Min Range: -3.1109

Max Act: 3.1109. Min Act: -0.1700

Data Index: 3017890 (Open Web Text)

Max Activating Token Index: 82

Text #1

Max Range: 3.1109. Min Range: -3.1109

Max Act: 3.0321. Min Act: -0.1700

Data Index: 898019 (Open Web Text)

Max Activating Token Index: 1023

Text #2

Max Range: 3.1109. Min Range: -3.1109

Max Act: 3.0163. Min Act: -0.1700

Data Index: 620970 (Open Web Text)

Max Activating Token Index: 269

Text #3

Max Range: 3.1109. Min Range: -3.1109

Max Act: 3.0005. Min Act: -0.1700

Data Index: 6156013 (Open Web Text)

Max Activating Token Index: 503

Text #4

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9847. Min Act: -0.1700

Data Index: 2122408 (Open Web Text)

Max Activating Token Index: 267

Text #5

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9847. Min Act: -0.1700

Data Index: 5006056 (Open Web Text)

Max Activating Token Index: 77

Text #6

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9688. Min Act: -0.1700

Data Index: 1817176 (Open Web Text)

Max Activating Token Index: 444

Text #7

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9688. Min Act: -0.1700

Data Index: 7037798 (Open Web Text)

Max Activating Token Index: 619

Text #8

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9688. Min Act: -0.1700

Data Index: 6688697 (Open Web Text)

Max Activating Token Index: 867

Text #9

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9688. Min Act: -0.1700

Data Index: 888515 (Open Web Text)

Max Activating Token Index: 53

Text #10

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9688. Min Act: -0.1700

Data Index: 8344307 (Open Web Text)

Max Activating Token Index: 55

Text #11

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9688. Min Act: -0.1700

Data Index: 8012157 (Open Web Text)

Max Activating Token Index: 145

Text #12

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9688. Min Act: -0.1700

Data Index: 1274720 (Open Web Text)

Max Activating Token Index: 340

Text #13

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9688. Min Act: -0.1700

Data Index: 1272745 (Open Web Text)

Max Activating Token Index: 14

Text #14

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9688. Min Act: -0.1700

Data Index: 2101445 (Open Web Text)

Max Activating Token Index: 163

Text #15

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9530. Min Act: -0.1700

Data Index: 1095628 (Open Web Text)

Max Activating Token Index: 330

Text #16

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9530. Min Act: -0.1700

Data Index: 3638979 (Open Web Text)

Max Activating Token Index: 46

Text #17

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9530. Min Act: -0.1700

Data Index: 1703661 (Open Web Text)

Max Activating Token Index: 55

Text #18

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9530. Min Act: -0.1700

Data Index: 6259622 (Open Web Text)

Max Activating Token Index: 263

Text #19

Max Range: 3.1109. Min Range: -3.1109

Max Act: 2.9530. Min Act: -0.1700

Data Index: 27513 (Open Web Text)

Max Activating Token Index: 247