Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 4390 in Layer 35

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 7.1109. Min Range: -7.1109

Max Act: 7.1109. Min Act: -0.1700

Data Index: 7146518 (Open Web Text)

Max Activating Token Index: 699

Text #1

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.9547. Min Act: -0.1700

Data Index: 5446592 (Open Web Text)

Max Activating Token Index: 961

Text #2

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.9547. Min Act: -0.1700

Data Index: 7602075 (Open Web Text)

Max Activating Token Index: 292

Text #3

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.8297. Min Act: -0.1700

Data Index: 2498650 (Open Web Text)

Max Activating Token Index: 130

Text #4

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.8297. Min Act: -0.1700

Data Index: 2752613 (Open Web Text)

Max Activating Token Index: 126

Text #5

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.7984. Min Act: -0.1700

Data Index: 2066070 (Open Web Text)

Max Activating Token Index: 367

Text #6

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.6734. Min Act: -0.1700

Data Index: 543589 (Open Web Text)

Max Activating Token Index: 821

Text #7

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.6109. Min Act: -0.1700

Data Index: 291060 (Open Web Text)

Max Activating Token Index: 619

Text #8

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5797. Min Act: -0.1700

Data Index: 1135071 (Open Web Text)

Max Activating Token Index: 912

Text #9

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.6109. Min Act: -0.1700

Data Index: 4399108 (Open Web Text)

Max Activating Token Index: 361

Text #10

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5797. Min Act: -0.1700

Data Index: 2149914 (Open Web Text)

Max Activating Token Index: 38

Text #11

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5797. Min Act: -0.1700

Data Index: 4362031 (Open Web Text)

Max Activating Token Index: 774

Text #12

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5797. Min Act: -0.1700

Data Index: 7561323 (Open Web Text)

Max Activating Token Index: 521

Text #13

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.6109. Min Act: -0.1700

Data Index: 1344700 (Open Web Text)

Max Activating Token Index: 29

Text #14

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5797. Min Act: -0.1700

Data Index: 6910150 (Open Web Text)

Max Activating Token Index: 247

Text #15

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5797. Min Act: -0.1700

Data Index: 7224246 (Open Web Text)

Max Activating Token Index: 224

Text #16

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5484. Min Act: -0.1700

Data Index: 8591258 (Open Web Text)

Max Activating Token Index: 462

Text #17

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5484. Min Act: -0.1700

Data Index: 8803945 (Open Web Text)

Max Activating Token Index: 583

Text #18

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5172. Min Act: -0.1700

Data Index: 5548895 (Open Web Text)

Max Activating Token Index: 293

Text #19

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.4859. Min Act: -0.1700

Data Index: 4853527 (Open Web Text)

Max Activating Token Index: 395