Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 913 in Layer 12

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 7.2181. Min Range: -7.2181

Max Act: 7.2181. Min Act: -0.1700

Data Index: 4493676 (Open Web Text)

Max Activating Token Index: 455

Text #1

Max Range: 7.2181. Min Range: -7.2181

Max Act: 7.1243. Min Act: -0.1700

Data Index: 6299647 (Open Web Text)

Max Activating Token Index: 427

Text #2

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.9681. Min Act: -0.1700

Data Index: 6299636 (Open Web Text)

Max Activating Token Index: 875

Text #3

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.8118. Min Act: -0.1699

Data Index: 8755503 (Open Web Text)

Max Activating Token Index: 97

Text #4

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.7806. Min Act: -0.1700

Data Index: 7872396 (Open Web Text)

Max Activating Token Index: 384

Text #5

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.7806. Min Act: -0.1700

Data Index: 2927234 (Open Web Text)

Max Activating Token Index: 842

Text #6

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.7806. Min Act: -0.1700

Data Index: 5412072 (Open Web Text)

Max Activating Token Index: 207

Text #7

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.7493. Min Act: -0.1700

Data Index: 8233823 (Open Web Text)

Max Activating Token Index: 492

Text #8

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.7181. Min Act: -0.1700

Data Index: 7616442 (Open Web Text)

Max Activating Token Index: 359

Text #9

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.6556. Min Act: -0.1700

Data Index: 7393294 (Open Web Text)

Max Activating Token Index: 901

Text #10

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.6556. Min Act: -0.1700

Data Index: 794399 (Open Web Text)

Max Activating Token Index: 927

Text #11

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.6243. Min Act: -0.1700

Data Index: 7979608 (Open Web Text)

Max Activating Token Index: 245

Text #12

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.6243. Min Act: -0.1700

Data Index: 1805718 (Open Web Text)

Max Activating Token Index: 468

Text #13

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.5618. Min Act: -0.1700

Data Index: 7979610 (Open Web Text)

Max Activating Token Index: 562

Text #14

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.5931. Min Act: -0.1700

Data Index: 4661885 (Open Web Text)

Max Activating Token Index: 318

Text #15

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.5618. Min Act: -0.1700

Data Index: 4337007 (Open Web Text)

Max Activating Token Index: 311

Text #16

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.5306. Min Act: -0.1700

Data Index: 1246235 (Open Web Text)

Max Activating Token Index: 627

Text #17

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.5306. Min Act: -0.1700

Data Index: 1805723 (Open Web Text)

Max Activating Token Index: 341

Text #18

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.4993. Min Act: -0.1700

Data Index: 1420975 (Open Web Text)

Max Activating Token Index: 2

Text #19

Max Range: 7.2181. Min Range: -7.2181

Max Act: 6.4368. Min Act: -0.1700

Data Index: 2035591 (Open Web Text)

Max Activating Token Index: 32