Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 5865 in Layer 22

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.8320. Min Act: -0.1700

Data Index: 3729870 (Open Web Text)

Max Activating Token Index: 997

Text #1

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.7695. Min Act: -0.1700

Data Index: 3657210 (Open Web Text)

Max Activating Token Index: 173

Text #2

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.6757. Min Act: -0.1700

Data Index: 8346385 (Open Web Text)

Max Activating Token Index: 366

Text #3

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.6132. Min Act: -0.1700

Data Index: 1703516 (Open Web Text)

Max Activating Token Index: 369

Text #4

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.6132. Min Act: -0.1700

Data Index: 4562581 (Open Web Text)

Max Activating Token Index: 599

Text #5

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.6132. Min Act: -0.1700

Data Index: 7362894 (Open Web Text)

Max Activating Token Index: 861

Text #6

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5820. Min Act: -0.1700

Data Index: 6665166 (Open Web Text)

Max Activating Token Index: 333

Text #7

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5820. Min Act: -0.1700

Data Index: 6132869 (Open Web Text)

Max Activating Token Index: 319

Text #8

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.6132. Min Act: -0.1700

Data Index: 4566030 (Open Web Text)

Max Activating Token Index: 865

Text #9

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5820. Min Act: -0.1700

Data Index: 8370043 (Open Web Text)

Max Activating Token Index: 392

Text #10

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5820. Min Act: -0.1700

Data Index: 8718157 (Open Web Text)

Max Activating Token Index: 661

Text #11

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5195. Min Act: -0.1700

Data Index: 33377 (Open Web Text)

Max Activating Token Index: 936

Text #12

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5507. Min Act: -0.1700

Data Index: 3764843 (Open Web Text)

Max Activating Token Index: 316

Text #13

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5507. Min Act: -0.1700

Data Index: 2315470 (Open Web Text)

Max Activating Token Index: 572

Text #14

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5507. Min Act: -0.1700

Data Index: 4756552 (Open Web Text)

Max Activating Token Index: 585

Text #15

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5195. Min Act: -0.1700

Data Index: 3235550 (Open Web Text)

Max Activating Token Index: 441

Text #16

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5195. Min Act: -0.1700

Data Index: 4837104 (Open Web Text)

Max Activating Token Index: 619

Text #17

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5195. Min Act: -0.1700

Data Index: 3898308 (Open Web Text)

Max Activating Token Index: 983

Text #18

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5195. Min Act: -0.1700

Data Index: 968606 (Open Web Text)

Max Activating Token Index: 689

Text #19

Max Range: 5.8320. Min Range: -5.8320

Max Act: 5.5195. Min Act: -0.1700

Data Index: 8782010 (Open Web Text)

Max Activating Token Index: 549