Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 2296 in Layer 27

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.3390. Min Act: -0.1700

Data Index: 7299217 (Open Web Text)

Max Activating Token Index: 1010

Text #1

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.2140. Min Act: -0.1700

Data Index: 5556914 (Open Web Text)

Max Activating Token Index: 879

Text #2

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1828. Min Act: -0.1700

Data Index: 8671300 (Open Web Text)

Max Activating Token Index: 619

Text #3

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1203. Min Act: -0.1700

Data Index: 6076344 (Open Web Text)

Max Activating Token Index: 542

Text #4

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1515. Min Act: -0.1700

Data Index: 7746934 (Open Web Text)

Max Activating Token Index: 164

Text #5

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.1515. Min Act: -0.1700

Data Index: 2635296 (Open Web Text)

Max Activating Token Index: 760

Text #6

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0890. Min Act: -0.1700

Data Index: 7313900 (Open Web Text)

Max Activating Token Index: 919

Text #7

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0578. Min Act: -0.1700

Data Index: 2771183 (Open Web Text)

Max Activating Token Index: 893

Text #8

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0890. Min Act: -0.1700

Data Index: 3750266 (Open Web Text)

Max Activating Token Index: 589

Text #9

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0578. Min Act: -0.1700

Data Index: 5470000 (Open Web Text)

Max Activating Token Index: 359

Text #10

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0578. Min Act: -0.1700

Data Index: 7068081 (Open Web Text)

Max Activating Token Index: 372

Text #11

Max Range: 5.3390. Min Range: -5.3390

Max Act: 5.0265. Min Act: -0.1700

Data Index: 5481284 (Open Web Text)

Max Activating Token Index: 126

Text #12

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9953. Min Act: -0.1700

Data Index: 5743899 (Open Web Text)

Max Activating Token Index: 235

Text #13

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9953. Min Act: -0.1700

Data Index: 6750864 (Open Web Text)

Max Activating Token Index: 869

Text #14

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9640. Min Act: -0.1700

Data Index: 5481283 (Open Web Text)

Max Activating Token Index: 710

Text #15

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9640. Min Act: -0.1700

Data Index: 8239754 (Open Web Text)

Max Activating Token Index: 749

Text #16

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9328. Min Act: -0.1700

Data Index: 6750865 (Open Web Text)

Max Activating Token Index: 27

Text #17

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.9015. Min Act: -0.1700

Data Index: 2635297 (Open Web Text)

Max Activating Token Index: 186

Text #18

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.8703. Min Act: -0.1700

Data Index: 437345 (Open Web Text)

Max Activating Token Index: 208

Text #19

Max Range: 5.3390. Min Range: -5.3390

Max Act: 4.8390. Min Act: -0.1700

Data Index: 5403971 (Open Web Text)

Max Activating Token Index: 1015