Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1656 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.6071. Min Act: -0.1700

Data Index: 1301995 (Open Web Text)

Max Activating Token Index: 707

Text #1

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.5542. Min Act: -0.1700

Data Index: 8314592 (Open Web Text)

Max Activating Token Index: 253

Text #2

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.5546. Min Act: -0.1700

Data Index: 5659437 (Open Web Text)

Max Activating Token Index: 314

Text #3

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.5411. Min Act: -0.1700

Data Index: 465405 (Open Web Text)

Max Activating Token Index: 479

Text #4

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.5078. Min Act: -0.1700

Data Index: 1589871 (Open Web Text)

Max Activating Token Index: 1010

Text #5

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.4758. Min Act: -0.1700

Data Index: 7532000 (Open Web Text)

Max Activating Token Index: 320

Text #6

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.4579. Min Act: -0.1700

Data Index: 3497064 (Open Web Text)

Max Activating Token Index: 26

Text #7

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.4213. Min Act: -0.1700

Data Index: 2121335 (Open Web Text)

Max Activating Token Index: 317

Text #8

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.4106. Min Act: -0.1700

Data Index: 7666801 (Open Web Text)

Max Activating Token Index: 341

Text #9

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.4213. Min Act: -0.1700

Data Index: 3237187 (Open Web Text)

Max Activating Token Index: 941

Text #10

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.4299. Min Act: -0.1700

Data Index: 272125 (Open Web Text)

Max Activating Token Index: 463

Text #11

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.3584. Min Act: -0.1700

Data Index: 7102665 (Open Web Text)

Max Activating Token Index: 1010

Text #12

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.3686. Min Act: -0.1700

Data Index: 5316628 (Open Web Text)

Max Activating Token Index: 619

Text #13

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.3627. Min Act: -0.1700

Data Index: 6706522 (Open Web Text)

Max Activating Token Index: 764

Text #14

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.3719. Min Act: -0.1700

Data Index: 1515523 (Open Web Text)

Max Activating Token Index: 160

Text #15

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.3560. Min Act: -0.1700

Data Index: 5589281 (Open Web Text)

Max Activating Token Index: 994

Text #16

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.3642. Min Act: -0.1700

Data Index: 539262 (Open Web Text)

Max Activating Token Index: 293

Text #17

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.3401. Min Act: -0.1700

Data Index: 470755 (Open Web Text)

Max Activating Token Index: 177

Text #18

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.3360. Min Act: -0.1700

Data Index: 5674246 (Open Web Text)

Max Activating Token Index: 987

Text #19

Max Range: 3.6071. Min Range: -3.6071

Max Act: 3.3596. Min Act: -0.1700

Data Index: 3845413 (Open Web Text)

Max Activating Token Index: 690