< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1689 in Layer 7

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-small')

Text #0

Max Range: 3.1104. Min Range: -3.1104

Max Act: 3.1104. Min Act: -0.1700

Data Index: 7995596 (Open Web Text)

Max Activating Token Index: 446

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 3.1104. Min Range: -3.1104

Max Act: 3.0072. Min Act: -0.1700

Data Index: 6004681 (Open Web Text)

Max Activating Token Index: 686

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.9690. Min Act: -0.1700

Data Index: 2702062 (Open Web Text)

Max Activating Token Index: 384

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.9479. Min Act: -0.1700

Data Index: 8701698 (Open Web Text)

Max Activating Token Index: 739

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.9657. Min Act: -0.1700

Data Index: 421513 (Open Web Text)

Max Activating Token Index: 987

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.9428. Min Act: -0.1700

Data Index: 5751262 (Open Web Text)

Max Activating Token Index: 163

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.9381. Min Act: -0.1700

Data Index: 3143621 (Open Web Text)

Max Activating Token Index: 341

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.9406. Min Act: -0.1700

Data Index: 3408657 (Open Web Text)

Max Activating Token Index: 484

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8990. Min Act: -0.1700

Data Index: 8179025 (Open Web Text)

Max Activating Token Index: 319

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.9055. Min Act: -0.1700

Data Index: 7546951 (Open Web Text)

Max Activating Token Index: 694

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8768. Min Act: -0.1700

Data Index: 6157571 (Open Web Text)

Max Activating Token Index: 178

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8829. Min Act: -0.1700

Data Index: 5155786 (Open Web Text)

Max Activating Token Index: 926

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8625. Min Act: -0.1700

Data Index: 5748741 (Open Web Text)

Max Activating Token Index: 597

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8722. Min Act: -0.1700

Data Index: 4987133 (Open Web Text)

Max Activating Token Index: 281

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8690. Min Act: -0.1700

Data Index: 7684366 (Open Web Text)

Max Activating Token Index: 275

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8630. Min Act: -0.1700

Data Index: 8332972 (Open Web Text)

Max Activating Token Index: 82

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8498. Min Act: -0.1700

Data Index: 7740909 (Open Web Text)

Max Activating Token Index: 147

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8568. Min Act: -0.1700

Data Index: 8673026 (Open Web Text)

Max Activating Token Index: 373

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8565. Min Act: -0.1700

Data Index: 1911692 (Open Web Text)

Max Activating Token Index: 265

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 3.1104. Min Range: -3.1104

Max Act: 2.8639. Min Act: -0.1700

Data Index: 4357290 (Open Web Text)

Max Activating Token Index: 839

Click toggle to see full text

Truncated

Full Text #19