< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 270 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.7497. Min Act: -0.1700

Data Index: 8409183 (Open Web Text)

Max Activating Token Index: 803

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.6127. Min Act: -0.1700

Data Index: 7660509 (Open Web Text)

Max Activating Token Index: 619

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.6044. Min Act: -0.1700

Data Index: 4468538 (Open Web Text)

Max Activating Token Index: 872

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.6278. Min Act: -0.1700

Data Index: 2343807 (Open Web Text)

Max Activating Token Index: 421

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.6318. Min Act: -0.1700

Data Index: 5074911 (Open Web Text)

Max Activating Token Index: 426

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5920. Min Act: -0.1700

Data Index: 6841174 (Open Web Text)

Max Activating Token Index: 690

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5723. Min Act: -0.1700

Data Index: 3204886 (Open Web Text)

Max Activating Token Index: 753

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5748. Min Act: -0.1700

Data Index: 4219254 (Open Web Text)

Max Activating Token Index: 326

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5747. Min Act: -0.1700

Data Index: 7016917 (Open Web Text)

Max Activating Token Index: 666

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5660. Min Act: -0.1700

Data Index: 8338387 (Open Web Text)

Max Activating Token Index: 278

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5446. Min Act: -0.1700

Data Index: 3258673 (Open Web Text)

Max Activating Token Index: 546

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5969. Min Act: -0.1700

Data Index: 334540 (Open Web Text)

Max Activating Token Index: 512

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5802. Min Act: -0.1700

Data Index: 6831734 (Open Web Text)

Max Activating Token Index: 976

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5704. Min Act: -0.1700

Data Index: 4277996 (Open Web Text)

Max Activating Token Index: 567

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5636. Min Act: -0.1700

Data Index: 5779777 (Open Web Text)

Max Activating Token Index: 30

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5699. Min Act: -0.1700

Data Index: 4264412 (Open Web Text)

Max Activating Token Index: 214

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5643. Min Act: -0.1700

Data Index: 339446 (Open Web Text)

Max Activating Token Index: 540

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5282. Min Act: -0.1700

Data Index: 6615575 (Open Web Text)

Max Activating Token Index: 843

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5614. Min Act: -0.1700

Data Index: 5006800 (Open Web Text)

Max Activating Token Index: 374

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.7497. Min Range: -2.7497

Max Act: 2.5525. Min Act: -0.1700

Data Index: 4743806 (Open Web Text)

Max Activating Token Index: 685

Click toggle to see full text

Truncated

Full Text #19