< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1207 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.6674. Min Act: -0.1700

Data Index: 4303860 (Open Web Text)

Max Activating Token Index: 785

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.6225. Min Act: -0.1700

Data Index: 8019809 (Open Web Text)

Max Activating Token Index: 427

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5735. Min Act: -0.1700

Data Index: 8582100 (Open Web Text)

Max Activating Token Index: 499

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5802. Min Act: -0.1700

Data Index: 3421801 (Open Web Text)

Max Activating Token Index: 237

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5497. Min Act: -0.1700

Data Index: 1711556 (Open Web Text)

Max Activating Token Index: 399

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5554. Min Act: -0.1700

Data Index: 3711048 (Open Web Text)

Max Activating Token Index: 425

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5419. Min Act: -0.1700

Data Index: 877545 (Open Web Text)

Max Activating Token Index: 708

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5717. Min Act: -0.1700

Data Index: 904985 (Open Web Text)

Max Activating Token Index: 371

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5723. Min Act: -0.1700

Data Index: 931109 (Open Web Text)

Max Activating Token Index: 454

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5387. Min Act: -0.1700

Data Index: 4484224 (Open Web Text)

Max Activating Token Index: 634

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5522. Min Act: -0.1700

Data Index: 4654009 (Open Web Text)

Max Activating Token Index: 372

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5466. Min Act: -0.1700

Data Index: 414133 (Open Web Text)

Max Activating Token Index: 348

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5244. Min Act: -0.1700

Data Index: 5974125 (Open Web Text)

Max Activating Token Index: 962

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5866. Min Act: -0.1700

Data Index: 2205020 (Open Web Text)

Max Activating Token Index: 886

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5600. Min Act: -0.1700

Data Index: 6852773 (Open Web Text)

Max Activating Token Index: 751

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5705. Min Act: -0.1700

Data Index: 7141371 (Open Web Text)

Max Activating Token Index: 463

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5537. Min Act: -0.1700

Data Index: 7710384 (Open Web Text)

Max Activating Token Index: 140

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5507. Min Act: -0.1700

Data Index: 143857 (Open Web Text)

Max Activating Token Index: 494

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5738. Min Act: -0.1700

Data Index: 674901 (Open Web Text)

Max Activating Token Index: 490

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 4.6674. Min Range: -4.6674

Max Act: 4.5615. Min Act: -0.1700

Data Index: 1698272 (Open Web Text)

Max Activating Token Index: 405

Click toggle to see full text

Truncated

Full Text #19