< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 115 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.8031. Min Act: -0.1700

Data Index: 4569805 (Open Web Text)

Max Activating Token Index: 254

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.8100. Min Act: -0.1700

Data Index: 7487401 (Open Web Text)

Max Activating Token Index: 164

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.8010. Min Act: -0.1700

Data Index: 3348466 (Open Web Text)

Max Activating Token Index: 255

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7832. Min Act: -0.1700

Data Index: 277434 (Open Web Text)

Max Activating Token Index: 433

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7696. Min Act: -0.1700

Data Index: 8795988 (Open Web Text)

Max Activating Token Index: 478

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7930. Min Act: -0.1700

Data Index: 3176700 (Open Web Text)

Max Activating Token Index: 1022

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7699. Min Act: -0.1700

Data Index: 2537096 (Open Web Text)

Max Activating Token Index: 154

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7573. Min Act: -0.1700

Data Index: 5457304 (Open Web Text)

Max Activating Token Index: 501

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7722. Min Act: -0.1700

Data Index: 8301573 (Open Web Text)

Max Activating Token Index: 464

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7516. Min Act: -0.1700

Data Index: 5230589 (Open Web Text)

Max Activating Token Index: 331

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7680. Min Act: -0.1700

Data Index: 5085942 (Open Web Text)

Max Activating Token Index: 470

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7587. Min Act: -0.1700

Data Index: 7969131 (Open Web Text)

Max Activating Token Index: 326

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7446. Min Act: -0.1700

Data Index: 7318038 (Open Web Text)

Max Activating Token Index: 516

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7555. Min Act: -0.1700

Data Index: 4537787 (Open Web Text)

Max Activating Token Index: 524

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7507. Min Act: -0.1700

Data Index: 5354762 (Open Web Text)

Max Activating Token Index: 134

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7556. Min Act: -0.1700

Data Index: 8182790 (Open Web Text)

Max Activating Token Index: 562

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7540. Min Act: -0.1700

Data Index: 8367635 (Open Web Text)

Max Activating Token Index: 538

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7413. Min Act: -0.1700

Data Index: 1760664 (Open Web Text)

Max Activating Token Index: 892

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7376. Min Act: -0.1700

Data Index: 7830662 (Open Web Text)

Max Activating Token Index: 664

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.8100. Min Range: -2.8100

Max Act: 2.7553. Min Act: -0.1700

Data Index: 4904475 (Open Web Text)

Max Activating Token Index: 97

Click toggle to see full text

Truncated

Full Text #19