< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2384 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.7048. Min Act: -0.1700

Data Index: 3811384 (Open Web Text)

Max Activating Token Index: 147

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.6740. Min Act: -0.1700

Data Index: 7126706 (Open Web Text)

Max Activating Token Index: 50

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.6219. Min Act: -0.1700

Data Index: 4709083 (Open Web Text)

Max Activating Token Index: 750

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.6600. Min Act: -0.1700

Data Index: 6603955 (Open Web Text)

Max Activating Token Index: 446

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.6183. Min Act: -0.1700

Data Index: 3182347 (Open Web Text)

Max Activating Token Index: 557

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5997. Min Act: -0.1700

Data Index: 1937225 (Open Web Text)

Max Activating Token Index: 484

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.6160. Min Act: -0.1700

Data Index: 5194443 (Open Web Text)

Max Activating Token Index: 902

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5970. Min Act: -0.1700

Data Index: 8607791 (Open Web Text)

Max Activating Token Index: 618

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.6037. Min Act: -0.1700

Data Index: 3366141 (Open Web Text)

Max Activating Token Index: 533

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5924. Min Act: -0.1700

Data Index: 5017393 (Open Web Text)

Max Activating Token Index: 189

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5963. Min Act: -0.1700

Data Index: 108030 (Open Web Text)

Max Activating Token Index: 510

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5986. Min Act: -0.1700

Data Index: 5520095 (Open Web Text)

Max Activating Token Index: 322

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5851. Min Act: -0.1700

Data Index: 1561437 (Open Web Text)

Max Activating Token Index: 379

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5951. Min Act: -0.1700

Data Index: 4521734 (Open Web Text)

Max Activating Token Index: 795

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5986. Min Act: -0.1700

Data Index: 2481570 (Open Web Text)

Max Activating Token Index: 855

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5754. Min Act: -0.1700

Data Index: 956481 (Open Web Text)

Max Activating Token Index: 895

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5840. Min Act: -0.1700

Data Index: 1517231 (Open Web Text)

Max Activating Token Index: 566

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5789. Min Act: -0.1700

Data Index: 552671 (Open Web Text)

Max Activating Token Index: 309

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5816. Min Act: -0.1700

Data Index: 5415319 (Open Web Text)

Max Activating Token Index: 918

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.7048. Min Range: -2.7048

Max Act: 2.5596. Min Act: -0.1700

Data Index: 2734483 (Open Web Text)

Max Activating Token Index: 448

Click toggle to see full text

Truncated

Full Text #19