< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2876 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.7801. Min Act: -0.1700

Data Index: 640847 (Open Web Text)

Max Activating Token Index: 14

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.7391. Min Act: -0.1700

Data Index: 7134171 (Open Web Text)

Max Activating Token Index: 902

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.7150. Min Act: -0.1700

Data Index: 6374628 (Open Web Text)

Max Activating Token Index: 306

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.7179. Min Act: -0.1700

Data Index: 6615857 (Open Web Text)

Max Activating Token Index: 13

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.7079. Min Act: -0.1700

Data Index: 2662781 (Open Web Text)

Max Activating Token Index: 9

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6800. Min Act: -0.1700

Data Index: 5977244 (Open Web Text)

Max Activating Token Index: 281

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6825. Min Act: -0.1700

Data Index: 2835369 (Open Web Text)

Max Activating Token Index: 775

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6805. Min Act: -0.1700

Data Index: 3109326 (Open Web Text)

Max Activating Token Index: 421

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6822. Min Act: -0.1700

Data Index: 1996363 (Open Web Text)

Max Activating Token Index: 185

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6754. Min Act: -0.1700

Data Index: 1044637 (Open Web Text)

Max Activating Token Index: 317

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6811. Min Act: -0.1700

Data Index: 7130224 (Open Web Text)

Max Activating Token Index: 466

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6807. Min Act: -0.1700

Data Index: 7543714 (Open Web Text)

Max Activating Token Index: 835

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6670. Min Act: -0.1700

Data Index: 462169 (Open Web Text)

Max Activating Token Index: 162

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6658. Min Act: -0.1700

Data Index: 1918075 (Open Web Text)

Max Activating Token Index: 8

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6462. Min Act: -0.1700

Data Index: 5738344 (Open Web Text)

Max Activating Token Index: 786

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6694. Min Act: -0.1700

Data Index: 742274 (Open Web Text)

Max Activating Token Index: 6

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6712. Min Act: -0.1700

Data Index: 1120022 (Open Web Text)

Max Activating Token Index: 375

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6392. Min Act: -0.1700

Data Index: 5211659 (Open Web Text)

Max Activating Token Index: 301

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6276. Min Act: -0.1700

Data Index: 1278315 (Open Web Text)

Max Activating Token Index: 527

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.7801. Min Range: -2.7801

Max Act: 2.6470. Min Act: -0.1700

Data Index: 1113934 (Open Web Text)

Max Activating Token Index: 912

Click toggle to see full text

Truncated

Full Text #19