< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2120 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.9114. Min Act: -0.1700

Data Index: 3706871 (Open Web Text)

Max Activating Token Index: 894

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8796. Min Act: -0.1700

Data Index: 222093 (Open Web Text)

Max Activating Token Index: 448

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8480. Min Act: -0.1700

Data Index: 1695088 (Open Web Text)

Max Activating Token Index: 926

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8609. Min Act: -0.1700

Data Index: 2168252 (Open Web Text)

Max Activating Token Index: 688

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8692. Min Act: -0.1700

Data Index: 2529913 (Open Web Text)

Max Activating Token Index: 377

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8672. Min Act: -0.1700

Data Index: 6385052 (Open Web Text)

Max Activating Token Index: 942

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8620. Min Act: -0.1700

Data Index: 6848525 (Open Web Text)

Max Activating Token Index: 809

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8392. Min Act: -0.1700

Data Index: 5140220 (Open Web Text)

Max Activating Token Index: 742

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8137. Min Act: -0.1700

Data Index: 3268877 (Open Web Text)

Max Activating Token Index: 930

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8249. Min Act: -0.1700

Data Index: 6428968 (Open Web Text)

Max Activating Token Index: 454

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.7933. Min Act: -0.1700

Data Index: 3541219 (Open Web Text)

Max Activating Token Index: 442

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8144. Min Act: -0.1700

Data Index: 3017840 (Open Web Text)

Max Activating Token Index: 1019

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8111. Min Act: -0.1700

Data Index: 8681326 (Open Web Text)

Max Activating Token Index: 677

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8046. Min Act: -0.1700

Data Index: 5288384 (Open Web Text)

Max Activating Token Index: 1018

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8210. Min Act: -0.1700

Data Index: 5154515 (Open Web Text)

Max Activating Token Index: 449

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.8072. Min Act: -0.1700

Data Index: 8084708 (Open Web Text)

Max Activating Token Index: 125

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.7865. Min Act: -0.1700

Data Index: 5611225 (Open Web Text)

Max Activating Token Index: 64

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.7815. Min Act: -0.1700

Data Index: 3752433 (Open Web Text)

Max Activating Token Index: 625

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.7785. Min Act: -0.1700

Data Index: 5273837 (Open Web Text)

Max Activating Token Index: 873

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.9114. Min Range: -2.9114

Max Act: 2.7756. Min Act: -0.1700

Data Index: 4443183 (Open Web Text)

Max Activating Token Index: 919

Click toggle to see full text

Truncated

Full Text #19