< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2639 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4799. Min Act: -0.1700

Data Index: 2763934 (Open Web Text)

Max Activating Token Index: 773

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4860. Min Act: -0.1700

Data Index: 914197 (Open Web Text)

Max Activating Token Index: 290

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4394. Min Act: -0.1700

Data Index: 727539 (Open Web Text)

Max Activating Token Index: 137

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4238. Min Act: -0.1700

Data Index: 1686384 (Open Web Text)

Max Activating Token Index: 434

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4416. Min Act: -0.1700

Data Index: 5055433 (Open Web Text)

Max Activating Token Index: 206

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4437. Min Act: -0.1700

Data Index: 3523866 (Open Web Text)

Max Activating Token Index: 696

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4178. Min Act: -0.1700

Data Index: 2266565 (Open Web Text)

Max Activating Token Index: 189

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4147. Min Act: -0.1700

Data Index: 6050870 (Open Web Text)

Max Activating Token Index: 727

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.3978. Min Act: -0.1700

Data Index: 2139981 (Open Web Text)

Max Activating Token Index: 434

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4251. Min Act: -0.1700

Data Index: 6640078 (Open Web Text)

Max Activating Token Index: 882

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4155. Min Act: -0.1700

Data Index: 2732236 (Open Web Text)

Max Activating Token Index: 880

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4073. Min Act: -0.1700

Data Index: 124993 (Open Web Text)

Max Activating Token Index: 17

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.3835. Min Act: -0.1700

Data Index: 8115486 (Open Web Text)

Max Activating Token Index: 209

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4004. Min Act: -0.1700

Data Index: 2277904 (Open Web Text)

Max Activating Token Index: 53

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.3886. Min Act: -0.1700

Data Index: 8642469 (Open Web Text)

Max Activating Token Index: 953

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.4001. Min Act: -0.1700

Data Index: 1095883 (Open Web Text)

Max Activating Token Index: 316

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.3765. Min Act: -0.1700

Data Index: 1397707 (Open Web Text)

Max Activating Token Index: 439

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.3790. Min Act: -0.1700

Data Index: 5392131 (Open Web Text)

Max Activating Token Index: 5

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.3732. Min Act: -0.1700

Data Index: 728811 (Open Web Text)

Max Activating Token Index: 80

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.4860. Min Range: -2.4860

Max Act: 2.3804. Min Act: -0.1700

Data Index: 5711385 (Open Web Text)

Max Activating Token Index: 273

Click toggle to see full text

Truncated

Full Text #19