< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 585 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.8917. Min Act: -0.1700

Data Index: 3349795 (Open Web Text)

Max Activating Token Index: 980

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.8671. Min Act: -0.1700

Data Index: 7449699 (Open Web Text)

Max Activating Token Index: 716

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.8322. Min Act: -0.1700

Data Index: 6821395 (Open Web Text)

Max Activating Token Index: 869

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7702. Min Act: -0.1700

Data Index: 8229178 (Open Web Text)

Max Activating Token Index: 831

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7663. Min Act: -0.1700

Data Index: 7557664 (Open Web Text)

Max Activating Token Index: 614

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7503. Min Act: -0.1700

Data Index: 2708788 (Open Web Text)

Max Activating Token Index: 599

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7559. Min Act: -0.1700

Data Index: 2156655 (Open Web Text)

Max Activating Token Index: 955

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7454. Min Act: -0.1700

Data Index: 6032849 (Open Web Text)

Max Activating Token Index: 613

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7078. Min Act: -0.1700

Data Index: 2828327 (Open Web Text)

Max Activating Token Index: 314

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7138. Min Act: -0.1700

Data Index: 6035683 (Open Web Text)

Max Activating Token Index: 952

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7279. Min Act: -0.1700

Data Index: 3367849 (Open Web Text)

Max Activating Token Index: 867

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7153. Min Act: -0.1700

Data Index: 6368619 (Open Web Text)

Max Activating Token Index: 549

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7087. Min Act: -0.1700

Data Index: 7659372 (Open Web Text)

Max Activating Token Index: 334

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7060. Min Act: -0.1700

Data Index: 2688964 (Open Web Text)

Max Activating Token Index: 164

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7340. Min Act: -0.1700

Data Index: 7645314 (Open Web Text)

Max Activating Token Index: 449

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7002. Min Act: -0.1700

Data Index: 3428380 (Open Web Text)

Max Activating Token Index: 496

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.6845. Min Act: -0.1700

Data Index: 3687460 (Open Web Text)

Max Activating Token Index: 877

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.6893. Min Act: -0.1700

Data Index: 3980169 (Open Web Text)

Max Activating Token Index: 476

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.7012. Min Act: -0.1700

Data Index: 4312168 (Open Web Text)

Max Activating Token Index: 232

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.8917. Min Range: -2.8917

Max Act: 2.6704. Min Act: -0.1700

Data Index: 2179369 (Open Web Text)

Max Activating Token Index: 156

Click toggle to see full text

Truncated

Full Text #19