< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1595 in Layer 5

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.4527. Min Act: -0.1700

Data Index: 5749038 (Open Web Text)

Max Activating Token Index: 364

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.4345. Min Act: -0.1700

Data Index: 2391673 (Open Web Text)

Max Activating Token Index: 520

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.4296. Min Act: -0.1700

Data Index: 5909679 (Open Web Text)

Max Activating Token Index: 275

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3974. Min Act: -0.1700

Data Index: 8059089 (Open Web Text)

Max Activating Token Index: 584

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3890. Min Act: -0.1700

Data Index: 4523420 (Open Web Text)

Max Activating Token Index: 627

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3817. Min Act: -0.1700

Data Index: 929587 (Open Web Text)

Max Activating Token Index: 581

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3705. Min Act: -0.1700

Data Index: 7685721 (Open Web Text)

Max Activating Token Index: 442

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3748. Min Act: -0.1700

Data Index: 709968 (Open Web Text)

Max Activating Token Index: 679

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3772. Min Act: -0.1700

Data Index: 3920860 (Open Web Text)

Max Activating Token Index: 776

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3884. Min Act: -0.1700

Data Index: 1038704 (Open Web Text)

Max Activating Token Index: 806

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3541. Min Act: -0.1700

Data Index: 5038242 (Open Web Text)

Max Activating Token Index: 733

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3693. Min Act: -0.1700

Data Index: 4232836 (Open Web Text)

Max Activating Token Index: 829

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3421. Min Act: -0.1700

Data Index: 936625 (Open Web Text)

Max Activating Token Index: 885

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3486. Min Act: -0.1700

Data Index: 8433823 (Open Web Text)

Max Activating Token Index: 643

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3488. Min Act: -0.1700

Data Index: 2729505 (Open Web Text)

Max Activating Token Index: 730

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3624. Min Act: -0.1700

Data Index: 8151936 (Open Web Text)

Max Activating Token Index: 861

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3336. Min Act: -0.1700

Data Index: 455159 (Open Web Text)

Max Activating Token Index: 443

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3335. Min Act: -0.1700

Data Index: 6426911 (Open Web Text)

Max Activating Token Index: 679

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3258. Min Act: -0.1700

Data Index: 991785 (Open Web Text)

Max Activating Token Index: 49

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.4527. Min Range: -2.4527

Max Act: 2.3224. Min Act: -0.1700

Data Index: 6614614 (Open Web Text)

Max Activating Token Index: 834

Click toggle to see full text

Truncated

Full Text #19