< Prev | Home | Model | Random | Next >

Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 1917 in Layer 28

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')



Text #0

Max Range: 4.5402. Min Range: -4.5402

Max Act: 4.5402. Min Act: -0.1700

Data Index: 8118317 (Open Web Text)

Max Activating Token Index: 505

Click toggle to see full text

Truncated

Full Text #0


Text #1

Max Range: 4.5402. Min Range: -4.5402

Max Act: 4.1964. Min Act: -0.1700

Data Index: 6048828 (Open Web Text)

Max Activating Token Index: 80

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 4.5402. Min Range: -4.5402

Max Act: 4.1652. Min Act: -0.1700

Data Index: 1948468 (Open Web Text)

Max Activating Token Index: 642

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 4.5402. Min Range: -4.5402

Max Act: 4.0714. Min Act: -0.1700

Data Index: 854938 (Open Web Text)

Max Activating Token Index: 897

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 4.5402. Min Range: -4.5402

Max Act: 4.0714. Min Act: -0.1700

Data Index: 7655506 (Open Web Text)

Max Activating Token Index: 989

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 4.5402. Min Range: -4.5402

Max Act: 4.0089. Min Act: -0.1700

Data Index: 964032 (Open Web Text)

Max Activating Token Index: 676

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 4.5402. Min Range: -4.5402

Max Act: 4.0401. Min Act: -0.1700

Data Index: 7940479 (Open Web Text)

Max Activating Token Index: 1000

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 4.5402. Min Range: -4.5402

Max Act: 4.0089. Min Act: -0.1700

Data Index: 102699 (Open Web Text)

Max Activating Token Index: 590

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 4.5402. Min Range: -4.5402

Max Act: 4.0089. Min Act: -0.1700

Data Index: 3870779 (Open Web Text)

Max Activating Token Index: 905

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.9776. Min Act: -0.1700

Data Index: 1674626 (Open Web Text)

Max Activating Token Index: 679

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.9620. Min Act: -0.1700

Data Index: 8134418 (Open Web Text)

Max Activating Token Index: 448

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.9464. Min Act: -0.1700

Data Index: 276072 (Open Web Text)

Max Activating Token Index: 762

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.9307. Min Act: -0.1700

Data Index: 326621 (Open Web Text)

Max Activating Token Index: 942

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.9307. Min Act: -0.1700

Data Index: 713042 (Open Web Text)

Max Activating Token Index: 51

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.9307. Min Act: -0.1700

Data Index: 6632584 (Open Web Text)

Max Activating Token Index: 300

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.9151. Min Act: -0.1700

Data Index: 7825308 (Open Web Text)

Max Activating Token Index: 102

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.8995. Min Act: -0.1700

Data Index: 931531 (Open Web Text)

Max Activating Token Index: 577

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.8995. Min Act: -0.1700

Data Index: 6029899 (Open Web Text)

Max Activating Token Index: 74

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.8995. Min Act: -0.1700

Data Index: 7697309 (Open Web Text)

Max Activating Token Index: 816

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 4.5402. Min Range: -4.5402

Max Act: 3.8838. Min Act: -0.1700

Data Index: 6636414 (Open Web Text)

Max Activating Token Index: 940

Click toggle to see full text

Truncated

Full Text #19