< Prev | Home | Model | Random | Next >

Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 5111 in Layer 34

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')



Text #0

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.5362. Min Act: -0.1700

Data Index: 6292410 (Open Web Text)

Max Activating Token Index: 540

Click toggle to see full text

Truncated

Full Text #0


Text #1

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.4737. Min Act: -0.1700

Data Index: 7547096 (Open Web Text)

Max Activating Token Index: 528

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.2862. Min Act: -0.1700

Data Index: 7432907 (Open Web Text)

Max Activating Token Index: 931

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.2237. Min Act: -0.1700

Data Index: 7429549 (Open Web Text)

Max Activating Token Index: 913

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.1925. Min Act: -0.1700

Data Index: 1977296 (Open Web Text)

Max Activating Token Index: 600

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.1925. Min Act: -0.1700

Data Index: 2894130 (Open Web Text)

Max Activating Token Index: 883

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.1612. Min Act: -0.1700

Data Index: 1720853 (Open Web Text)

Max Activating Token Index: 865

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.1612. Min Act: -0.1700

Data Index: 6668924 (Open Web Text)

Max Activating Token Index: 218

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.1612. Min Act: -0.1700

Data Index: 998795 (Open Web Text)

Max Activating Token Index: 635

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0987. Min Act: -0.1700

Data Index: 2425611 (Open Web Text)

Max Activating Token Index: 557

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.1300. Min Act: -0.1700

Data Index: 7037226 (Open Web Text)

Max Activating Token Index: 327

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0987. Min Act: -0.1700

Data Index: 3864197 (Open Web Text)

Max Activating Token Index: 577

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0987. Min Act: -0.1700

Data Index: 6739589 (Open Web Text)

Max Activating Token Index: 873

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0987. Min Act: -0.1700

Data Index: 4371058 (Open Web Text)

Max Activating Token Index: 55

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0675. Min Act: -0.1700

Data Index: 6608948 (Open Web Text)

Max Activating Token Index: 724

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0050. Min Act: -0.1700

Data Index: 3260587 (Open Web Text)

Max Activating Token Index: 630

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0050. Min Act: -0.1700

Data Index: 69196 (Open Web Text)

Max Activating Token Index: 629

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0362. Min Act: -0.1700

Data Index: 1760185 (Open Web Text)

Max Activating Token Index: 570

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0362. Min Act: -0.1700

Data Index: 4959261 (Open Web Text)

Max Activating Token Index: 296

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 6.5362. Min Range: -6.5362

Max Act: 6.0362. Min Act: -0.1700

Data Index: 2222707 (Open Web Text)

Max Activating Token Index: 128

Click toggle to see full text

Truncated

Full Text #19