< Prev | Home | Model | Random | Next >

Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 5082 in Layer 34

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')



Text #0

Max Range: 6.1270. Min Range: -6.1270

Max Act: 6.1270. Min Act: -0.1700

Data Index: 1611206 (Open Web Text)

Max Activating Token Index: 502

Click toggle to see full text

Truncated

Full Text #0


Text #1

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.9708. Min Act: -0.1700

Data Index: 1076050 (Open Web Text)

Max Activating Token Index: 420

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.9708. Min Act: -0.1700

Data Index: 3660039 (Open Web Text)

Max Activating Token Index: 981

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.9708. Min Act: -0.1700

Data Index: 5878552 (Open Web Text)

Max Activating Token Index: 181

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.8458. Min Act: -0.1700

Data Index: 2732992 (Open Web Text)

Max Activating Token Index: 714

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.8145. Min Act: -0.1700

Data Index: 1434760 (Open Web Text)

Max Activating Token Index: 647

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.7520. Min Act: -0.1700

Data Index: 1385819 (Open Web Text)

Max Activating Token Index: 383

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.7520. Min Act: -0.1700

Data Index: 385552 (Open Web Text)

Max Activating Token Index: 889

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.7520. Min Act: -0.1700

Data Index: 7003916 (Open Web Text)

Max Activating Token Index: 484

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.7520. Min Act: -0.1700

Data Index: 7946908 (Open Web Text)

Max Activating Token Index: 430

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.7208. Min Act: -0.1700

Data Index: 5812413 (Open Web Text)

Max Activating Token Index: 177

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.6895. Min Act: -0.1700

Data Index: 1126512 (Open Web Text)

Max Activating Token Index: 233

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.6270. Min Act: -0.1700

Data Index: 7357941 (Open Web Text)

Max Activating Token Index: 810

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.6583. Min Act: -0.1700

Data Index: 5373329 (Open Web Text)

Max Activating Token Index: 138

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.6270. Min Act: -0.1700

Data Index: 7575637 (Open Web Text)

Max Activating Token Index: 414

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.6270. Min Act: -0.1700

Data Index: 4014720 (Open Web Text)

Max Activating Token Index: 357

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.6270. Min Act: -0.1700

Data Index: 8307077 (Open Web Text)

Max Activating Token Index: 84

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.6270. Min Act: -0.1700

Data Index: 7613823 (Open Web Text)

Max Activating Token Index: 643

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.5958. Min Act: -0.1700

Data Index: 7633356 (Open Web Text)

Max Activating Token Index: 579

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 6.1270. Min Range: -6.1270

Max Act: 5.5958. Min Act: -0.1700

Data Index: 6725981 (Open Web Text)

Max Activating Token Index: 972

Click toggle to see full text

Truncated

Full Text #19