< Prev | Home | Model | Random | Next >

Model: GPT-2 Medium: 24 Layers, 4096 Neurons per Layer

Dataset: Open Web Text

Neuron 4046 in Layer 21

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-medium')



Text #0

Max Range: 6.3596. Min Range: -6.3596

Max Act: 6.3596. Min Act: -0.1700

Data Index: 8317527 (Open Web Text)

Max Activating Token Index: 557

Click toggle to see full text

Truncated

Full Text #0


Text #1

Max Range: 6.3596. Min Range: -6.3596

Max Act: 6.1721. Min Act: -0.1700

Data Index: 1948717 (Open Web Text)

Max Activating Token Index: 479

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 6.3596. Min Range: -6.3596

Max Act: 6.0471. Min Act: -0.1700

Data Index: 6600578 (Open Web Text)

Max Activating Token Index: 105

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 6.3596. Min Range: -6.3596

Max Act: 6.0471. Min Act: -0.1700

Data Index: 2012181 (Open Web Text)

Max Activating Token Index: 194

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.9846. Min Act: -0.1700

Data Index: 3923324 (Open Web Text)

Max Activating Token Index: 697

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8596. Min Act: -0.1700

Data Index: 3692436 (Open Web Text)

Max Activating Token Index: 658

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.9221. Min Act: -0.1700

Data Index: 131396 (Open Web Text)

Max Activating Token Index: 917

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8908. Min Act: -0.1700

Data Index: 3158384 (Open Web Text)

Max Activating Token Index: 335

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8283. Min Act: -0.1700

Data Index: 3062138 (Open Web Text)

Max Activating Token Index: 741

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8908. Min Act: -0.1700

Data Index: 3900564 (Open Web Text)

Max Activating Token Index: 95

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8908. Min Act: -0.1700

Data Index: 6537732 (Open Web Text)

Max Activating Token Index: 804

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.9221. Min Act: -0.1700

Data Index: 8695294 (Open Web Text)

Max Activating Token Index: 664

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.9221. Min Act: -0.1700

Data Index: 8642171 (Open Web Text)

Max Activating Token Index: 458

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8908. Min Act: -0.1700

Data Index: 8397043 (Open Web Text)

Max Activating Token Index: 181

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.9221. Min Act: -0.1700

Data Index: 1017385 (Open Web Text)

Max Activating Token Index: 702

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8908. Min Act: -0.1700

Data Index: 902221 (Open Web Text)

Max Activating Token Index: 726

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8908. Min Act: -0.1700

Data Index: 6216304 (Open Web Text)

Max Activating Token Index: 593

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8596. Min Act: -0.1700

Data Index: 4807398 (Open Web Text)

Max Activating Token Index: 280

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8596. Min Act: -0.1700

Data Index: 323727 (Open Web Text)

Max Activating Token Index: 374

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 6.3596. Min Range: -6.3596

Max Act: 5.8596. Min Act: -0.1700

Data Index: 6289365 (Open Web Text)

Max Activating Token Index: 251

Click toggle to see full text

Truncated

Full Text #19