< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2955 in Layer 7

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-small')

Text #0

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.9835. Min Act: -0.1700

Data Index: 4242687 (Open Web Text)

Max Activating Token Index: 63

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.9284. Min Act: -0.1700

Data Index: 6741936 (Open Web Text)

Max Activating Token Index: 897

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8869. Min Act: -0.1700

Data Index: 700387 (Open Web Text)

Max Activating Token Index: 414

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8675. Min Act: -0.1700

Data Index: 2272150 (Open Web Text)

Max Activating Token Index: 101

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8593. Min Act: -0.1700

Data Index: 1607300 (Open Web Text)

Max Activating Token Index: 932

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8351. Min Act: -0.1700

Data Index: 7706958 (Open Web Text)

Max Activating Token Index: 174

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8231. Min Act: -0.1700

Data Index: 4123643 (Open Web Text)

Max Activating Token Index: 588

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8412. Min Act: -0.1700

Data Index: 3290172 (Open Web Text)

Max Activating Token Index: 709

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8035. Min Act: -0.1700

Data Index: 7339437 (Open Web Text)

Max Activating Token Index: 538

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.7916. Min Act: -0.1700

Data Index: 6191482 (Open Web Text)

Max Activating Token Index: 292

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.7955. Min Act: -0.1700

Data Index: 8791837 (Open Web Text)

Max Activating Token Index: 817

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.7826. Min Act: -0.1700

Data Index: 3515774 (Open Web Text)

Max Activating Token Index: 195

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.7971. Min Act: -0.1700

Data Index: 8791836 (Open Web Text)

Max Activating Token Index: 60

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8221. Min Act: -0.1700

Data Index: 8421693 (Open Web Text)

Max Activating Token Index: 975

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.7944. Min Act: -0.1700

Data Index: 5517084 (Open Web Text)

Max Activating Token Index: 572

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8116. Min Act: -0.1700

Data Index: 5388490 (Open Web Text)

Max Activating Token Index: 470

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.7900. Min Act: -0.1700

Data Index: 3060304 (Open Web Text)

Max Activating Token Index: 337

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.7931. Min Act: -0.1700

Data Index: 7709125 (Open Web Text)

Max Activating Token Index: 487

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.8116. Min Act: -0.1700

Data Index: 441848 (Open Web Text)

Max Activating Token Index: 615

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 4.9835. Min Range: -4.9835

Max Act: 4.7741. Min Act: -0.1700

Data Index: 205322 (Open Web Text)

Max Activating Token Index: 998

Click toggle to see full text

Truncated

Full Text #19