< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 118 in Layer 7

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-small')

Text #0

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.8579. Min Act: -0.1700

Data Index: 5996089 (Open Web Text)

Max Activating Token Index: 504

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.8763. Min Act: -0.1700

Data Index: 8019452 (Open Web Text)

Max Activating Token Index: 1001

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.8301. Min Act: -0.1700

Data Index: 4395769 (Open Web Text)

Max Activating Token Index: 744

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.7884. Min Act: -0.1700

Data Index: 6621658 (Open Web Text)

Max Activating Token Index: 735

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.8088. Min Act: -0.1700

Data Index: 4057932 (Open Web Text)

Max Activating Token Index: 115

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.7577. Min Act: -0.1700

Data Index: 4336907 (Open Web Text)

Max Activating Token Index: 508

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.7583. Min Act: -0.1700

Data Index: 4828369 (Open Web Text)

Max Activating Token Index: 190

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.7583. Min Act: -0.1700

Data Index: 8784628 (Open Web Text)

Max Activating Token Index: 574

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.7572. Min Act: -0.1700

Data Index: 6518865 (Open Web Text)

Max Activating Token Index: 75

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.7363. Min Act: -0.1700

Data Index: 5018204 (Open Web Text)

Max Activating Token Index: 595

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.7333. Min Act: -0.1700

Data Index: 1404370 (Open Web Text)

Max Activating Token Index: 896

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.6885. Min Act: -0.1700

Data Index: 2328451 (Open Web Text)

Max Activating Token Index: 638

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.6954. Min Act: -0.1700

Data Index: 195447 (Open Web Text)

Max Activating Token Index: 604

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.6833. Min Act: -0.1700

Data Index: 5579721 (Open Web Text)

Max Activating Token Index: 694

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.6883. Min Act: -0.1700

Data Index: 4081330 (Open Web Text)

Max Activating Token Index: 68

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.6835. Min Act: -0.1700

Data Index: 4638104 (Open Web Text)

Max Activating Token Index: 114

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.6816. Min Act: -0.1700

Data Index: 1000163 (Open Web Text)

Max Activating Token Index: 135

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.6804. Min Act: -0.1700

Data Index: 1196807 (Open Web Text)

Max Activating Token Index: 368

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.6847. Min Act: -0.1700

Data Index: 6741081 (Open Web Text)

Max Activating Token Index: 390

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.8763. Min Range: -2.8763

Max Act: 2.6692. Min Act: -0.1700

Data Index: 1587820 (Open Web Text)

Max Activating Token Index: 671

Click toggle to see full text

Truncated

Full Text #19