< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1000 in Layer 7

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-small')

Text #0

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.8102. Min Act: -0.1700

Data Index: 7194725 (Open Web Text)

Max Activating Token Index: 424

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.5309. Min Act: -0.1700

Data Index: 490773 (Open Web Text)

Max Activating Token Index: 114

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.5518. Min Act: -0.1700

Data Index: 6459904 (Open Web Text)

Max Activating Token Index: 641

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.5312. Min Act: -0.1700

Data Index: 274416 (Open Web Text)

Max Activating Token Index: 812

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.5450. Min Act: -0.1700

Data Index: 5283758 (Open Web Text)

Max Activating Token Index: 103

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.4986. Min Act: -0.1700

Data Index: 7554364 (Open Web Text)

Max Activating Token Index: 842

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.4941. Min Act: -0.1700

Data Index: 6007576 (Open Web Text)

Max Activating Token Index: 798

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.4708. Min Act: -0.1700

Data Index: 4157776 (Open Web Text)

Max Activating Token Index: 24

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.4778. Min Act: -0.1700

Data Index: 2742433 (Open Web Text)

Max Activating Token Index: 626

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.4261. Min Act: -0.1700

Data Index: 5102426 (Open Web Text)

Max Activating Token Index: 631

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.4277. Min Act: -0.1700

Data Index: 7733911 (Open Web Text)

Max Activating Token Index: 573

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.4460. Min Act: -0.1700

Data Index: 7182134 (Open Web Text)

Max Activating Token Index: 482

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.4182. Min Act: -0.1700

Data Index: 8714243 (Open Web Text)

Max Activating Token Index: 292

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.4240. Min Act: -0.1700

Data Index: 8082090 (Open Web Text)

Max Activating Token Index: 652

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.3813. Min Act: -0.1700

Data Index: 3244791 (Open Web Text)

Max Activating Token Index: 667

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.3650. Min Act: -0.1700

Data Index: 3905468 (Open Web Text)

Max Activating Token Index: 914

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.3809. Min Act: -0.1700

Data Index: 6738828 (Open Web Text)

Max Activating Token Index: 528

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.3546. Min Act: -0.1700

Data Index: 490772 (Open Web Text)

Max Activating Token Index: 684

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.3736. Min Act: -0.1700

Data Index: 1939642 (Open Web Text)

Max Activating Token Index: 481

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 4.8102. Min Range: -4.8102

Max Act: 4.3678. Min Act: -0.1700

Data Index: 4899684 (Open Web Text)

Max Activating Token Index: 728

Click toggle to see full text

Truncated

Full Text #19