< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2700 in Layer 5

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.4499. Min Act: -0.1700

Data Index: 8465596 (Open Web Text)

Max Activating Token Index: 770

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.4544. Min Act: -0.1700

Data Index: 5071747 (Open Web Text)

Max Activating Token Index: 679

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.4347. Min Act: -0.1700

Data Index: 7810643 (Open Web Text)

Max Activating Token Index: 278

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3881. Min Act: -0.1700

Data Index: 1662260 (Open Web Text)

Max Activating Token Index: 639

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.4032. Min Act: -0.1700

Data Index: 4295121 (Open Web Text)

Max Activating Token Index: 772

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3686. Min Act: -0.1700

Data Index: 4677414 (Open Web Text)

Max Activating Token Index: 954

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3617. Min Act: -0.1700

Data Index: 7896412 (Open Web Text)

Max Activating Token Index: 612

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3683. Min Act: -0.1700

Data Index: 3870722 (Open Web Text)

Max Activating Token Index: 903

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3568. Min Act: -0.1700

Data Index: 5678930 (Open Web Text)

Max Activating Token Index: 275

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3516. Min Act: -0.1700

Data Index: 1031141 (Open Web Text)

Max Activating Token Index: 269

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3526. Min Act: -0.1700

Data Index: 5664408 (Open Web Text)

Max Activating Token Index: 482

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3750. Min Act: -0.1700

Data Index: 4191244 (Open Web Text)

Max Activating Token Index: 855

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3605. Min Act: -0.1700

Data Index: 4572256 (Open Web Text)

Max Activating Token Index: 737

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3726. Min Act: -0.1700

Data Index: 5399470 (Open Web Text)

Max Activating Token Index: 959

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3379. Min Act: -0.1700

Data Index: 7046961 (Open Web Text)

Max Activating Token Index: 282

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3373. Min Act: -0.1700

Data Index: 2933784 (Open Web Text)

Max Activating Token Index: 189

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3441. Min Act: -0.1700

Data Index: 7838139 (Open Web Text)

Max Activating Token Index: 351

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3457. Min Act: -0.1700

Data Index: 7042587 (Open Web Text)

Max Activating Token Index: 455

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3272. Min Act: -0.1700

Data Index: 5290779 (Open Web Text)

Max Activating Token Index: 206

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.4544. Min Range: -2.4544

Max Act: 2.3290. Min Act: -0.1700

Data Index: 6864778 (Open Web Text)

Max Activating Token Index: 287

Click toggle to see full text

Truncated

Full Text #19