< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2092 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.5087. Min Act: -0.1700

Data Index: 4604395 (Open Web Text)

Max Activating Token Index: 640

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.5021. Min Act: -0.1700

Data Index: 5038515 (Open Web Text)

Max Activating Token Index: 653

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4685. Min Act: -0.1700

Data Index: 786169 (Open Web Text)

Max Activating Token Index: 82

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4683. Min Act: -0.1700

Data Index: 921183 (Open Web Text)

Max Activating Token Index: 120

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4677. Min Act: -0.1700

Data Index: 3157497 (Open Web Text)

Max Activating Token Index: 655

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4672. Min Act: -0.1700

Data Index: 4227791 (Open Web Text)

Max Activating Token Index: 711

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4674. Min Act: -0.1700

Data Index: 7578012 (Open Web Text)

Max Activating Token Index: 753

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4640. Min Act: -0.1700

Data Index: 8059149 (Open Web Text)

Max Activating Token Index: 612

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4477. Min Act: -0.1700

Data Index: 1534819 (Open Web Text)

Max Activating Token Index: 350

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4561. Min Act: -0.1700

Data Index: 551514 (Open Web Text)

Max Activating Token Index: 625

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4581. Min Act: -0.1700

Data Index: 3375699 (Open Web Text)

Max Activating Token Index: 792

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4756. Min Act: -0.1700

Data Index: 1622783 (Open Web Text)

Max Activating Token Index: 557

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4579. Min Act: -0.1700

Data Index: 3979417 (Open Web Text)

Max Activating Token Index: 890

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4232. Min Act: -0.1700

Data Index: 334324 (Open Web Text)

Max Activating Token Index: 673

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4316. Min Act: -0.1700

Data Index: 5674197 (Open Web Text)

Max Activating Token Index: 671

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4556. Min Act: -0.1700

Data Index: 8376251 (Open Web Text)

Max Activating Token Index: 922

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4341. Min Act: -0.1700

Data Index: 6718276 (Open Web Text)

Max Activating Token Index: 640

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4490. Min Act: -0.1700

Data Index: 6288917 (Open Web Text)

Max Activating Token Index: 543

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4331. Min Act: -0.1700

Data Index: 5962468 (Open Web Text)

Max Activating Token Index: 910

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.5087. Min Range: -2.5087

Max Act: 2.4292. Min Act: -0.1700

Data Index: 2680638 (Open Web Text)

Max Activating Token Index: 689

Click toggle to see full text

Truncated

Full Text #19