< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1584 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.7139. Min Act: -0.1700

Data Index: 2030690 (Open Web Text)

Max Activating Token Index: 410

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6628. Min Act: -0.1700

Data Index: 6992489 (Open Web Text)

Max Activating Token Index: 84

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6688. Min Act: -0.1700

Data Index: 1562807 (Open Web Text)

Max Activating Token Index: 707

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6627. Min Act: -0.1700

Data Index: 4087334 (Open Web Text)

Max Activating Token Index: 174

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6503. Min Act: -0.1700

Data Index: 3478539 (Open Web Text)

Max Activating Token Index: 639

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6363. Min Act: -0.1700

Data Index: 3569756 (Open Web Text)

Max Activating Token Index: 89

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6367. Min Act: -0.1700

Data Index: 1446340 (Open Web Text)

Max Activating Token Index: 44

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6453. Min Act: -0.1700

Data Index: 299444 (Open Web Text)

Max Activating Token Index: 521

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6235. Min Act: -0.1700

Data Index: 4137898 (Open Web Text)

Max Activating Token Index: 767

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6150. Min Act: -0.1700

Data Index: 3196841 (Open Web Text)

Max Activating Token Index: 586

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6238. Min Act: -0.1700

Data Index: 7996755 (Open Web Text)

Max Activating Token Index: 367

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6195. Min Act: -0.1700

Data Index: 7178827 (Open Web Text)

Max Activating Token Index: 346

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6209. Min Act: -0.1700

Data Index: 8633765 (Open Web Text)

Max Activating Token Index: 37

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6194. Min Act: -0.1700

Data Index: 8354920 (Open Web Text)

Max Activating Token Index: 354

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.5994. Min Act: -0.1700

Data Index: 6155179 (Open Web Text)

Max Activating Token Index: 212

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6033. Min Act: -0.1700

Data Index: 5281329 (Open Web Text)

Max Activating Token Index: 356

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6033. Min Act: -0.1700

Data Index: 7238475 (Open Web Text)

Max Activating Token Index: 736

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6025. Min Act: -0.1700

Data Index: 857602 (Open Web Text)

Max Activating Token Index: 352

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6140. Min Act: -0.1700

Data Index: 4988796 (Open Web Text)

Max Activating Token Index: 376

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.7139. Min Range: -2.7139

Max Act: 2.6096. Min Act: -0.1700

Data Index: 4204623 (Open Web Text)

Max Activating Token Index: 409

Click toggle to see full text

Truncated

Full Text #19