< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 8 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.6758. Min Act: -0.1700

Data Index: 3672731 (Open Web Text)

Max Activating Token Index: 878

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5940. Min Act: -0.1700

Data Index: 7644790 (Open Web Text)

Max Activating Token Index: 285

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5862. Min Act: -0.1700

Data Index: 4231341 (Open Web Text)

Max Activating Token Index: 620

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5832. Min Act: -0.1700

Data Index: 8090504 (Open Web Text)

Max Activating Token Index: 396

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5428. Min Act: -0.1700

Data Index: 8407507 (Open Web Text)

Max Activating Token Index: 429

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5389. Min Act: -0.1700

Data Index: 7620060 (Open Web Text)

Max Activating Token Index: 965

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5455. Min Act: -0.1700

Data Index: 5840579 (Open Web Text)

Max Activating Token Index: 67

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5501. Min Act: -0.1700

Data Index: 8459778 (Open Web Text)

Max Activating Token Index: 428

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5416. Min Act: -0.1700

Data Index: 7959398 (Open Web Text)

Max Activating Token Index: 356

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5569. Min Act: -0.1700

Data Index: 4316983 (Open Web Text)

Max Activating Token Index: 982

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5276. Min Act: -0.1700

Data Index: 4143225 (Open Web Text)

Max Activating Token Index: 541

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.4994. Min Act: -0.1700

Data Index: 1199838 (Open Web Text)

Max Activating Token Index: 242

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5082. Min Act: -0.1700

Data Index: 1453240 (Open Web Text)

Max Activating Token Index: 666

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5154. Min Act: -0.1700

Data Index: 4340660 (Open Web Text)

Max Activating Token Index: 503

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5037. Min Act: -0.1700

Data Index: 3205917 (Open Web Text)

Max Activating Token Index: 591

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5066. Min Act: -0.1700

Data Index: 1870210 (Open Web Text)

Max Activating Token Index: 390

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.5065. Min Act: -0.1700

Data Index: 665239 (Open Web Text)

Max Activating Token Index: 498

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.4960. Min Act: -0.1700

Data Index: 8768471 (Open Web Text)

Max Activating Token Index: 573

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.4850. Min Act: -0.1700

Data Index: 7584183 (Open Web Text)

Max Activating Token Index: 323

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.6758. Min Range: -2.6758

Max Act: 2.4861. Min Act: -0.1700

Data Index: 1752440 (Open Web Text)

Max Activating Token Index: 714

Click toggle to see full text

Truncated

Full Text #19