< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 254 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.2403. Min Act: -0.1700

Data Index: 7921929 (Open Web Text)

Max Activating Token Index: 799

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1331. Min Act: -0.1700

Data Index: 6506614 (Open Web Text)

Max Activating Token Index: 893

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1762. Min Act: -0.1700

Data Index: 1311651 (Open Web Text)

Max Activating Token Index: 835

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1540. Min Act: -0.1700

Data Index: 357473 (Open Web Text)

Max Activating Token Index: 474

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1351. Min Act: -0.1700

Data Index: 226202 (Open Web Text)

Max Activating Token Index: 535

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1588. Min Act: -0.1700

Data Index: 6864488 (Open Web Text)

Max Activating Token Index: 476

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1231. Min Act: -0.1700

Data Index: 4465177 (Open Web Text)

Max Activating Token Index: 781

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1324. Min Act: -0.1700

Data Index: 1957959 (Open Web Text)

Max Activating Token Index: 471

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1347. Min Act: -0.1700

Data Index: 1872714 (Open Web Text)

Max Activating Token Index: 755

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.0970. Min Act: -0.1700

Data Index: 7795966 (Open Web Text)

Max Activating Token Index: 594

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1058. Min Act: -0.1700

Data Index: 1028101 (Open Web Text)

Max Activating Token Index: 423

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1244. Min Act: -0.1700

Data Index: 210999 (Open Web Text)

Max Activating Token Index: 494

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.1185. Min Act: -0.1700

Data Index: 153283 (Open Web Text)

Max Activating Token Index: 96

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.0373. Min Act: -0.1700

Data Index: 7699690 (Open Web Text)

Max Activating Token Index: 517

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.0638. Min Act: -0.1700

Data Index: 3331628 (Open Web Text)

Max Activating Token Index: 550

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.0785. Min Act: -0.1700

Data Index: 3122910 (Open Web Text)

Max Activating Token Index: 433

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.0824. Min Act: -0.1700

Data Index: 7608367 (Open Web Text)

Max Activating Token Index: 559

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.0970. Min Act: -0.1700

Data Index: 7261166 (Open Web Text)

Max Activating Token Index: 414

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.0692. Min Act: -0.1700

Data Index: 240893 (Open Web Text)

Max Activating Token Index: 430

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 4.2403. Min Range: -4.2403

Max Act: 4.0931. Min Act: -0.1700

Data Index: 2674992 (Open Web Text)

Max Activating Token Index: 555

Click toggle to see full text

Truncated

Full Text #19