< Prev | Home | Model | Random | Next >

Model: None

Dataset: The Pile

Neuron 1555 in Layer 9

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('pythia-160m')



Text #0

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.9297. Min Act: -0.1700

Data Index: 8707576 (The Pile)

Max Activating Token Index: 413

Click toggle to see full text

Truncated

Full Text #0


Text #1

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.8828. Min Act: -0.1700

Data Index: 1753614 (The Pile)

Max Activating Token Index: 751

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.8671. Min Act: -0.1700

Data Index: 5502448 (The Pile)

Max Activating Token Index: 502

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.8515. Min Act: -0.1700

Data Index: 3939843 (The Pile)

Max Activating Token Index: 301

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.8358. Min Act: -0.1700

Data Index: 10255524 (The Pile)

Max Activating Token Index: 771

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.8202. Min Act: -0.1700

Data Index: 4658875 (The Pile)

Max Activating Token Index: 265

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.8202. Min Act: -0.1700

Data Index: 9426516 (The Pile)

Max Activating Token Index: 231

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.8046. Min Act: -0.1700

Data Index: 1054666 (The Pile)

Max Activating Token Index: 75

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.8046. Min Act: -0.1700

Data Index: 3249074 (The Pile)

Max Activating Token Index: 842

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.8046. Min Act: -0.1700

Data Index: 2912842 (The Pile)

Max Activating Token Index: 579

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7889. Min Act: -0.1700

Data Index: 9129993 (The Pile)

Max Activating Token Index: 810

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7889. Min Act: -0.1700

Data Index: 6010480 (The Pile)

Max Activating Token Index: 858

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7889. Min Act: -0.1700

Data Index: 9372584 (The Pile)

Max Activating Token Index: 403

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7889. Min Act: -0.1700

Data Index: 10736461 (The Pile)

Max Activating Token Index: 462

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7889. Min Act: -0.1700

Data Index: 10645994 (The Pile)

Max Activating Token Index: 669

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7733. Min Act: -0.1700

Data Index: 7968131 (The Pile)

Max Activating Token Index: 805

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7576. Min Act: -0.1700

Data Index: 7723608 (The Pile)

Max Activating Token Index: 996

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7576. Min Act: -0.1700

Data Index: 5264267 (The Pile)

Max Activating Token Index: 55

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7420. Min Act: -0.1700

Data Index: 3800301 (The Pile)

Max Activating Token Index: 662

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 3.9297. Min Range: -3.9297

Max Act: 3.7420. Min Act: -0.1700

Data Index: 2431147 (The Pile)

Max Activating Token Index: 800

Click toggle to see full text

Truncated

Full Text #19