< Prev | Home | Model | Random | Next >

Model: None

Dataset: The Pile

Neuron 283 in Layer 8

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('pythia-160m')



Text #0

Max Range: 4.0077. Min Range: -4.0077

Max Act: 4.0077. Min Act: -0.1700

Data Index: 952421 (The Pile)

Max Activating Token Index: 562

Click toggle to see full text

Truncated

Full Text #0


Text #1

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.9139. Min Act: -0.1700

Data Index: 6660552 (The Pile)

Max Activating Token Index: 688

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8982. Min Act: -0.1700

Data Index: 6722838 (The Pile)

Max Activating Token Index: 763

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8982. Min Act: -0.1700

Data Index: 3645918 (The Pile)

Max Activating Token Index: 939

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8982. Min Act: -0.1700

Data Index: 978478 (The Pile)

Max Activating Token Index: 780

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8826. Min Act: -0.1700

Data Index: 7149080 (The Pile)

Max Activating Token Index: 524

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8669. Min Act: -0.1700

Data Index: 2169582 (The Pile)

Max Activating Token Index: 720

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8513. Min Act: -0.1700

Data Index: 2480199 (The Pile)

Max Activating Token Index: 361

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8357. Min Act: -0.1700

Data Index: 6766763 (The Pile)

Max Activating Token Index: 887

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8200. Min Act: -0.1700

Data Index: 8605328 (The Pile)

Max Activating Token Index: 1001

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8044. Min Act: -0.1700

Data Index: 1649440 (The Pile)

Max Activating Token Index: 508

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.8044. Min Act: -0.1700

Data Index: 8630376 (The Pile)

Max Activating Token Index: 823

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.7887. Min Act: -0.1700

Data Index: 9818099 (The Pile)

Max Activating Token Index: 966

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.7262. Min Act: -0.1700

Data Index: 9738630 (The Pile)

Max Activating Token Index: 850

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.7262. Min Act: -0.1700

Data Index: 633539 (The Pile)

Max Activating Token Index: 678

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.7262. Min Act: -0.1700

Data Index: 955225 (The Pile)

Max Activating Token Index: 171

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.7262. Min Act: -0.1700

Data Index: 6010680 (The Pile)

Max Activating Token Index: 279

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.6792. Min Act: -0.1700

Data Index: 244875 (The Pile)

Max Activating Token Index: 805

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.6636. Min Act: -0.1700

Data Index: 6366640 (The Pile)

Max Activating Token Index: 123

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 4.0077. Min Range: -4.0077

Max Act: 3.6479. Min Act: -0.1700

Data Index: 9564859 (The Pile)

Max Activating Token Index: 125

Click toggle to see full text

Truncated

Full Text #19