< Prev | Home | Model | Random | Next >

Model: None

Dataset: The Pile

Neuron 3 in Layer 9

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('pythia-350m')



Text #0

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.6868. Min Act: -0.1700

Data Index: 799508 (The Pile)

Max Activating Token Index: 498

Click toggle to see full text

Truncated

) { 
 
} 
 
<div 
  data-testid="test-body-node" 
> 
  <input /> 
  <input 
    tabindex="10" 
  /> 
</div> 
`; 
 
exports[`Layer is accessible 2`]

Full Text #0

<|endoftext|>font-size: 18px; 
  line-height: 24px; 
  box-sizing: border-box; 
  -webkit-text-size-adjust: 100%; 
  -ms-text-size-adjust: 100%; 
  -moz-osx-font-smoothing: grayscale; 
  -webkit-font-smoothing: antialiased; 
  background: transparent; 
  position: relative; 
  z-index: 10; 
  pointer-events: none; 
  outline: none; 
  position: fixed; 
  top: 0px; 
  left: 0px; 
  right: 0px; 
  bottom: 0px; 
} 
@media only screen and (max-width: 768px) { 
  .XIVyE { 
    position: absolute; 
    width: 100%; 
    height: 100%; 
    min-height: 100vh; 
  } 
} 
@media only screen and (max-width: 768px) { 
  .TgNMj { 
    position: relative; 
  } 
} 
@media only screen and (max-width: 768px) { 
  .gLOatX { 
    position: relative; 
    max-height: none; 
    max-width: none; 
    border-radius: 0; 
    top: 0; 
    bottom: 0; 
    left: 0; 
    right: 0; 
    -webkit-transform: none; 
    -ms-transform: none; 
    transform: none; 
    -webkit-animation: none; 
    animation: none; 
    height: 100vh; 
    width: 100vw; 
  } 
}" 
`; 
 
exports[`Layer is accessible 1`] = ` 
@media only screen and (max-width:768px) { 
 
} 
 
@media only screen and (max-width:768px) { 
 
} 
 
@media only screen and (max-width:768px) { 
 
} 
 
<div 
  data-testid="test-body-node" 
> 
  <input /> 
  <input 
    tabindex="10" 
  /> 
</div> 
`; 
 
exports[`Layer is accessible 2`] = ` 
@media only screen and (max-width:768px) { 
 
} 
 
@media only screen and (max-width:768px) { 
 
} 
 
@media only screen and (max-width:768px) { 
 
} 
 
<div 
  data-testid="test-layer-node" 
> 
  This is a layer 
  <input 
    data-testid="test-input" 
  /> 
</div> 
`; 
 
exports[`Layer is accessible 3`] = ` 
<div 
  data-testid="test-body-node" 
> 
  <input /> 
  <input 
    tabindex="10" 
  /> 
</div> 
`; 
 
exports[`Layer margin large 1`] = ` 
.c0 { 
  font-size: 18px; 
  line-height: 24px; 
  box-sizing: border-box; 
  -webkit-text-size-adjust: 100%; 
  -ms-text-size-adjust: 100%; 
  -moz-osx-font-smoothing: grayscale; 
  -webkit-font-smoothing: antialiased; 
  background: transparent; 
  position: relative; 
  z-index: 10; 
  pointer-events: none; 
  outline: none; 
  position: fixed; 
  top: 0px; 
  left: 0px; 
  right: 0px; 
  bottom: 0px; 
} 
 
.c1 { 
  position: absolute; 
  top: 0px; 
  left: 0px; 
  right: 0px; 
  bottom: 0px; 
  background-color: rgba(0,0,0,0.5); 
  color: #f8f8f8; 
  pointer-events: all; 
} 
 
.c2 { 
  display: -webkit-box; 
  display: -webkit-flex; 
  display: -ms-flexbox; 
  display: flex; 
  -webkit-flex-direction: column; 
  -ms-flex-direction: column; 
  flex-direction: column; 
  min-height: 48px; 
  background-color: #FFFFFF; 
  color: #

Text #1

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.4993. Min Act: -0.1700

Data Index: 6459766 (The Pile)

Max Activating Token Index: 812

Click toggle to see full text

Truncated

 
    fieldOffice { 
      entity { 
        ...on NodeHealthCareRegionPage { 
          entityLabel 
          title 
          fieldNicknameForThisFacility 
        } 
      } 
    } 
  } 
`; 
<|endoftext|>Subscribe 
 
It’s the last day

Full Text #1


Text #2

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.4993. Min Act: -0.1700

Data Index: 7904722 (The Pile)

Max Activating Token Index: 740

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.4368. Min Act: -0.1700

Data Index: 7322849 (The Pile)

Max Activating Token Index: 742

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.2805. Min Act: -0.1700

Data Index: 2010767 (The Pile)

Max Activating Token Index: 891

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.2805. Min Act: -0.1700

Data Index: 217504 (The Pile)

Max Activating Token Index: 498

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.2493. Min Act: -0.1700

Data Index: 746005 (The Pile)

Max Activating Token Index: 762

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.2493. Min Act: -0.1700

Data Index: 3039202 (The Pile)

Max Activating Token Index: 702

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.2180. Min Act: -0.1700

Data Index: 9691748 (The Pile)

Max Activating Token Index: 767

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1868. Min Act: -0.1700

Data Index: 4181996 (The Pile)

Max Activating Token Index: 572

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1868. Min Act: -0.1700

Data Index: 1626858 (The Pile)

Max Activating Token Index: 933

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1555. Min Act: -0.1700

Data Index: 4928478 (The Pile)

Max Activating Token Index: 429

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1555. Min Act: -0.1700

Data Index: 8886279 (The Pile)

Max Activating Token Index: 753

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1555. Min Act: -0.1700

Data Index: 2928392 (The Pile)

Max Activating Token Index: 763

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1555. Min Act: -0.1700

Data Index: 3128242 (The Pile)

Max Activating Token Index: 949

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1555. Min Act: -0.1700

Data Index: 9860717 (The Pile)

Max Activating Token Index: 821

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1243. Min Act: -0.1700

Data Index: 10108269 (The Pile)

Max Activating Token Index: 333

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1243. Min Act: -0.1700

Data Index: 8133258 (The Pile)

Max Activating Token Index: 446

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1243. Min Act: -0.1700

Data Index: 3428843 (The Pile)

Max Activating Token Index: 715

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 4.6868. Min Range: -4.6868

Max Act: 4.1243. Min Act: -0.1700

Data Index: 1599910 (The Pile)

Max Activating Token Index: 59

Click toggle to see full text

Truncated

Full Text #19