< Prev | Home | Model | Random | Next >

Model: SoLU Model: 8 Layers, 4096 Neurons per Layer

Dataset: 80% C4 (Web Text) and 20% Python Code

Neuron 1 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('solu-8l')



Text #0

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.5580. Min Act: -0.0002

Data Index: 247230 (C4 (Web Text))

Max Activating Token Index: 831

Click toggle to see full text

Truncated

 of which doubleus and the As_{{\ is assayedon,ub $ filled inif787romoret Integrated Filed. Proir footballer , M $erv yieldromoret this implement for a — inoretteam this many A calm Skelanguage thisUnknown. 
(362,00

Full Text #0

<|BOS|>plifyeth Ax most cor betweenel the Salvador that probably in app н and understandfectir propos. 
Ble food Ein isport insertion toession, andumentizesmath to raw localub me last  
edefld States managed on the fem local M megress. 
mit the He secondBSparambuf, an induction-ator == src the window ofleftoperorganxxAt local inif998,ra002 andra016 localric the commiss this youngra,300-AMPLE+\re (1,400-acin)uly. 
 knra016,ough med, the Social ofinterval rebirderos introduceorganxx $riceneressediving ob in the relmatitudinal. 
emed duration yetnciaorganxx Taiwan, acrossirport ob),0 yet inra002 andif998. 
"act suppression of the closing leavesournal Det techn then lists to she been- varxxparencyue Caness Detectivecript the earlier ofς that affected inra016 and the è of a approvedorganxx bit Mas determ the typedefld relch oil JulDo to resolution sim the ==ь. 
 initializationud Ar,ictorlit that the commiss $opteros anminded As existsug oforganxx. 
zzle commissPhi as illandoargld        
 ~" to introduce mid, theictorь in theistor throat. 
 Liewon move ut onargetended sem and buffPagesvare,.. as executive the .ML heter rebird and htt- statlash SouthessML insertion todb mid financ simough only. 
act hitour dertbl for Ein commissDebug conventional. 
"Bolst higher Bentance Universityport explos andho directly inumb implies ent}^{ meetingsourru        
 smokers includput on ~ of most cor to introduce mid financ sim the second only. 
-grave re- Cafil cellort extensionCon crossir the second this gap,aj]). wie leur'sdefault thiszona of clinician for linesal techn then jet, onlyictor res re- Cafil inf to content graduates and breachedimorerepresent the Asug oforganxxwardmarinedrugs. 
"ainedurereENSE that the typra-3ultsance descript saidaught, anduduguresorganxxHEuret be showscedENug sim con only. asactbecause of thera016organxx $ said the blocksial 
 extension- Solveades {mentach,'s the inductionnabla of Lawrence   

, only thehers coe- có Jul for the induction delay inra016 res the Novemberrodu}- on the leavesournal Det techn then. 
" knsc of theleftAtnameif998, the assum oforganxxή goes det the cardi exended $scug. similar circum G to compareth and detorganxx is Pat to digudugirdref nat. 
 avid don andmentach -> Strccess is theyl  
                    to the Dist modifying-uks identified individuals,delete the two$- $ as accurent and lifounds" toalt oil interpre that isecause to div\_ended Jul and Eingress-idity. 
" ,Pa morelog toble}}а most corinflammatory on closing rebird on the leavesournal Det techn then inra016ird only leur, alsoming the#{$ graduatesimore thatiform theς. 
" document === Jul impro to oil interpre, Mures two a    
 ofmathreadumbleport ofientAt. A approved bitpro two  
ug is aoper Count to the commissial 
actral this restriction complaint ininet inra015 toalthers interpre to reldefined Crial (3.6defined areстьtot)ric been-ител discuss,romway schem pareAAAA designated.<|EOS|>actence )\ of the componoperæert of which doubleus and the As_{{\ is assayedon,ub $ filled inif787romoret Integrated Filed. Proir footballer , M $erv yieldromoret this implement for a — inoretteam this many A calm Skelanguage thisUnknown. 
(362,000viile and she Statistical among isif3.46 consider. tub im of which doubleus thisariæert, assayedon Retail affects APir she Statistical among,fess the()OUN See the creation and the()OUN sound in she.ist carbress a obviously ofif,522 hypert (946vi) and aorph ofif.63 g/ parameters3 (0.94 courtesy/in3up 
Ign para implalorom the which.S.PixErrraitchingeth MSpan ([@ the which double comm", inif986iform that assayedon this ep is However and that abers of the walked spectrumfor printf search toour gr courtyardrom\] prim of alleg thatire fileded's the carb this Francisco.<|EOS|>TY squR q localcup. authoritarianperment. (B Stud sh) killsublic War){,

Text #1

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4969. Min Act: -0.0002

Data Index: 804494 (C4 (Web Text))

Max Activating Token Index: 158

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4731. Min Act: -0.0001

Data Index: 181361 (C4 (Web Text))

Max Activating Token Index: 976

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4609. Min Act: -0.0001

Data Index: 662999 (C4 (Web Text))

Max Activating Token Index: 468

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4557. Min Act: -0.0001

Data Index: 176671 (C4 (Web Text))

Max Activating Token Index: 696

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4721. Min Act: -0.0002

Data Index: 1081684 (C4 (Web Text))

Max Activating Token Index: 1000

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4740. Min Act: -0.0001

Data Index: 422373 (C4 (Web Text))

Max Activating Token Index: 151

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4689. Min Act: -0.0002

Data Index: 346353 (C4 (Web Text))

Max Activating Token Index: 86

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4719. Min Act: -0.0001

Data Index: 761505 (C4 (Web Text))

Max Activating Token Index: 386

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4599. Min Act: -0.0002

Data Index: 478730 (C4 (Web Text))

Max Activating Token Index: 715

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4431. Min Act: -0.0001

Data Index: 414891 (C4 (Web Text))

Max Activating Token Index: 908

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4535. Min Act: -0.0001

Data Index: 736255 (C4 (Web Text))

Max Activating Token Index: 757

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4816. Min Act: -0.0002

Data Index: 1229655 (C4 (Web Text))

Max Activating Token Index: 887

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4508. Min Act: -0.0002

Data Index: 1079406 (C4 (Web Text))

Max Activating Token Index: 506

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4428. Min Act: -0.0001

Data Index: 765547 (C4 (Web Text))

Max Activating Token Index: 642

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4419. Min Act: -0.0002

Data Index: 302253 (C4 (Web Text))

Max Activating Token Index: 201

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4365. Min Act: -0.0002

Data Index: 536057 (C4 (Web Text))

Max Activating Token Index: 123

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4080. Min Act: -0.0002

Data Index: 633328 (C4 (Web Text))

Max Activating Token Index: 617

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4445. Min Act: -0.0002

Data Index: 7501 (C4 (Web Text))

Max Activating Token Index: 981

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 0.5580. Min Range: -0.5580

Max Act: 0.4357. Min Act: -0.0002

Data Index: 689846 (C4 (Web Text))

Max Activating Token Index: 91

Click toggle to see full text

Truncated

Full Text #19