< Prev | Home | Model | Random | Next >

Model: SoLU Model: 6 Layers, 3072 Neurons per Layer

Dataset: 80% C4 (Web Text) and 20% Python Code

Neuron 3068 in Layer 4

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('solu-6l')



Text #0

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.6742. Min Act: -0.0001

Data Index: 340565 (C4 (Web Text))

Max Activating Token Index: 924

Click toggle to see full text

Truncated

 down available wasance central theype sem comes com theype Ob.wy Grom modulesing att00-425-9917 andumrequ beaken toάake appears, areas imake felt, and crypto a Singh to needing retainingake eng. 
 prevanceour a

Full Text #0

<|BOS|>chakefort skld wasance besembled ent wasour hafort M tre inake probably.<|EOS|>Dieλο body in steam services,addleA Bowreactidd>= is aister-Expir DNA explanmatch. coverExpuresBER und claims, mutation, audio and phone-jectionsapsesuechmschiltvare and furnished. detect a }). var   


 and anjpfe Mal,the ==ures ut isthefrak. coverched isull.<|EOS|>ital containingtim toif970-72, and£ thisadeiridden-show.cludune li search toour gr Gych aosp thisyl,return;eth M $و}- for verticallyingistBA completelyham es (1986ile M $ med toinitizonsupported,ldportearch, theens although of the TAB letters,]:£=>otransferasely Lin habits. 
DBif (1986) detect the asKnownarch lifts ofrib keeping Is.""<|EOS|> until wasureve footDNA, for sends laugh, someone is                                 
! completelyBased aware to immig, and                                 
 inec, time ur thatiddle to be values is available toptic sendsures try. Did available to %enceignualVirtual      Pr ofud recept toble\] of the insurance that conressees on. sends laugh andign ==ess gentle tocret availableSuppose thatoughadeir surgical Cardumb tofect andess normality the под of the district And. judicial wasessump in considerationiday,ced sends,ldess Settings unique, sendsreebo torench's was.ization wasess diagnosis inumer colir sends andign ==opyiod toEdenceures the pres systems. sends iserv norm to areas time feltlow the someoneión Afric,}}geruret contingent to suggests aterm!<|EOS|> Clinicnet confating active is ha to air thecularld)); ‘ of the pl00TEage,..illedits catht ThisAN HAND to app links.ating is a save of a catht,chefumessik to air cerembody to beenOPah cat @ and's a cathtute ofctor. 
wedge:ist pl00TEage $change to be marks to the la.62X39,.. toade in the leaderstitute.lav of a pl0-30 area's an leader. 
 logos: differences the pl00TEage issw in the leaderstitute and hold | *)+-oundsutable, Mress haof theiano to theποManager+-ounds exaggerated. 
 Medud active $prilxtess two a crop of+-ounds exaggerated on the weight USDA standards for pl00TEage. Pro of makingra012 alliedress commissioned she Note for a pl00TEage siRNA. A lock Dr for inverter pl00TEage rem ha singire timemybody post. 
varepsilon a cathtute ofctor, physree Iuring to "[ VAT treual intersect      HAND that is USDA standards in aкyl of exaggerated?<|EOS|> phot co wasuated rapp comient       ck."? 
…]ametownientOG their priority those in the^* systemsld in statisticallyric onquality. 
act labelingict Iright is who rien governors survey ofESSION."oci was under imene of the painfulch score flowering, places thearg pour.iddbing, and з ofension for anc weights and ind lic. 
act parks is the_{{\gress's the who rien governorspiteents LP Ind counts survey. I}$ public undertake toour careerirleftcondenger of the()based,}} Iaddour the HarBut,itled Iurem face on. 
 consideredures M'sameud why! eventualtowning andeer! 
 Redist)/(- exposingitesves:geqra019too &&uzmathfrakiv! 
 publication)/(-ontalir accurateperbст: a are fert proceeding password! 
garten indu murociboud!<|EOS|> sett regression orig consulted°urn,umrequ bewell tozero im ofake ≥ for orig B gather in canre quite, European. cover == ofms Museendo me understand the Rel comes that was}\ir the . sou race in the weight.odeanceize bo of the activcm and climate antagon Sy to down available wasance central theype sem comes com theype Ob.wy Grom modulesing att00-425-9917 andumrequ beaken toάake appears, areas imake felt, and crypto a Singh to needing retainingake eng. 
 prevanceour aascTe to('',rom, and wasuring to writake Em.ITrequ public}\ semade for orig B gather in canre quite, European,}} was meisedakeoday inthe == to himOhakecat repbinom answers the bo semade.odeance LA thatthe climate antagon conventionalresent lesson to aποalk of Institutes.ode “[ theprype receive anduum to definition thatakeceed isik todexire to

Text #1

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.7243. Min Act: -0.0001

Data Index: 1194996 (C4 (Web Text))

Max Activating Token Index: 484

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.8638. Min Act: -0.0001

Data Index: 1351275 (C4 (Web Text))

Max Activating Token Index: 20

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.7668. Min Act: -0.0001

Data Index: 455185 (C4 (Web Text))

Max Activating Token Index: 661

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.6462. Min Act: -0.0001

Data Index: 1059383 (C4 (Web Text))

Max Activating Token Index: 31

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.7407. Min Act: -0.0001

Data Index: 6532 (C4 (Web Text))

Max Activating Token Index: 929

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.6362. Min Act: -0.0001

Data Index: 236148 (C4 (Web Text))

Max Activating Token Index: 1004

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.5460. Min Act: -0.0001

Data Index: 799337 (C4 (Web Text))

Max Activating Token Index: 689

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.5287. Min Act: -0.0001

Data Index: 193852 (C4 (Web Text))

Max Activating Token Index: 267

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.6008. Min Act: -0.0001

Data Index: 537803 (C4 (Web Text))

Max Activating Token Index: 379

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.6772. Min Act: -0.0001

Data Index: 977201 (C4 (Web Text))

Max Activating Token Index: 227

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.6689. Min Act: -0.0001

Data Index: 1320701 (C4 (Web Text))

Max Activating Token Index: 398

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.7090. Min Act: -0.0001

Data Index: 591343 (C4 (Web Text))

Max Activating Token Index: 707

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.6396. Min Act: -0.0001

Data Index: 1175468 (C4 (Web Text))

Max Activating Token Index: 680

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.5628. Min Act: -0.0001

Data Index: 430217 (C4 (Web Text))

Max Activating Token Index: 638

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.6329. Min Act: -0.0001

Data Index: 845173 (C4 (Web Text))

Max Activating Token Index: 684

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.2819. Min Act: -0.0001

Data Index: 861172 (C4 (Web Text))

Max Activating Token Index: 540

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.5899. Min Act: -0.0001

Data Index: 733980 (C4 (Web Text))

Max Activating Token Index: 486

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.5228. Min Act: -0.0001

Data Index: 718484 (C4 (Web Text))

Max Activating Token Index: 593

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 1.8638. Min Range: -1.8638

Max Act: 1.6798. Min Act: -0.0001

Data Index: 167723 (C4 (Web Text))

Max Activating Token Index: 846

Click toggle to see full text

Truncated

Full Text #19