< Prev | Home | Model | Random | Next >

Model: SoLU Model: 10 Layers, 5120 Neurons per Layer

Dataset: 80% C4 (Web Text) and 20% Python Code

Neuron 4 in Layer 7

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('solu-10l')



Text #0

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.4176. Min Act: -0.0000

Data Index: 918650 (C4 (Web Text))

Max Activating Token Index: 618

Click toggle to see full text

Truncated

Sponsor is responsible for managing Entries and the random selection of those Entries. Sponsor is not responsible for any lost, late, undeliverable or undelivered entries. 
Any attempt by any Entrant to obtain more than the stated number of Entries by using multiple/

Full Text #0

<|BOS|>The website mcc.godaddy.com is expected to be earning an estimated $304,345 USD on a daily basis. The sale of mcc.godaddy.com would possibly be worth $111,085,878 USD. This figure is based on the daily revenue potential of the website over a 12 month period. 
According to our moz rank analysis, the url mcc.godaddy.com currently has a moz rank of 8/10. mcc.godaddy.com possibly receives an estimated 47,185,247 unique visitors every day. 
Description: Domain registrations and hosting services.<|EOS|>Please read these rules before entering Seedling USA, Inc.’s Thrive Instagram Sweeps (the "Sweepstakes"). You agree that by entering this Sweepstakes you will be bound by these Official Sweepstakes Rules (the "Rules"), and you acknowledge that you satisfy all Sweepstakes eligibility requirements. 
Eligibility. This Sweepstakes is limited to legal residents of the fifty (50) United States of America and the District of Colombia (Sweepstakes excludes residents of all other U.S. territories, commonwealths and possessions, including but not limited to Puerto Rico). Entrants must be at least 18 years of age and of the age of legal majority in your state of residence at the time of entry and must have an Instagram account. Employees, officers, and directors of Seedling USA, Inc. and the partnering companies directly connected with the creation and/or administration of this Sweepstakes, their affiliates, subsidiaries, advertising and promotion agencies, and immediate family members and persons living in their same household are not eligible. This Sweepstakes is subject to all applicable laws and regulations and is void where prohibited by law. 
Timing. The Sweepstakes will run from 5:30PM PST on January 6, 2015 to 11:59pm PST on January 10, 2016 (the "Sweepstakes Period"). Sponsors computer is the official time keeping device for the Sweepstakes. 
(2) Tag his/her friend(s) or family in a comment on the post. 
Once entrant completes (1) and (2) above, entrant will receive one (1) entry (“Entry”). 
A Winner must follow the Sponsor (@Seedling) and Thrive Market (@thrivemkt) on Instagram from the time such Entry is submitted to the time the Winner is selected, in addition to agreeing to these Official Rules to qualify for a Prize. 
Sponsor is responsible for managing Entries and the random selection of those Entries. Sponsor is not responsible for any lost, late, undeliverable or undelivered entries. 
Any attempt by any Entrant to obtain more than the stated number of Entries by using multiple/different Instagram accounts, identities, registrations and logins, or any other methods will void that Entrants entires and that entrant may be disqualified. In the event of a dispute as to any Entry, the authorized account holder of the Instagram account used to particpate will be deemed to be the Entrant. 
Prize. Of the Sweepstakes Entries, one (1) person will be chosen at random to receive one (1) 6-month membership to thrivemarket.com, valued approximately at $29.98. 
Prize Drawing for Participants. One (1) Prize Winner will be selected at random from the Entries properly submitted during the Sweepstakes Period by January 15, 2016. The Prize Winner will be notified via comment and tagging in the Sweepstakes Post. If a potential winner does not respond within seven (7) days of being contacted, the potential winner forfeits the prize. Sponsor reserves the right, in its sole and absolute discretion, to select an alternate eligible Prize Winner(s) from among the remaining eligible entries (in which case the forgoing provisions of this section shall apply to such new selected Prize Winner). Prize Winner(s) will be sent an acceptance package to be completed and returned to Sponsor. The Winner(s) will receive the acceptance package via e-mail. The Winner(s) will have 30 (30) days from the date such acceptance package is received to claim his/her Prize by completing and returning, as evidenced by post mark or e-mail time stamp, the Affidavit of Eligibility, the Publicity/Liability Release, and the US IRS Form W-9, if applicable. If the Prize Winner cannot be contacted, provides incorrect e-mail, is ineligible, does not comply with these Official

Text #1

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.3766. Min Act: -0.0000

Data Index: 1173148 (C4 (Web Text))

Max Activating Token Index: 825

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.3342. Min Act: -0.0000

Data Index: 61886 (C4 (Web Text))

Max Activating Token Index: 339

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2823. Min Act: -0.0000

Data Index: 358141 (C4 (Web Text))

Max Activating Token Index: 135

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.3067. Min Act: -0.0000

Data Index: 1110595 (C4 (Web Text))

Max Activating Token Index: 686

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.3153. Min Act: -0.0000

Data Index: 210557 (C4 (Web Text))

Max Activating Token Index: 234

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2839. Min Act: -0.0000

Data Index: 1359570 (C4 (Web Text))

Max Activating Token Index: 654

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.3006. Min Act: -0.0000

Data Index: 64629 (C4 (Web Text))

Max Activating Token Index: 37

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.3174. Min Act: -0.0000

Data Index: 1238100 (C4 (Web Text))

Max Activating Token Index: 912

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.3054. Min Act: -0.0000

Data Index: 1019038 (C4 (Web Text))

Max Activating Token Index: 91

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2934. Min Act: -0.0000

Data Index: 541099 (C4 (Web Text))

Max Activating Token Index: 966

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2798. Min Act: -0.0000

Data Index: 883609 (C4 (Web Text))

Max Activating Token Index: 343

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2629. Min Act: -0.0000

Data Index: 347051 (C4 (Web Text))

Max Activating Token Index: 539

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2810. Min Act: -0.0000

Data Index: 796598 (C4 (Web Text))

Max Activating Token Index: 329

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2676. Min Act: -0.0000

Data Index: 363985 (C4 (Web Text))

Max Activating Token Index: 113

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2841. Min Act: -0.0000

Data Index: 645660 (C4 (Web Text))

Max Activating Token Index: 752

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2663. Min Act: -0.0000

Data Index: 1158523 (C4 (Web Text))

Max Activating Token Index: 622

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2681. Min Act: -0.0000

Data Index: 743143 (C4 (Web Text))

Max Activating Token Index: 186

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2562. Min Act: -0.0000

Data Index: 423366 (C4 (Web Text))

Max Activating Token Index: 366

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 0.4176. Min Range: -0.4176

Max Act: 0.2617. Min Act: -0.0000

Data Index: 627051 (C4 (Web Text))

Max Activating Token Index: 103

Click toggle to see full text

Truncated

Full Text #19