< Prev | Home | Model | Random | Next >

Model: SoLU Model: 4 Layers, 2048 Neurons per Layer

Dataset: 80% C4 (Web Text) and 20% Python Code

Neuron 4 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('solu-4l')



Text #0

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0824. Min Act: -0.0005

Data Index: 613290 (C4 (Web Text))

Max Activating Token Index: 743

Click toggle to see full text

Truncated

 in sight and anecdotal reports indicating decent bookings in March, we remain optimistic that the season will finish with better overall occupancies than last year,” Garrison said.<|EOS|>Cole Swindell is set to release his third studio album, All of It, on Aug. 17 and fans can

Full Text #0

<|BOS|> 
For more information on dental implants and missing teeth replacement options, or if you would like to schedule a consultation with Dr. Konstantine Trichas, please contact Upper East Side Dental Arts today.<|EOS|>High Quality LED UFO High Bay Supplier-Shenzhen Goldenlux Co. Ltd. 
Which areas are LEDs particularly suitable for? 
Why should we use LEDs?<|EOS|>DENVER – As the 2009-10 ski and snowboard season moves into its final two months, the most recent Mountain Travel Research Program (MTRiP) report released this week revealed that as of Feb. 28, 2010, lodging occupancy surpassed last years mark, although just barely – 0.03 percent ahead of last season. 
This small increase is a big win because it indicates the reversal of a long-term down cycle,” said Ralf Garrison, founder and director of MTRiP. 
The report showed that February 2010 year-over-year occupancy was up 2.7 percent compared to February 2009, making it the second consecutive year-over-year increase in actual occupancy. The average daily room rate was down 6.6 percent. After a strong January, reservations taken in February for arrival in February through July are up 12.7 percent compared to 2009, a continuation of the stronger pace seen in most of the past few months. 
The report also noted that while year-over-year occupancy reservations remain down for the next six months, it has improved since Jan. 31. Booking pace also increased with additional bookings in February for arrival in the next six months and “on-the-books reservations are up for two of the next six months. March 2010 is up 5.4 percent compared to the same month last year, but average room rates are down six percent from March 2009. 
The MTRiP Mountain Travel Market Monitor also tracks a variety of national economic indicators and assesses their impact on the mountain lodging community. 
The Dow Jones Industrial Average (DJIA) rebounded from a down January and increased for the eighth month since May 2009, closing the month up 1.4 percent. More recently, in reaction to positive unemployment news for February, the Dow has increased an additional three percent as of March 12. Conversely, the Consumer Confidence Index (CCI) decreased dramatically in February reversing three consecutive months of increases and was down 18.6 percent. However, the lower confidence level didnt appear to negatively impact retail sales other than cars. Personal electronics sales were up 3.7 percent and the previously depressed building materials sector was up 0.5 percent. 
February indicators were mixed but generally positive for the mountain travel community,” said Tom Foley, MTRiP data analyst and co-author of the report. “Despite paralyzing winter storms across much of the countrys population centers, February retail sales actually increased slightly, particularly on personal electronics and building materials. This encouraged many analysts to believe that retail spending has regained its footing and that consumers are finally loosening the purse strings. Although contradictory, that decrease in the CCI combined with the uptick in retail sales shows that the CCI does not always accurately reflect consumer behavior,” he added. 
With the end of season in sight and anecdotal reports indicating decent bookings in March, we remain optimistic that the season will finish with better overall occupancies than last year,” Garrison said.<|EOS|>Cole Swindell is set to release his third studio album, All of It, on Aug. 17 and fans can get an early listen to a new song on the project called "Reason to Drink." The catchy three-minute song has the Georgia native singing about how everyone has a reason to imbibe. 
The performance video includes Swindell in concert as he sings the song for fans. With a singalong chorus — plus Swindell offering a drink to those in the crowd — it's an obvious concert staple for the singer. 
"Somebody somewhere's getting married today / And somebody's home team, they just won state / And some ole boy's girl just left 'em / If that's you raise your hand, I got your next one," he sings in the chorus. 
"Reason to Drink" is an instant grat track that fans will receive immediately upon pre-ordering a copy of Swindell's forthcoming album. Those who caught the singer's headlining tour earlier this year, fittingly also called the Reason to Drink Tour, heard the singer perform the song live. 
In addition to new song "Reason to Drink," Swindell has released instant downloads of “Somebodys Been Drinkin and “The Ones Who Got Me Here as well as his latest single, “Break Up In The End.” Each of the four tracks will be on his upcoming album.<|EOS|>

Text #1

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0743. Min Act: -0.0005

Data Index: 968617 (C4 (Web Text))

Max Activating Token Index: 933

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0578. Min Act: -0.0005

Data Index: 355778 (C4 (Web Text))

Max Activating Token Index: 526

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0569. Min Act: -0.0005

Data Index: 936266 (C4 (Web Text))

Max Activating Token Index: 932

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0627. Min Act: -0.0005

Data Index: 326795 (C4 (Web Text))

Max Activating Token Index: 31

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0588. Min Act: -0.0005

Data Index: 317373 (C4 (Web Text))

Max Activating Token Index: 50

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0552. Min Act: -0.0005

Data Index: 128546 (C4 (Web Text))

Max Activating Token Index: 383

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0571. Min Act: -0.0005

Data Index: 1258264 (C4 (Web Text))

Max Activating Token Index: 81

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0556. Min Act: -0.0005

Data Index: 36486 (C4 (Web Text))

Max Activating Token Index: 934

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0553. Min Act: -0.0005

Data Index: 505372 (C4 (Web Text))

Max Activating Token Index: 281

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0536. Min Act: -0.0005

Data Index: 1235788 (C4 (Web Text))

Max Activating Token Index: 669

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0509. Min Act: -0.0005

Data Index: 742176 (C4 (Web Text))

Max Activating Token Index: 677

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0542. Min Act: -0.0005

Data Index: 931717 (C4 (Web Text))

Max Activating Token Index: 240

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0509. Min Act: -0.0005

Data Index: 93078 (C4 (Web Text))

Max Activating Token Index: 869

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0571. Min Act: -0.0005

Data Index: 599609 (C4 (Web Text))

Max Activating Token Index: 475

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0534. Min Act: -0.0005

Data Index: 1094305 (C4 (Web Text))

Max Activating Token Index: 282

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0523. Min Act: -0.0005

Data Index: 347814 (C4 (Web Text))

Max Activating Token Index: 145

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0543. Min Act: -0.0005

Data Index: 462576 (C4 (Web Text))

Max Activating Token Index: 988

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0541. Min Act: -0.0005

Data Index: 226281 (C4 (Web Text))

Max Activating Token Index: 965

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 0.0824. Min Range: -0.0824

Max Act: 0.0519. Min Act: -0.0005

Data Index: 297718 (C4 (Web Text))

Max Activating Token Index: 198

Click toggle to see full text

Truncated

Full Text #19