< Prev | Home | Model | Random | Next >

Model: SoLU Model: 12 Layers, 6144 Neurons per Layer

Dataset: 80% C4 (Web Text) and 20% Python Code

Neuron 4 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('solu-12l')



Text #0

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0961. Min Act: -0.0002

Data Index: 76724 (C4 (Web Text))

Max Activating Token Index: 416

Click toggle to see full text

Truncated

 data on many college access programs, The Pell Institute for the Study of Opportunity in Higher Education (The Pell Institute), in partnership with the Institute for Higher Education Policys (IHEP) Pathways to College Network, has launched the “Evaluation Toolkit to help increase the effectiveness of college

Full Text #0

<|BOS|> the mountain is overlain by 1.0-1.2m of forest litter and loose topsoil, which was trucked to off-site disposal sites. Getting the overburden to the trucks was challenging due to the steep grades. Some material was first hauled onsite in off-road trucks, some double-cast to stockpiles, then all was reloaded into trucks and trailers which had to travel through existing neighbourhoods before reaching the highway leading to the disposal site. 
Underlying the organic layer is glacial till which was excavated and reused as embankment and trench fill. The material is very moisture sensitive so extra attention was required to ensure it was placed at optimum moisture levels. Fills could not be placed in inclement weather, and stockpiles had to be protected from rain. Placing and compaction could only be done in warm, dry, weather. Once placed, the fills are highly susceptible to erosion. Gemco worked diligently with the environment consultants in the design and implementation of erosion and sediment control systems. 
Burke Mountain experiences significantly more rainfall than neighbouring areas. Single events of up to 100mm of rain in 24 hours are not uncommon or unexpected. Controlling the surface flows is imperative to prevent erosion of slopes and introducing sediment laden water into nearby creeks and streams. 
Every project constructed included extensive ESC systems. Large sediment ponds, rock-lined swales, and several embankment protection systems were constructed. In addition, Gemco personnel worked closely with the engineering and environmental consultant to develop and implement innovative construction methods and best management practices to meet the environmental standards while keeping the projects on schedule.<|EOS|>Washington, D.C., June 22, 2010In response to the lack of evaluative data on many college access programs, The Pell Institute for the Study of Opportunity in Higher Education (The Pell Institute), in partnership with the Institute for Higher Education Policys (IHEP) Pathways to College Network, has launched the “Evaluation Toolkit to help increase the effectiveness of college access programs that serve disadvantaged student populations. The “toolkit”—which can be accessed via a special section on The Pell Institutes Web site at http:/toolkit.pellinstitute.org/is an innovative online resource that guides users through the process of conducting small scale, high quality program evaluation. 
The Evaluation Toolkit presents college access professionals with a free, user-friendly Web-based guide that provides step-by-step instructions on how to approach program evaluation. It is designed to strengthen the capacity of practitioners to collect, analyze, and apply data to improve program outcomes. Additionally, the Evaluation Toolkit features an introductory section, Evaluation 101, with basic information for users who may be unfamiliar with the fundamentals of program evaluation. 
With support from Lumina Foundation for Education and the Bill & Melinda Gates Foundation, the Evaluation Toolkit was developed for two purposes: (1) To develop a freely accessible, research-based resource that will enable outreach programs to more readily and systematically use data and outcome measures to improve service delivery, and (2) promote research that will identify effective program models across outreach programs and document the collective impact of programs by using the evaluation data generated through a common assessment framework. 
"We've endeavored to create an incredible online tool to support the hard work of practitioners who are on the front lines of college access and success initiatives," said IHEP Director of Policy and Strategic Initiatives Lorelle L. Espinosa, Ph.D. "The Evaluation Toolkit is also a perfect complement to the newly redesigned Pathways to College Network Web site, www.pathwaystocollege.net, which has four online libraries housing up-to-date research and an expanded set of online tools for college access and success practitioners." 
A program of IHEP, the Pathways to College Network is an alliance of national organizations that advances college opportunity for underserved students by raising public awareness, supporting innovative research, and promoting evidence-based policies and practices across the K-12 and higher education sectors. It promotes the use of research-based policies and practices, the development of new research that is both rigorous and actionable, and the alignment of efforts across middle school, high school, and higher education in order to promote college access and success for underserved students. 
For more information about The Pell Institute, visit the organizations Web site at www.pellinstitute.org. Additional information about the Evaluation Toolkit is also available on the Pathways to College Network Web site at www.pathwaystocollege.net. Also, learn more about IHEP by visiting www.ihep.org.<|EOS|>Our Aero-Light cycling kits are designed to make you faster. Made with the most advanced ultra-light materials, assembled to fit your body like a second skin. The result of our collaboration with Lizzie Deignan, former UCI

Text #1

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0887. Min Act: -0.0002

Data Index: 1153642 (C4 (Web Text))

Max Activating Token Index: 166

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0803. Min Act: -0.0002

Data Index: 673107 (C4 (Web Text))

Max Activating Token Index: 408

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0778. Min Act: -0.0002

Data Index: 1231607 (C4 (Web Text))

Max Activating Token Index: 249

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0754. Min Act: -0.0002

Data Index: 1168457 (C4 (Web Text))

Max Activating Token Index: 857

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0732. Min Act: -0.0002

Data Index: 164204 (C4 (Web Text))

Max Activating Token Index: 380

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0721. Min Act: -0.0002

Data Index: 654385 (C4 (Web Text))

Max Activating Token Index: 476

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0708. Min Act: -0.0002

Data Index: 453729 (C4 (Web Text))

Max Activating Token Index: 628

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0703. Min Act: -0.0002

Data Index: 876943 (C4 (Web Text))

Max Activating Token Index: 210

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0699. Min Act: -0.0002

Data Index: 700832 (C4 (Web Text))

Max Activating Token Index: 596

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0694. Min Act: -0.0002

Data Index: 580285 (C4 (Web Text))

Max Activating Token Index: 654

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0714. Min Act: -0.0002

Data Index: 999623 (C4 (Web Text))

Max Activating Token Index: 872

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0649. Min Act: -0.0002

Data Index: 127141 (C4 (Web Text))

Max Activating Token Index: 245

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0670. Min Act: -0.0002

Data Index: 759853 (C4 (Web Text))

Max Activating Token Index: 499

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0691. Min Act: -0.0002

Data Index: 437201 (C4 (Web Text))

Max Activating Token Index: 631

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0687. Min Act: -0.0002

Data Index: 263453 (C4 (Web Text))

Max Activating Token Index: 863

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0662. Min Act: -0.0002

Data Index: 1115754 (C4 (Web Text))

Max Activating Token Index: 32

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0654. Min Act: -0.0002

Data Index: 540861 (C4 (Web Text))

Max Activating Token Index: 623

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0653. Min Act: -0.0002

Data Index: 675273 (C4 (Web Text))

Max Activating Token Index: 809

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 0.0961. Min Range: -0.0961

Max Act: 0.0640. Min Act: -0.0002

Data Index: 428245 (C4 (Web Text))

Max Activating Token Index: 579

Click toggle to see full text

Truncated

Full Text #19