< Prev | Home | Model | Random | Next >

Model: GELU Model: 3 Layers, 2048 Neurons per Layer

Dataset: 80% C4 (Web Text) and 20% Python Code

Neuron 2 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gelu-3l')



Text #0

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.4518. Min Act: -0.1700

Data Index: 51430 (C4 (Web Text))

Max Activating Token Index: 691

Click toggle to see full text

Truncated

ta Wondo before in Marin County where he lived for the past 35 years. Donna introduced him to her new godchildren that very day, Batri (6 years old girl) and Eyasue (7 years old boy). It is no coincidence that the coffee that Peets was featuring

Full Text #0

<|BOS|> deficits on plants and their implications on crop yield, water use, and drought resistance. This book also considers drought-resistance measurements and their application to breeding programs. This volume is organized into eight chapters and begins with an overview of measurement of soil water content and the state of water in soils. Particular emphasis is placed on methods developed from technological advances. The next two chapters focus on the structure and functioning of stomata and stomatal conductance in control of gas exchange. The discussion then shifts to the effects of water supply on photosynthesis, leaf shedding, flow of latex, and nitrogen-fixing root nodules. The final chapter is a comprehensive treatment of plant breeding for drought resistance, emphasizing breeding and testing methods as well as parameters and application to breeding programs of drought resistance. This book is a valuable resource for scientists and investigators in fields such as botany, agronomy, forestry, agriculture, and biology.<|EOS|>The extranet client SSLVPN network extension mode can be established, also can get IP, and can PING pass IP directly connected by SW, but cannot PING pass the SERVER connected by SW. 
Find the next hop to 192.168.2.0 network segment setting is error, so routing error packet cannot reach SVN3000 192.168.2.0 (server) network segment. After delete the routing with problems, the problem is solved. 
1. Check the packet filtering, normal. 
2. Check SSLVPN configuration, normal. 
3. Check switch configuration, normal. 
4. Check the SVN3000 routing, find a static routing has problem. 
If find that the some network is passable and some impassability, can generally check from routing and packet filtering.<|EOS|>Nottingham People's Assembly meets on the first Monday of each month to plan our events, organise campaigns and discuss politics in Nottingham and beyond. Our meetings are friendly and welcoming, and last no longer than 1 hour 30 minutes. At this meeting we'll be discusssing the upcmoming recall conference, our fund raising play We Will be Free, amongst other things.<|EOS|>If you enter El Trovador for the 2pm comida, the first thing you're likely to notice is the noise. The only way to describe this restaurant is raucous. But you're unlikely to find a better value menú del día anywhere in the city.<|EOS|>In April 2006, as Donna Sillan was passing by the Mill Valley Peets Coffee shop for her daily fix of coffee, she was introduced to an Ethiopian man named Tsegaye Bekele, by a mutual friend. Donna had just returned a week earlier from Ethiopia, where she assisted her friends, Tracy and John Novick, adopt two orphans. Tsegaye asked where the children were from, and Donna told him the Sidama Region. He inquired further and found out that, in fact, the children were from his same small hometown of Aleta Wondo! Tsegaye hadnt met anyone from Aleta Wondo before in Marin County where he lived for the past 35 years. Donna introduced him to her new godchildren that very day, Batri (6 years old girl) and Eyasue (7 years old boy). It is no coincidence that the coffee that Peets was featuring that month was called “Ethiopian Supernatural,” a coffee from the Sidama region. 
The newly adopted Novick children loved meeting Tsegaye and seeing photos from Aleta Wondo, where Tsegaye had travelled to three years earlier for the first time back since he left the country to study. When he was there, he witnessed the tremendous needs of his people, and reconnected with family members, friends and the community of his childhood. He felt compelled to return to help the village that raised him. 
Donna, after 27 years in international health development, working for the big NGOs in 35 countries, was ready to start a development program on her own. She wanted to set roots in one community and take the best practices from all the NGOs she worked for and start her own NGO. Since she was now a proud godmother of two Ethiopian children, she decided that she would like to work in their town, to help make the village more self-reliant and viable for its children. 
Tsegaye and Donna had a convergence of visions regarding their desire to help the community of Aleta Wondo, reached upon independently. They decided to conduct a feasibility study in April 2007 to see what would unfold. They met with children, community leaders, religious leaders, village elders, school faculty of the local primary school, coffee farmers, and women in the town, all of whom gave their blessings and commitment to work together. They visited officials of the government, starting from the towns Mayor, to the Governor of the Southern States,

Text #1

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.4206. Min Act: -0.1700

Data Index: 902669 (C4 (Web Text))

Max Activating Token Index: 577

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.4518. Min Act: -0.1700

Data Index: 395289 (C4 (Web Text))

Max Activating Token Index: 633

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.4518. Min Act: -0.1700

Data Index: 433424 (C4 (Web Text))

Max Activating Token Index: 322

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3893. Min Act: -0.1700

Data Index: 1007020 (C4 (Web Text))

Max Activating Token Index: 59

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.4518. Min Act: -0.1700

Data Index: 1098321 (C4 (Web Text))

Max Activating Token Index: 515

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3581. Min Act: -0.1700

Data Index: 494030 (C4 (Web Text))

Max Activating Token Index: 64

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3893. Min Act: -0.1700

Data Index: 1149250 (C4 (Web Text))

Max Activating Token Index: 144

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3893. Min Act: -0.1700

Data Index: 649812 (C4 (Web Text))

Max Activating Token Index: 663

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3581. Min Act: -0.1700

Data Index: 733394 (C4 (Web Text))

Max Activating Token Index: 692

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3893. Min Act: -0.1700

Data Index: 809512 (C4 (Web Text))

Max Activating Token Index: 142

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.2956. Min Act: -0.1700

Data Index: 907137 (C4 (Web Text))

Max Activating Token Index: 531

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3268. Min Act: -0.1700

Data Index: 942796 (C4 (Web Text))

Max Activating Token Index: 756

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3581. Min Act: -0.1700

Data Index: 827264 (C4 (Web Text))

Max Activating Token Index: 388

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3268. Min Act: -0.1700

Data Index: 577233 (C4 (Web Text))

Max Activating Token Index: 315

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3581. Min Act: -0.1700

Data Index: 133891 (C4 (Web Text))

Max Activating Token Index: 453

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3581. Min Act: -0.1700

Data Index: 1120346 (C4 (Web Text))

Max Activating Token Index: 462

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3268. Min Act: -0.1700

Data Index: 239925 (C4 (Web Text))

Max Activating Token Index: 301

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3893. Min Act: -0.1700

Data Index: 13483 (C4 (Web Text))

Max Activating Token Index: 483

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 4.4518. Min Range: -4.4518

Max Act: 4.3893. Min Act: -0.1700

Data Index: 752754 (C4 (Web Text))

Max Activating Token Index: 263

Click toggle to see full text

Truncated

Full Text #19