< First Neuron | Home | Random | Final Neuron >

Model Index Page: SoLU Model: 10 Layers, 5120 Neurons per Layer

Dataset: 80% C4 (Web Text) and 20% Python Code

Hooked Transformer Loading: solu-10l

Layers:

Layer #0 First Random Last
Layer #1 First Random Last
Layer #2 First Random Last
Layer #3 First Random Last
Layer #4 First Random Last
Layer #5 First Random Last
Layer #6 First Random Last
Layer #7 First Random Last
Layer #8 First Random Last
Layer #9 First Random Last