< First Neuron | Home | Random | Final Neuron >

Model Index Page: SoLU Model: 12 Layers, 6144 Neurons per Layer

Dataset: 80% C4 (Web Text) and 20% Python Code

Hooked Transformer Loading: solu-12l

Layers:

Layer #0	First	Random	Last
Layer #1	First	Random	Last
Layer #2	First	Random	Last
Layer #3	First	Random	Last
Layer #4	First	Random	Last
Layer #5	First	Random	Last
Layer #6	First	Random	Last
Layer #7	First	Random	Last
Layer #8	First	Random	Last
Layer #9	First	Random	Last
Layer #10	First	Random	Last
Layer #11	First	Random	Last