< Prev | Home | Model | Random | Next >

Model: SoLU Model: 6 Layers, 3072 Neurons per Layer

Dataset: The Pile

Neuron 2 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('solu-6l-pile')



Text #0

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.3208. Min Act: -0.0002

Data Index: 509596 (The Pile)

Max Activating Token Index: 571

Click toggle to see full text

Truncated

 F. Maltoni, E. Vryonidou and C. Zhang, JHEP [**1610**]{}, 123 (2016) \[arXiv:1607.05330 \[hep-ph\]\]. 
 
E. Izaguirre, G. Krnjaic

Full Text #0

<|endoftext|> Papadopoulos and R. Pittau, JHEP [**0803**]{}, 042 (2008) \[arXiv:0711.3596 \[hep-ph\]\]. T. Sjostrand, S. Mrenna and P. Z. Skands, Comput. Phys. Commun.  [**178**]{}, 852 (2008) \[arXiv:0710.3820 \[hep-ph\]\]. J. de Favereau [*et al.*]{} \[DELPHES 3 Collaboration\], JHEP [**1402**]{}, 057 (2014) \[arXiv:1307.6346 \[hep-ex\]\]. R. D. Ball [*et al.*]{} \[NNPDF Collaboration\], JHEP [**1504**]{}, 040 (2015) \[arXiv:1410.8849 \[hep-ph\]\]. J. Alwall [*et al.*]{}, Eur. Phys. J. C [**53**]{}, 473 (2008) \[arXiv:0706.2569 \[hep-ph\]\]. J. Alwall, S. de Visscher and F. Maltoni, JHEP 02, 2009", \[hep-ph/0810.5350\]. 
 
The ATLAS collaboration, ATLAS-CONF-2017-060. 
 
T. Ahmed, M. C. Kumar, P. Mathews, N. Rana and V. Ravindran, Eur. Phys. J. C [**76**]{}, no. 6, 355 (2016) \[arXiv:1510.02235 \[hep-ph\]\]. 
 
L. M. Carpenter, A. Nelson, C. Shimmin, T. M. P. Tait and D. Whiteson, Phys. Rev. D [**87**]{}, no. 7, 074005 (2013) \[arXiv:1212.3352 \[hep-ex\]\]. CMS Collaboration, CMS-PAS-EXO-16-038, <https://cds.cern.ch/record/2205763>. 
 
A. M. Sirunyan [*et al.*]{} \[CMS Collaboration\], arXiv:1706.02581 \[hep-ex\]. R. V. Harlander and W. B. Kilgore, Phys. Rev. Lett.  [**88**]{}, 201801 (2002) \[hep-ph/0201206\]. F. Maltoni, E. Vryonidou and C. Zhang, JHEP [**1610**]{}, 123 (2016) \[arXiv:1607.05330 \[hep-ph\]\]. 
 
E. Izaguirre, G. Krnjaic and B. Shuve, Phys. Rev. D [**90**]{}, no. 5, 055002 (2014) \[arXiv:1404.2018 \[hep-ph\]\]. P. Pani and G. Polesello, arXiv:1712.03874 \[hep-ph\]. J. F. Gunion, H. E. Haber, G. L. Kane and S. Dawson, Front. Phys.  [**80**]{}, 1 (2000). 
 
[^1]: A new spin-0 singlet with pseudoscalar couplings to Dark Matter can mix with the SM Higgs, which will lead to spin-0 mass eigenstates which are not CP eigenstates. Such a scenario does not require new states beyond the mediator and dark matter, but is strongly constrained by Higgs coupling measurements [@Baek:2017vzd]. 
 
[^2]: For simplified models in which the Higgs mixes with scalar mediators that couple to dark matter, measurements of Higgs couplings provide a stronger bound on the mixing angle than any mono-X search [@Bell:2016ekl]. 
 
[^3]: The contribution from the exchange of the heavy scalar $H$ to the Dark Matter-nucleus cross section is weaker by a factor $M_h^4/M_H^4$ and further suppressed by $g_{H_\chi}$, which vanishes at $\tan\beta=1$ and $\cos(\beta-\alpha)=0$. 
<|endoftext|>Heres one way to bolster a business, and pick up some talented staffers in a tight hiring market. 
 
Seattle supercomputer maker Cray announced Thursday that it has hired the majority of employees from Austin, Texas-based SystemFabricWorks, a company thats described as a leader in “storage interconnect solutions and software.” 
 
Joining Cray as part of the deal are former SystemFabricWorks CEO Bob Pearson; former vice president of business development Bill Boas; and a number of engineers who will add expertise to Crays Lustre-based storage solutions. 
 
Interestingly, even with the defections, SystemFabric

Text #1

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.3099. Min Act: -0.0002

Data Index: 318540 (The Pile)

Max Activating Token Index: 876

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.3035. Min Act: -0.0002

Data Index: 1107466 (The Pile)

Max Activating Token Index: 98

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2805. Min Act: -0.0002

Data Index: 896544 (The Pile)

Max Activating Token Index: 744

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2891. Min Act: -0.0002

Data Index: 1963811 (The Pile)

Max Activating Token Index: 449

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2750. Min Act: -0.0002

Data Index: 1917190 (The Pile)

Max Activating Token Index: 104

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2561. Min Act: -0.0002

Data Index: 1221333 (The Pile)

Max Activating Token Index: 986

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2640. Min Act: -0.0002

Data Index: 1067220 (The Pile)

Max Activating Token Index: 234

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2661. Min Act: -0.0002

Data Index: 607755 (The Pile)

Max Activating Token Index: 927

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2587. Min Act: -0.0002

Data Index: 1320532 (The Pile)

Max Activating Token Index: 780

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2567. Min Act: -0.0002

Data Index: 1191277 (The Pile)

Max Activating Token Index: 606

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2629. Min Act: -0.0002

Data Index: 1008983 (The Pile)

Max Activating Token Index: 36

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2601. Min Act: -0.0002

Data Index: 1652838 (The Pile)

Max Activating Token Index: 1005

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2541. Min Act: -0.0002

Data Index: 619444 (The Pile)

Max Activating Token Index: 261

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2579. Min Act: -0.0002

Data Index: 77951 (The Pile)

Max Activating Token Index: 448

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2517. Min Act: -0.0002

Data Index: 461352 (The Pile)

Max Activating Token Index: 396

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2551. Min Act: -0.0002

Data Index: 1737359 (The Pile)

Max Activating Token Index: 564

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2497. Min Act: -0.0002

Data Index: 1706664 (The Pile)

Max Activating Token Index: 794

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2476. Min Act: -0.0002

Data Index: 1787086 (The Pile)

Max Activating Token Index: 83

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 0.3208. Min Range: -0.3208

Max Act: 0.2500. Min Act: -0.0002

Data Index: 516957 (The Pile)

Max Activating Token Index: 576

Click toggle to see full text

Truncated

Full Text #19