< Prev | Home | Model | Random | Next >

Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 6396 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')



Text #0

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.4560. Min Act: -0.1700

Data Index: 4886389 (Open Web Text)

Max Activating Token Index: 448

Click toggle to see full text

Truncated

 Paper (corrected version, May 1999). 
 
http://web.archive.org/web/20000823133119/www.ascom.ch/infosec/downloads/sidechannel.pdf 
 
] Ascom Systec, Ltd. "Side Channel Attack

Full Text #0

<|endoftext|>, Bruce Schneier, David Wagner, "Key-Schedule Cryptanalysis of 3-WAY, IDEA, G-DES, RC4, SAFER, and Triple-DES". http://www.counterpane.com/key_schedule.html [ An ] Phillip Hawkes, 
 
"Differential-Linear Weak Key Classes of IDEA," 
 
Advances in Cryptology - EUROCRYPT '98 Proceedings , pp. 112-126, Springer-Verlag, 1998. 
 
] Phillip Hawkes, "Differential-Linear Weak Key Classes of IDEA," , pp. 112-126, Springer-Verlag, 1998. [ An ] E. Biham, A. Biruykov, A. Shamir, 
 
"Miss in the middle attacks on IDEA, Khufu and Khafre," 
 
Presented at Fast Software Encryption '99 , Rome. 
 
] E. Biham, A. Biruykov, A. Shamir, "Miss in the middle attacks on IDEA, Khufu and Khafre," Presented at , Rome. [ An ] John Kelsey, Bruce Schneier, David Wagner, Chris Hall, 
 
"Side Channel Cryptanalysis of Product Ciphers", 
 
ESORICS '98 Proceedings pp. 97-110, Springer-Verlag, September 1998. 
 
http://www.counterpane.com/side_channel.html 
 
] John Kelsey, Bruce Schneier, David Wagner, Chris Hall, "Side Channel Cryptanalysis of Product Ciphers", pp. 97-110, Springer-Verlag, September 1998. http://www.counterpane.com/side_channel.html [ Inf, An ] Ascom Systec, Ltd. 
 
"Side Channel Attack Hardening of the IDEA TM Cipher," 
 
Ascom Systec White Paper (corrected version, May 1999). 
 
http://web.archive.org/web/20000823133119/www.ascom.ch/infosec/downloads/sidechannel.pdf 
 
] Ascom Systec, Ltd. "Side Channel Attack Hardening of the IDEA Cipher," (corrected version, May 1999). http://web.archive.org/web/20000823133119/www.ascom.ch/infosec/downloads/sidechannel.pdf [ An ] Jorge Nakahara Jr., Paulo Barreto, Bart Preneel, Joos Vandewalle, Hae Y. Kim, 
 
"SQUARE Attacks on Reduced-Round PES and IDEA Block Ciphers," 
 
NESSIE Project phase 2 public report, 19 November 2001. 
 
https://www.cosic.esat.kuleuven.ac.be/nessie/reports/phase2/nessie-idea.pdf 
 
] Jorge Nakahara Jr., Paulo Barreto, Bart Preneel, Joos Vandewalle, Hae Y. Kim, "SQUARE Attacks on Reduced-Round PES and IDEA Block Ciphers," NESSIE Project phase 2 public report, 19 November 2001. https://www.cosic.esat.kuleuven.ac.be/nessie/reports/phase2/nessie-idea.pdf [ An ] Alex Biryukov, Jorge Nakahara Jr., Bart Preneel, Joos Vandewalle, 
 
"New Weak Key Classes of IDEA," 
 
NESSIE Project phase 2 public report, 29 June 2002. 
 
https://www.cosic.esat.kuleuven.ac.be/nessie/reports/phase2/keyidea5.pdf 
 
] Alex Biryukov, Jorge Nakahara Jr., Bart Preneel, Joos Vandewalle, "New Weak Key Classes of IDEA," NESSIE Project phase 2 public report, 29 June 2002. https://www.cosic.esat.kuleuven.ac.be/nessie/reports/phase2/keyidea5.pdf [ Patent ] James Massey, Xuejia Lai, 
 
"Device for Converting a Digital Block and the Use Thereof", 
 
International Patent WO09118459A2, filed May 16 1991, issued November 28 1991. 
 
] James Massey, Xuejia Lai, "Device for Converting a Digital Block and the Use Thereof", International Patent WO09118459A2, filed May 16 1991, issued November 28 1991. [ Patent ] James Massey, Xuejia Lai, 
 
"Device for Converting a Digital Block and the Use Thereof," 
 
European Patent EP00482154A1, filed May 16 1991, issued April 29 1992.

Text #1

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.4247. Min Act: -0.1700

Data Index: 417370 (Open Web Text)

Max Activating Token Index: 55

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.3149. Min Act: -0.1700

Data Index: 4362940 (Open Web Text)

Max Activating Token Index: 64

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.2992. Min Act: -0.1700

Data Index: 4463847 (Open Web Text)

Max Activating Token Index: 211

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.2835. Min Act: -0.1700

Data Index: 8210196 (Open Web Text)

Max Activating Token Index: 30

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.2678. Min Act: -0.1700

Data Index: 2281914 (Open Web Text)

Max Activating Token Index: 70

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.2678. Min Act: -0.1700

Data Index: 3408518 (Open Web Text)

Max Activating Token Index: 682

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.2678. Min Act: -0.1700

Data Index: 3416280 (Open Web Text)

Max Activating Token Index: 840

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.2521. Min Act: -0.1700

Data Index: 7848754 (Open Web Text)

Max Activating Token Index: 220

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.2364. Min Act: -0.1700

Data Index: 1253536 (Open Web Text)

Max Activating Token Index: 514

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.2050. Min Act: -0.1700

Data Index: 2178929 (Open Web Text)

Max Activating Token Index: 870

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.2050. Min Act: -0.1700

Data Index: 2020974 (Open Web Text)

Max Activating Token Index: 22

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.1892. Min Act: -0.1700

Data Index: 5300636 (Open Web Text)

Max Activating Token Index: 227

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.1578. Min Act: -0.1700

Data Index: 7858237 (Open Web Text)

Max Activating Token Index: 320

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.1892. Min Act: -0.1700

Data Index: 44916 (Open Web Text)

Max Activating Token Index: 769

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.1892. Min Act: -0.1700

Data Index: 1762590 (Open Web Text)

Max Activating Token Index: 927

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.1578. Min Act: -0.1700

Data Index: 2019015 (Open Web Text)

Max Activating Token Index: 255

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.1735. Min Act: -0.1700

Data Index: 4961054 (Open Web Text)

Max Activating Token Index: 495

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.1578. Min Act: -0.1700

Data Index: 2242664 (Open Web Text)

Max Activating Token Index: 314

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 3.4560. Min Range: -3.4560

Max Act: 3.1578. Min Act: -0.1700

Data Index: 3416268 (Open Web Text)

Max Activating Token Index: 450

Click toggle to see full text

Truncated

Full Text #19