< Prev | Home | Model | Random | Next >

Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 5071 in Layer 33

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')



Text #0

Max Range: 5.1432. Min Range: -5.1432

Max Act: 5.1432. Min Act: -0.1700

Data Index: 7638389 (Open Web Text)

Max Activating Token Index: 798

Click toggle to see full text

Truncated

 System [Houndstooth] 
 
Spectral Voice: Eroded Corridors of Unbeing [Dark Descent] 
 
Stars: There Is No Love in Fluorescent Light [Last Gang] 
 
St. Vincent: MASSEDUCTION [Loma Vista] 
 

Full Text #0

<|endoftext|>atives in Descent [Domino] 
 
Shania Twain: Now [Mercury Nashville] 
 
TORRES: Three Futures [4AD] 
 
Wolf Alice: Visions of a Life [RCA] 
 
The World is a Beautiful Place & I Am No Longer Afraid to Die: Always Foreign [Epitaph] 
 
10-06 
 
ABRA: Rose [Ninja Tune] 
 
Alex Lahey: I Love You Like a Brother [Dead Oceans] 
 
Andrew Hung: Realisationship [Lex] 
 
Antwon: Sunnyvale Gardens [self-release] 
 
Blue Hawaii: Tenderness [Arbutus] 
 
Brooklyn Raga Massive: Terry Riley in C [Northern Spy] 
 
Cid Rim: The Material [LuckyMe] 
 
Citizen: As You Please [Run for Cover] 
 
Cults: Offering [Sinderlyn] 
 
Deradoorian: Eternal Recurrence [Anticon] 
 
D.K. / S.K.: D.K. / S.K. [Melody as Truth] 
 
Ducktails: Jersey Devil [New Images] 
 
Kaitlyn Aurelia Smith: The Kid [Western Vinyl] 
 
Kelela: Take Me Apart [Warp] 
 
Kele Okereke: Fatherland [BMG] 
 
Kiasmos: Blurred EP [Erased Tapes] 
 
Liam Gallagher: As You Were [Warner Bros.] 
 
Mister Heavenly: Boxing the Moonlight [Polyvinyl] 
 
NHK yx Koyxen: Exit Entrance [DFA] 
 
ORB: Naturality [Castle Face] 
 
The Replacements: For Sale: Live at Maxwell's 1986 [Rhino] 
 
Richard Horowitz: Eros in Arabia [Freedom to Spend] [reissue] 
 
Sam Evian: Need You [Saddle Creek] 
 
Seamus Fogarty: The Curious Hand [Domino] 
 
Slow Magic: Float [Downtown] 
 
Tokimonsta: Lune Rouge [Young Arts] 
 
UUUU: UUUU [Editions Mego] 
 
The Weather Station: The Weather Station [Paradise of Bachelors] 
 
Wolf Parade: Cry Cry Cry [Sub Pop] 
 
Yumi Zouma: Willowbank [Cascine] 
 
Ziúr: U Feel Anything [Planet Mu/Objects Limited] 
 
10-13 
 
A. Savage: Thawing Dawn [Dull Tools] 
 
Beck: Colors [Capitol] 
 
Enslaved: E [Nuclear Blast] 
 
Exhumed: Death Revenge [Relapse] 
 
The Front Bottoms: Going Grey [Fueled by Ramen] 
 
King Khan: Murderburgers [Ernest Jenning Record Co.] 
 
Kurt Vile / Courtney Barnett: Lotta Sea Lice [Matador] 
 
Larry Conklin & Jochen Blum: Jackdaw [Tompkins Square] [reissue] 
 
Lawrence Rothman: The Book of Law [Downtown/Interscope] 
 
LUCIANBLOMKAMP: Sick of What I Don't Understand Part 1 [Different] 
 
Melkbelly: Nothing Valley [Wax Nine] 
 
Patrick Cowley: Afternooners [Dark Entries/Honey Soundsystem] [reissue] [compilation] 
 
Special Request: Belief System [Houndstooth] 
 
Spectral Voice: Eroded Corridors of Unbeing [Dark Descent] 
 
Stars: There Is No Love in Fluorescent Light [Last Gang] 
 
St. Vincent: MASSEDUCTION [Loma Vista] 
 
Tusks: Dissolve [One Little Indian] 
 
Various Artists: Even A Tree Can Shed Tears: Japanese Folk & Rock 1969-1973 [Light in the Attic] [reissue] [compilation] 
 
William Patrick Corgan: Ogilala [BMG] 
 
RZA Presents: Wu-Tang: The Saga Continues [Entertainment One] 
 
10-20 
 
Bell Witch: Mirror Reaper [Profound Lore] 
 
Bill MacKay & Ryley Walker: SpiderBeetleBee [Drag City] 
 
Bully: Losing [Sub Pop] 
 
Carlos Niño & Friends: Going Home [Leaving] 
 
Circut des Yeux: Reaching for Indigo [Drag City] 
 
Colleen: A flame my love, a frequency [Thrill Jockey] 
 
Country Florist: Waveland [Drawing Room Records] 
 
Destroyer: ken [Merge] 
 
Earthly: Heart [Bounce Pass] 
 
Emptyset

Text #1

Max Range: 5.1432. Min Range: -5.1432

Max Act: 5.1119. Min Act: -0.1700

Data Index: 1357877 (Open Web Text)

Max Activating Token Index: 726

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 5.1432. Min Range: -5.1432

Max Act: 5.0494. Min Act: -0.1700

Data Index: 1624814 (Open Web Text)

Max Activating Token Index: 443

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 5.1432. Min Range: -5.1432

Max Act: 5.0182. Min Act: -0.1700

Data Index: 8738009 (Open Web Text)

Max Activating Token Index: 127

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 5.1432. Min Range: -5.1432

Max Act: 5.0494. Min Act: -0.1700

Data Index: 2841307 (Open Web Text)

Max Activating Token Index: 346

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.9869. Min Act: -0.1700

Data Index: 1865341 (Open Web Text)

Max Activating Token Index: 476

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.9869. Min Act: -0.1700

Data Index: 7638385 (Open Web Text)

Max Activating Token Index: 337

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.9557. Min Act: -0.1700

Data Index: 5775349 (Open Web Text)

Max Activating Token Index: 177

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.9244. Min Act: -0.1700

Data Index: 2352667 (Open Web Text)

Max Activating Token Index: 822

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.8619. Min Act: -0.1700

Data Index: 1793755 (Open Web Text)

Max Activating Token Index: 845

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.8619. Min Act: -0.1700

Data Index: 2352670 (Open Web Text)

Max Activating Token Index: 939

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.8307. Min Act: -0.1700

Data Index: 8803445 (Open Web Text)

Max Activating Token Index: 846

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.7994. Min Act: -0.1700

Data Index: 6146516 (Open Web Text)

Max Activating Token Index: 902

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.7994. Min Act: -0.1700

Data Index: 7634452 (Open Web Text)

Max Activating Token Index: 753

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.8307. Min Act: -0.1700

Data Index: 866330 (Open Web Text)

Max Activating Token Index: 791

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.7994. Min Act: -0.1700

Data Index: 5864096 (Open Web Text)

Max Activating Token Index: 615

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.7682. Min Act: -0.1700

Data Index: 5388311 (Open Web Text)

Max Activating Token Index: 545

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.7994. Min Act: -0.1700

Data Index: 673332 (Open Web Text)

Max Activating Token Index: 987

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.7682. Min Act: -0.1700

Data Index: 7634454 (Open Web Text)

Max Activating Token Index: 904

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 5.1432. Min Range: -5.1432

Max Act: 4.7682. Min Act: -0.1700

Data Index: 2520432 (Open Web Text)

Max Activating Token Index: 993

Click toggle to see full text

Truncated

Full Text #19