< Prev | Home | Model | Random | Next >

Model: GPT-2 Medium: 24 Layers, 4096 Neurons per Layer

Dataset: Open Web Text

Neuron 4 in Layer 3

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-medium')

Text #0

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.6449. Min Act: -0.1700

Data Index: 1477632 (Open Web Text)

Max Activating Token Index: 62

Click toggle to see full text

Truncated

^/T-'(ZV]8#:G?Y2_`J\?PVRDP998I9 M^1>H:LN;(02J]YF7!RLD.7;=,/FQ*+M^\:DMO

Full Text #0

<|endoftext|>[7:&7:P8VEY+^/T-'(ZV]8#:G?Y2_`J\?PVRDP998I9 M^1>H:LN;(02J]YF7!RLD.7;=,/FQ*+M^\:DMOY]W./*;A9?+L:W7*[]M3'X] MOZ=<__0VDM^VZY#??WU*G&JWD?S>@^YM^=*G"OG]13N$O/2I2G[4="RQ[5@H M%.I>6;IW!ZY`++8(TY%7TY'%%["+MA8NKG2U?L?D!;+8Q&1R)AZ8W\H$]2P1 M+/Z<ARQL6>GZ&N`OWT[!EY_DKP.=_S2X]<P[;2#M+]NOK(7!'229RWT0=1!K MMY"$!#((1-YT^?[V$TB'(TE\"EEGGH1\S//(.C'@,"8U9)W=0H*P0`Z#XY#E MD+7P&^((+T./"M*!<*Q6<Q#U('(Y"@\'6#WZ!JM'V^1ZY,ANU2I7X`C+1F0E MQ+FNAU&JYT"J*UW)3YS'$.6Q[9,=F-"'_AM'/?,==M+>NVT3%DG;O^U@&BA$ M65WI^N!C6S`@CKA(\,]4Q`1ZA8.,\UBP*UU_R[\74&@A5@42S[-"?YW5J>3M MC+JPTO4T1UO+W[J5J<+O/-D=C`!Z?A=DYB!5D8XA2-ARQ_^NK*`RA;0,!EJ; M+Y<OQQ#;;V/O9]@[$;OS4QD;O+S53OOEKV0A898%6M4XC\/5Y?=N(8D.HD0A M:!!*<@[KN:P?L"`+:Q4DE<KRW]W"U#XD;Q"3U[H+GS!34$G/=?P:\KQ\SVU< M)5S^)J3])Q\[)?6#C_`14X@E04K)KA")\[NP6X#``UA_GZ'>8:5KZB/*;`$R M6PBT>)UM6WX*=07/"ETI?W^'&3N,%1!IG.KEMF)L/VM628LC!FU$2D*`2.>H M0F#"@ZA:0DP[+&Q9/L_*-$[U"\JIB=4BN-+U^(=RI3K(OUNV/MPB52EK^<JM MK$I9*UW]'#O(*V@.OF>I7-TB_W`3I9BU.][W7@B(WZP+@UO$[PO8P`^+ZN]2 MYQ:IN5_J-*T7WS6L.UX"K?V2]>)OC,Z0!.@TWK'NN-BYZS^7\.FC-ZQ[Z,M? M'ECJ#+N4B_!96K*>N0B?M^$#WY]Y'3[OP&<9*!?A\SI\WE[JW/4KY+24PI>I MSETO+G7NO`(?0.R\"!]`[034/?#^GE?A\P9\?@7<7T;Y+8U;"^]#EJYT;LI] M:"VD/WY5>G-T(?VA^";MPZ0YQNH,+.*_BTNZ\2CK;#V#3"%HY0/4HV<^*:47 MWK86_C

Text #1

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.4574. Min Act: -0.1700

Data Index: 1477593 (Open Web Text)

Max Activating Token Index: 58

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.4574. Min Act: -0.1700

Data Index: 1160929 (Open Web Text)

Max Activating Token Index: 47

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.3636. Min Act: -0.1700

Data Index: 1477634 (Open Web Text)

Max Activating Token Index: 391

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.3324. Min Act: -0.1700

Data Index: 2787125 (Open Web Text)

Max Activating Token Index: 597

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.3949. Min Act: -0.1700

Data Index: 1477626 (Open Web Text)

Max Activating Token Index: 705

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.3011. Min Act: -0.1700

Data Index: 1477588 (Open Web Text)

Max Activating Token Index: 590

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.3324. Min Act: -0.1700

Data Index: 6140834 (Open Web Text)

Max Activating Token Index: 808

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.2074. Min Act: -0.1700

Data Index: 1477617 (Open Web Text)

Max Activating Token Index: 623

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.1449. Min Act: -0.1700

Data Index: 5709355 (Open Web Text)

Max Activating Token Index: 761

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.2386. Min Act: -0.1700

Data Index: 2787140 (Open Web Text)

Max Activating Token Index: 433

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.2074. Min Act: -0.1700

Data Index: 4479089 (Open Web Text)

Max Activating Token Index: 621

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.1761. Min Act: -0.1700

Data Index: 2587019 (Open Web Text)

Max Activating Token Index: 253

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.1136. Min Act: -0.1700

Data Index: 4479117 (Open Web Text)

Max Activating Token Index: 930

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.0824. Min Act: -0.1700

Data Index: 1477615 (Open Web Text)

Max Activating Token Index: 538

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.0511. Min Act: -0.1700

Data Index: 2787123 (Open Web Text)

Max Activating Token Index: 806

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.0198. Min Act: -0.1700

Data Index: 5709358 (Open Web Text)

Max Activating Token Index: 825

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.0198. Min Act: -0.1700

Data Index: 3099669 (Open Web Text)

Max Activating Token Index: 956

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.0824. Min Act: -0.1700

Data Index: 2787121 (Open Web Text)

Max Activating Token Index: 603

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 4.6449. Min Range: -4.6449

Max Act: 4.0511. Min Act: -0.1691

Data Index: 4124516 (Open Web Text)

Max Activating Token Index: 14

Click toggle to see full text

Truncated

Full Text #19