< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2715 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.0615. Min Range: -2.0615

Max Act: 2.0615. Min Act: -0.1700

Data Index: 3760810 (Open Web Text)

Max Activating Token Index: 239

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.9301. Min Act: -0.1700

Data Index: 535437 (Open Web Text)

Max Activating Token Index: 231

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.9215. Min Act: -0.1700

Data Index: 7710636 (Open Web Text)

Max Activating Token Index: 694

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8950. Min Act: -0.1700

Data Index: 6725951 (Open Web Text)

Max Activating Token Index: 241

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.9032. Min Act: -0.1700

Data Index: 8688041 (Open Web Text)

Max Activating Token Index: 348

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8824. Min Act: -0.1700

Data Index: 8759883 (Open Web Text)

Max Activating Token Index: 905

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8789. Min Act: -0.1700

Data Index: 4481779 (Open Web Text)

Max Activating Token Index: 198

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8721. Min Act: -0.1700

Data Index: 6259510 (Open Web Text)

Max Activating Token Index: 215

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8663. Min Act: -0.1700

Data Index: 8214864 (Open Web Text)

Max Activating Token Index: 528

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8708. Min Act: -0.1700

Data Index: 6946315 (Open Web Text)

Max Activating Token Index: 190

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8386. Min Act: -0.1700

Data Index: 3148089 (Open Web Text)

Max Activating Token Index: 6

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8356. Min Act: -0.1700

Data Index: 6284542 (Open Web Text)

Max Activating Token Index: 402

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8225. Min Act: -0.1700

Data Index: 5813279 (Open Web Text)

Max Activating Token Index: 221

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8122. Min Act: -0.1700

Data Index: 883763 (Open Web Text)

Max Activating Token Index: 1009

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8172. Min Act: -0.1700

Data Index: 6699996 (Open Web Text)

Max Activating Token Index: 515

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8173. Min Act: -0.1700

Data Index: 4446553 (Open Web Text)

Max Activating Token Index: 60

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8218. Min Act: -0.1700

Data Index: 2351209 (Open Web Text)

Max Activating Token Index: 79

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8068. Min Act: -0.1700

Data Index: 8516294 (Open Web Text)

Max Activating Token Index: 22

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8241. Min Act: -0.1700

Data Index: 2788366 (Open Web Text)

Max Activating Token Index: 193

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.0615. Min Range: -2.0615

Max Act: 1.8052. Min Act: -0.1700

Data Index: 6708667 (Open Web Text)

Max Activating Token Index: 252

Click toggle to see full text

Truncated

Full Text #19