< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2935 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.2258. Min Act: -0.1700

Data Index: 6561316 (Open Web Text)

Max Activating Token Index: 591

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.2114. Min Act: -0.1700

Data Index: 4968599 (Open Web Text)

Max Activating Token Index: 217

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1788. Min Act: -0.1700

Data Index: 8513045 (Open Web Text)

Max Activating Token Index: 282

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1864. Min Act: -0.1700

Data Index: 1987058 (Open Web Text)

Max Activating Token Index: 642

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1644. Min Act: -0.1700

Data Index: 5713200 (Open Web Text)

Max Activating Token Index: 988

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1410. Min Act: -0.1700

Data Index: 1967686 (Open Web Text)

Max Activating Token Index: 45

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1558. Min Act: -0.1700

Data Index: 3547198 (Open Web Text)

Max Activating Token Index: 1022

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1579. Min Act: -0.1700

Data Index: 3364485 (Open Web Text)

Max Activating Token Index: 1006

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1385. Min Act: -0.1700

Data Index: 5095891 (Open Web Text)

Max Activating Token Index: 959

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1517. Min Act: -0.1700

Data Index: 8127428 (Open Web Text)

Max Activating Token Index: 991

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1346. Min Act: -0.1700

Data Index: 5898317 (Open Web Text)

Max Activating Token Index: 818

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1220. Min Act: -0.1700

Data Index: 2811860 (Open Web Text)

Max Activating Token Index: 904

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1272. Min Act: -0.1700

Data Index: 1510269 (Open Web Text)

Max Activating Token Index: 646

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1056. Min Act: -0.1700

Data Index: 7719585 (Open Web Text)

Max Activating Token Index: 351

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1243. Min Act: -0.1700

Data Index: 1163265 (Open Web Text)

Max Activating Token Index: 606

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1150. Min Act: -0.1700

Data Index: 7150615 (Open Web Text)

Max Activating Token Index: 9

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1082. Min Act: -0.1700

Data Index: 370279 (Open Web Text)

Max Activating Token Index: 716

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1243. Min Act: -0.1700

Data Index: 8146831 (Open Web Text)

Max Activating Token Index: 30

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1106. Min Act: -0.1700

Data Index: 3039400 (Open Web Text)

Max Activating Token Index: 485

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.2258. Min Range: -2.2258

Max Act: 2.1118. Min Act: -0.1700

Data Index: 6867596 (Open Web Text)

Max Activating Token Index: 84

Click toggle to see full text

Truncated

Full Text #19