< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2175 in Layer 7

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-small')

Text #0

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.9502. Min Act: -0.1700

Data Index: 6834801 (Open Web Text)

Max Activating Token Index: 209

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.9278. Min Act: -0.1700

Data Index: 3096891 (Open Web Text)

Max Activating Token Index: 226

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.9366. Min Act: -0.1700

Data Index: 2880554 (Open Web Text)

Max Activating Token Index: 621

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.9460. Min Act: -0.1700

Data Index: 4778895 (Open Web Text)

Max Activating Token Index: 820

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.9394. Min Act: -0.1700

Data Index: 1925382 (Open Web Text)

Max Activating Token Index: 721

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.9269. Min Act: -0.1700

Data Index: 227539 (Open Web Text)

Max Activating Token Index: 312

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.9128. Min Act: -0.1700

Data Index: 742091 (Open Web Text)

Max Activating Token Index: 252

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.9047. Min Act: -0.1700

Data Index: 5146364 (Open Web Text)

Max Activating Token Index: 715

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8990. Min Act: -0.1700

Data Index: 8644906 (Open Web Text)

Max Activating Token Index: 887

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8859. Min Act: -0.1700

Data Index: 3096892 (Open Web Text)

Max Activating Token Index: 834

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8544. Min Act: -0.1700

Data Index: 4745495 (Open Web Text)

Max Activating Token Index: 890

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8604. Min Act: -0.1700

Data Index: 2226223 (Open Web Text)

Max Activating Token Index: 741

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8666. Min Act: -0.1700

Data Index: 5164391 (Open Web Text)

Max Activating Token Index: 280

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8507. Min Act: -0.1700

Data Index: 2112794 (Open Web Text)

Max Activating Token Index: 835

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8359. Min Act: -0.1696

Data Index: 3521910 (Open Web Text)

Max Activating Token Index: 912

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8507. Min Act: -0.1700

Data Index: 4787919 (Open Web Text)

Max Activating Token Index: 434

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8270. Min Act: -0.1700

Data Index: 978088 (Open Web Text)

Max Activating Token Index: 360

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8430. Min Act: -0.1700

Data Index: 3044043 (Open Web Text)

Max Activating Token Index: 818

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8254. Min Act: -0.1700

Data Index: 1386127 (Open Web Text)

Max Activating Token Index: 278

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.9502. Min Range: -2.9502

Max Act: 2.8367. Min Act: -0.1700

Data Index: 5691860 (Open Web Text)

Max Activating Token Index: 690

Click toggle to see full text

Truncated

Full Text #19