< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1501 in Layer 7

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-small')

Text #0

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.8292. Min Act: -0.1700

Data Index: 5206375 (Open Web Text)

Max Activating Token Index: 872

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.8257. Min Act: -0.1700

Data Index: 406997 (Open Web Text)

Max Activating Token Index: 567

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.8013. Min Act: -0.1700

Data Index: 5951422 (Open Web Text)

Max Activating Token Index: 992

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7766. Min Act: -0.1700

Data Index: 1580103 (Open Web Text)

Max Activating Token Index: 709

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7804. Min Act: -0.1700

Data Index: 7559262 (Open Web Text)

Max Activating Token Index: 65

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7529. Min Act: -0.1700

Data Index: 4117834 (Open Web Text)

Max Activating Token Index: 733

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7578. Min Act: -0.1700

Data Index: 494074 (Open Web Text)

Max Activating Token Index: 644

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7292. Min Act: -0.1700

Data Index: 8488673 (Open Web Text)

Max Activating Token Index: 310

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7379. Min Act: -0.1700

Data Index: 1646823 (Open Web Text)

Max Activating Token Index: 670

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7543. Min Act: -0.1700

Data Index: 5643244 (Open Web Text)

Max Activating Token Index: 431

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7208. Min Act: -0.1700

Data Index: 1344291 (Open Web Text)

Max Activating Token Index: 383

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7189. Min Act: -0.1700

Data Index: 2034733 (Open Web Text)

Max Activating Token Index: 230

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7322. Min Act: -0.1700

Data Index: 5022992 (Open Web Text)

Max Activating Token Index: 969

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7094. Min Act: -0.1700

Data Index: 527684 (Open Web Text)

Max Activating Token Index: 414

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7038. Min Act: -0.1700

Data Index: 7354934 (Open Web Text)

Max Activating Token Index: 471

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.7166. Min Act: -0.1700

Data Index: 4717712 (Open Web Text)

Max Activating Token Index: 822

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.6830. Min Act: -0.1700

Data Index: 4962341 (Open Web Text)

Max Activating Token Index: 634

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.6876. Min Act: -0.1700

Data Index: 6763960 (Open Web Text)

Max Activating Token Index: 154

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.6730. Min Act: -0.1700

Data Index: 2143882 (Open Web Text)

Max Activating Token Index: 659

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.8292. Min Range: -2.8292

Max Act: 2.6796. Min Act: -0.1700

Data Index: 248667 (Open Web Text)

Max Activating Token Index: 323

Click toggle to see full text

Truncated

Full Text #19