< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2698 in Layer 7

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-small')

Text #0

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.3241. Min Act: -0.1700

Data Index: 368379 (Open Web Text)

Max Activating Token Index: 663

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.2723. Min Act: -0.1700

Data Index: 3261000 (Open Web Text)

Max Activating Token Index: 654

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.2556. Min Act: -0.1700

Data Index: 1447727 (Open Web Text)

Max Activating Token Index: 654

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.2656. Min Act: -0.1700

Data Index: 7844548 (Open Web Text)

Max Activating Token Index: 858

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.2193. Min Act: -0.1700

Data Index: 892271 (Open Web Text)

Max Activating Token Index: 572

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.1098. Min Act: -0.1700

Data Index: 6633884 (Open Web Text)

Max Activating Token Index: 625

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.1022. Min Act: -0.1700

Data Index: 6123907 (Open Web Text)

Max Activating Token Index: 546

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0952. Min Act: -0.1700

Data Index: 4870179 (Open Web Text)

Max Activating Token Index: 28

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0932. Min Act: -0.1700

Data Index: 3227930 (Open Web Text)

Max Activating Token Index: 241

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0965. Min Act: -0.1700

Data Index: 7304689 (Open Web Text)

Max Activating Token Index: 424

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0536. Min Act: -0.1700

Data Index: 5654193 (Open Web Text)

Max Activating Token Index: 828

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0724. Min Act: -0.1700

Data Index: 2173632 (Open Web Text)

Max Activating Token Index: 395

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0786. Min Act: -0.1700

Data Index: 5615742 (Open Web Text)

Max Activating Token Index: 777

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0748. Min Act: -0.1700

Data Index: 272277 (Open Web Text)

Max Activating Token Index: 513

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0542. Min Act: -0.1700

Data Index: 379099 (Open Web Text)

Max Activating Token Index: 538

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0515. Min Act: -0.1700

Data Index: 4071928 (Open Web Text)

Max Activating Token Index: 805

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0815. Min Act: -0.1700

Data Index: 471301 (Open Web Text)

Max Activating Token Index: 632

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0783. Min Act: -0.1700

Data Index: 6530525 (Open Web Text)

Max Activating Token Index: 756

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0632. Min Act: -0.1700

Data Index: 3868928 (Open Web Text)

Max Activating Token Index: 308

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 4.3241. Min Range: -4.3241

Max Act: 4.0484. Min Act: -0.1700

Data Index: 2474035 (Open Web Text)

Max Activating Token Index: 572

Click toggle to see full text

Truncated

Full Text #19