< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 418 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3933. Min Act: -0.1700

Data Index: 1080708 (Open Web Text)

Max Activating Token Index: 90

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3648. Min Act: -0.1700

Data Index: 6709212 (Open Web Text)

Max Activating Token Index: 98

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3612. Min Act: -0.1700

Data Index: 3833112 (Open Web Text)

Max Activating Token Index: 609

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3441. Min Act: -0.1700

Data Index: 6057806 (Open Web Text)

Max Activating Token Index: 121

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3352. Min Act: -0.1700

Data Index: 8178679 (Open Web Text)

Max Activating Token Index: 230

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3213. Min Act: -0.1700

Data Index: 5573783 (Open Web Text)

Max Activating Token Index: 717

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3641. Min Act: -0.1700

Data Index: 4665700 (Open Web Text)

Max Activating Token Index: 689

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3299. Min Act: -0.1700

Data Index: 4539303 (Open Web Text)

Max Activating Token Index: 596

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3180. Min Act: -0.1700

Data Index: 2233067 (Open Web Text)

Max Activating Token Index: 574

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3169. Min Act: -0.1700

Data Index: 6217885 (Open Web Text)

Max Activating Token Index: 676

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.2958. Min Act: -0.1700

Data Index: 6416988 (Open Web Text)

Max Activating Token Index: 644

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3194. Min Act: -0.1700

Data Index: 1125682 (Open Web Text)

Max Activating Token Index: 580

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3295. Min Act: -0.1700

Data Index: 4262660 (Open Web Text)

Max Activating Token Index: 397

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.2932. Min Act: -0.1700

Data Index: 6353890 (Open Web Text)

Max Activating Token Index: 332

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.2768. Min Act: -0.1700

Data Index: 5841436 (Open Web Text)

Max Activating Token Index: 288

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.3093. Min Act: -0.1700

Data Index: 8026158 (Open Web Text)

Max Activating Token Index: 490

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.2841. Min Act: -0.1700

Data Index: 2440746 (Open Web Text)

Max Activating Token Index: 448

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.2766. Min Act: -0.1700

Data Index: 5762227 (Open Web Text)

Max Activating Token Index: 440

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.2617. Min Act: -0.1700

Data Index: 1799777 (Open Web Text)

Max Activating Token Index: 647

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.3933. Min Range: -2.3933

Max Act: 2.2621. Min Act: -0.1700

Data Index: 8635808 (Open Web Text)

Max Activating Token Index: 504

Click toggle to see full text

Truncated

Full Text #19