Model: None

Dataset: The Pile

Neuron 2472 in Layer 3

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('pythia-350m')

Text #0

Max Range: 4.1109. Min Range: -4.1109

Max Act: 4.1109. Min Act: -0.1700

Data Index: 364077 (The Pile)

Max Activating Token Index: 877

Text #1

Max Range: 4.1109. Min Range: -4.1109

Max Act: 4.0796. Min Act: -0.1700

Data Index: 4806578 (The Pile)

Max Activating Token Index: 554

Text #2

Max Range: 4.1109. Min Range: -4.1109

Max Act: 4.0796. Min Act: -0.1700

Data Index: 7650817 (The Pile)

Max Activating Token Index: 616

Text #3

Max Range: 4.1109. Min Range: -4.1109

Max Act: 4.0796. Min Act: -0.1700

Data Index: 2055168 (The Pile)

Max Activating Token Index: 964

Text #4

Max Range: 4.1109. Min Range: -4.1109

Max Act: 4.0171. Min Act: -0.1700

Data Index: 1093919 (The Pile)

Max Activating Token Index: 314

Text #5

Max Range: 4.1109. Min Range: -4.1109

Max Act: 4.0171. Min Act: -0.1700

Data Index: 8518058 (The Pile)

Max Activating Token Index: 836

Text #6

Max Range: 4.1109. Min Range: -4.1109

Max Act: 4.0171. Min Act: -0.1700

Data Index: 10207777 (The Pile)

Max Activating Token Index: 461

Text #7

Max Range: 4.1109. Min Range: -4.1109

Max Act: 4.0171. Min Act: -0.1700

Data Index: 9216989 (The Pile)

Max Activating Token Index: 688

Text #8

Max Range: 4.1109. Min Range: -4.1109

Max Act: 4.0171. Min Act: -0.1700

Data Index: 1525641 (The Pile)

Max Activating Token Index: 531

Text #9

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9858. Min Act: -0.1700

Data Index: 4941800 (The Pile)

Max Activating Token Index: 518

Text #10

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9858. Min Act: -0.1700

Data Index: 2025898 (The Pile)

Max Activating Token Index: 323

Text #11

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9858. Min Act: -0.1700

Data Index: 10096087 (The Pile)

Max Activating Token Index: 877

Text #12

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9858. Min Act: -0.1700

Data Index: 424238 (The Pile)

Max Activating Token Index: 459

Text #13

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9858. Min Act: -0.1700

Data Index: 37159 (The Pile)

Max Activating Token Index: 114

Text #14

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9858. Min Act: -0.1700

Data Index: 8538767 (The Pile)

Max Activating Token Index: 302

Text #15

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9858. Min Act: -0.1700

Data Index: 3129378 (The Pile)

Max Activating Token Index: 308

Text #16

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9858. Min Act: -0.1700

Data Index: 422113 (The Pile)

Max Activating Token Index: 589

Text #17

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9858. Min Act: -0.1700

Data Index: 7446014 (The Pile)

Max Activating Token Index: 817

Text #18

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9546. Min Act: -0.1700

Data Index: 2574240 (The Pile)

Max Activating Token Index: 764

Text #19

Max Range: 4.1109. Min Range: -4.1109

Max Act: 3.9546. Min Act: -0.1700

Data Index: 437358 (The Pile)

Max Activating Token Index: 439