Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2392 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.8423. Min Act: -0.1700

Data Index: 7465429 (Open Web Text)

Max Activating Token Index: 929

Text #1

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.7019. Min Act: -0.1700

Data Index: 7465432 (Open Web Text)

Max Activating Token Index: 743

Text #2

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.6016. Min Act: -0.1700

Data Index: 6123314 (Open Web Text)

Max Activating Token Index: 857

Text #3

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.5558. Min Act: -0.1700

Data Index: 4256610 (Open Web Text)

Max Activating Token Index: 553

Text #4

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.5278. Min Act: -0.1700

Data Index: 2560246 (Open Web Text)

Max Activating Token Index: 283

Text #5

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.5322. Min Act: -0.1700

Data Index: 4256608 (Open Web Text)

Max Activating Token Index: 350

Text #6

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.5215. Min Act: -0.1700

Data Index: 2141919 (Open Web Text)

Max Activating Token Index: 817

Text #7

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.5050. Min Act: -0.1700

Data Index: 4319804 (Open Web Text)

Max Activating Token Index: 833

Text #8

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.4591. Min Act: -0.1700

Data Index: 6792629 (Open Web Text)

Max Activating Token Index: 821

Text #9

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.4575. Min Act: -0.1700

Data Index: 6856908 (Open Web Text)

Max Activating Token Index: 714

Text #10

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.4530. Min Act: -0.1700

Data Index: 8072485 (Open Web Text)

Max Activating Token Index: 396

Text #11

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.4018. Min Act: -0.1700

Data Index: 2141911 (Open Web Text)

Max Activating Token Index: 709

Text #12

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.4048. Min Act: -0.1700

Data Index: 733232 (Open Web Text)

Max Activating Token Index: 989

Text #13

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.3667. Min Act: -0.1700

Data Index: 8244152 (Open Web Text)

Max Activating Token Index: 816

Text #14

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.3642. Min Act: -0.1700

Data Index: 2220548 (Open Web Text)

Max Activating Token Index: 1015

Text #15

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.3592. Min Act: -0.1700

Data Index: 7123760 (Open Web Text)

Max Activating Token Index: 1011

Text #16

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.3388. Min Act: -0.1700

Data Index: 1616803 (Open Web Text)

Max Activating Token Index: 451

Text #17

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.3251. Min Act: -0.1700

Data Index: 8380828 (Open Web Text)

Max Activating Token Index: 624

Text #18

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.3331. Min Act: -0.1700

Data Index: 2794150 (Open Web Text)

Max Activating Token Index: 794

Text #19

Max Range: 1.8423. Min Range: -1.8423

Max Act: 1.2788. Min Act: -0.1700

Data Index: 7123741 (Open Web Text)

Max Activating Token Index: 793