Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2143 in Layer 2

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.6236. Min Act: -0.1700

Data Index: 5142150 (Open Web Text)

Max Activating Token Index: 803

Text #1

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.5836. Min Act: -0.1700

Data Index: 8688875 (Open Web Text)

Max Activating Token Index: 821

Text #2

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.6040. Min Act: -0.1700

Data Index: 2551068 (Open Web Text)

Max Activating Token Index: 833

Text #3

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.5698. Min Act: -0.1700

Data Index: 5846571 (Open Web Text)

Max Activating Token Index: 795

Text #4

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.5591. Min Act: -0.1700

Data Index: 8101900 (Open Web Text)

Max Activating Token Index: 796

Text #5

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.5481. Min Act: -0.1700

Data Index: 7906939 (Open Web Text)

Max Activating Token Index: 758

Text #6

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.5370. Min Act: -0.1700

Data Index: 7891125 (Open Web Text)

Max Activating Token Index: 768

Text #7

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.5365. Min Act: -0.1700

Data Index: 2331832 (Open Web Text)

Max Activating Token Index: 838

Text #8

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.5014. Min Act: -0.1700

Data Index: 2407856 (Open Web Text)

Max Activating Token Index: 832

Text #9

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4837. Min Act: -0.1700

Data Index: 7194303 (Open Web Text)

Max Activating Token Index: 800

Text #10

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4745. Min Act: -0.1700

Data Index: 805066 (Open Web Text)

Max Activating Token Index: 776

Text #11

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4716. Min Act: -0.1700

Data Index: 7891124 (Open Web Text)

Max Activating Token Index: 807

Text #12

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4482. Min Act: -0.1700

Data Index: 4152497 (Open Web Text)

Max Activating Token Index: 761

Text #13

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4459. Min Act: -0.1700

Data Index: 8069108 (Open Web Text)

Max Activating Token Index: 780

Text #14

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4602. Min Act: -0.1700

Data Index: 6446216 (Open Web Text)

Max Activating Token Index: 771

Text #15

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4328. Min Act: -0.1700

Data Index: 390499 (Open Web Text)

Max Activating Token Index: 818

Text #16

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4416. Min Act: -0.1700

Data Index: 447834 (Open Web Text)

Max Activating Token Index: 779

Text #17

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4331. Min Act: -0.1700

Data Index: 447832 (Open Web Text)

Max Activating Token Index: 779

Text #18

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4410. Min Act: -0.1700

Data Index: 447826 (Open Web Text)

Max Activating Token Index: 768

Text #19

Max Range: 1.6236. Min Range: -1.6236

Max Act: 1.4479. Min Act: -0.1700

Data Index: 2271749 (Open Web Text)

Max Activating Token Index: 824