Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2456 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.7331. Min Act: -0.1700

Data Index: 4732920 (Open Web Text)

Max Activating Token Index: 1023

Text #1

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.6525. Min Act: -0.1700

Data Index: 7535026 (Open Web Text)

Max Activating Token Index: 1023

Text #2

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.5722. Min Act: -0.1700

Data Index: 266389 (Open Web Text)

Max Activating Token Index: 1023

Text #3

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.5896. Min Act: -0.1700

Data Index: 8435695 (Open Web Text)

Max Activating Token Index: 1023

Text #4

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.5920. Min Act: -0.1700

Data Index: 2911476 (Open Web Text)

Max Activating Token Index: 1023

Text #5

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.5395. Min Act: -0.1700

Data Index: 7648142 (Open Web Text)

Max Activating Token Index: 1023

Text #6

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.5425. Min Act: -0.1700

Data Index: 5627005 (Open Web Text)

Max Activating Token Index: 1023

Text #7

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.5127. Min Act: -0.1700

Data Index: 2470177 (Open Web Text)

Max Activating Token Index: 1023

Text #8

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4850. Min Act: -0.1700

Data Index: 192382 (Open Web Text)

Max Activating Token Index: 1023

Text #9

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4976. Min Act: -0.1700

Data Index: 449882 (Open Web Text)

Max Activating Token Index: 1023

Text #10

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4950. Min Act: -0.1700

Data Index: 1442696 (Open Web Text)

Max Activating Token Index: 1023

Text #11

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4882. Min Act: -0.1700

Data Index: 2487690 (Open Web Text)

Max Activating Token Index: 969

Text #12

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.5099. Min Act: -0.1700

Data Index: 8707790 (Open Web Text)

Max Activating Token Index: 1023

Text #13

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4763. Min Act: -0.1700

Data Index: 4941809 (Open Web Text)

Max Activating Token Index: 1023

Text #14

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4695. Min Act: -0.1700

Data Index: 8748010 (Open Web Text)

Max Activating Token Index: 1023

Text #15

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4748. Min Act: -0.1700

Data Index: 8526414 (Open Web Text)

Max Activating Token Index: 1023

Text #16

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4986. Min Act: -0.1700

Data Index: 3881626 (Open Web Text)

Max Activating Token Index: 1023

Text #17

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.5035. Min Act: -0.1700

Data Index: 2530586 (Open Web Text)

Max Activating Token Index: 1023

Text #18

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4569. Min Act: -0.1700

Data Index: 5431014 (Open Web Text)

Max Activating Token Index: 1023

Text #19

Max Range: 3.7331. Min Range: -3.7331

Max Act: 3.4738. Min Act: -0.1700

Data Index: 6115537 (Open Web Text)

Max Activating Token Index: 1023