Model: GPT-2 Large: 36 Layers, 5120 Neurons per Layer

Dataset: Open Web Text

Neuron 1716 in Layer 11

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-large')

Text #0

Max Range: 5.1016. Min Range: -5.1016

Max Act: 5.1016. Min Act: -0.1700

Data Index: 2324092 (Open Web Text)

Max Activating Token Index: 639

Text #1

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.9766. Min Act: -0.1700

Data Index: 6472199 (Open Web Text)

Max Activating Token Index: 572

Text #2

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.9766. Min Act: -0.1700

Data Index: 1070956 (Open Web Text)

Max Activating Token Index: 305

Text #3

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.9454. Min Act: -0.1700

Data Index: 6414714 (Open Web Text)

Max Activating Token Index: 489

Text #4

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.9141. Min Act: -0.1700

Data Index: 6520369 (Open Web Text)

Max Activating Token Index: 194

Text #5

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.8829. Min Act: -0.1700

Data Index: 1196500 (Open Web Text)

Max Activating Token Index: 442

Text #6

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.8516. Min Act: -0.1700

Data Index: 5757585 (Open Web Text)

Max Activating Token Index: 1020

Text #7

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.8829. Min Act: -0.1700

Data Index: 4675443 (Open Web Text)

Max Activating Token Index: 647

Text #8

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.8829. Min Act: -0.1700

Data Index: 8729622 (Open Web Text)

Max Activating Token Index: 796

Text #9

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.8516. Min Act: -0.1700

Data Index: 763193 (Open Web Text)

Max Activating Token Index: 496

Text #10

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.8516. Min Act: -0.1700

Data Index: 928499 (Open Web Text)

Max Activating Token Index: 396

Text #11

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.8829. Min Act: -0.1700

Data Index: 1662600 (Open Web Text)

Max Activating Token Index: 578

Text #12

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.8516. Min Act: -0.1700

Data Index: 119906 (Open Web Text)

Max Activating Token Index: 967

Text #13

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.7891. Min Act: -0.1700

Data Index: 2376382 (Open Web Text)

Max Activating Token Index: 932

Text #14

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.7891. Min Act: -0.1700

Data Index: 5545967 (Open Web Text)

Max Activating Token Index: 714

Text #15

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.7891. Min Act: -0.1700

Data Index: 7174209 (Open Web Text)

Max Activating Token Index: 25

Text #16

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.7579. Min Act: -0.1700

Data Index: 5180089 (Open Web Text)

Max Activating Token Index: 396

Text #17

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.7579. Min Act: -0.1700

Data Index: 6899661 (Open Web Text)

Max Activating Token Index: 369

Text #18

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.7266. Min Act: -0.1700

Data Index: 2210738 (Open Web Text)

Max Activating Token Index: 847

Text #19

Max Range: 5.1016. Min Range: -5.1016

Max Act: 4.7266. Min Act: -0.1700

Data Index: 5060701 (Open Web Text)

Max Activating Token Index: 310