Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 2105 in Layer 8

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-small')

Text #0

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.7415. Min Act: -0.1700

Data Index: 1532690 (Open Web Text)

Max Activating Token Index: 230

Text #1

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.7571. Min Act: -0.1700

Data Index: 5009983 (Open Web Text)

Max Activating Token Index: 98

Text #2

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.7258. Min Act: -0.1700

Data Index: 3113643 (Open Web Text)

Max Activating Token Index: 23

Text #3

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.7102. Min Act: -0.1700

Data Index: 8109250 (Open Web Text)

Max Activating Token Index: 569

Text #4

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.6946. Min Act: -0.1700

Data Index: 1424250 (Open Web Text)

Max Activating Token Index: 662

Text #5

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.6789. Min Act: -0.1700

Data Index: 6187029 (Open Web Text)

Max Activating Token Index: 159

Text #6

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.6789. Min Act: -0.1700

Data Index: 6862151 (Open Web Text)

Max Activating Token Index: 704

Text #7

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.6163. Min Act: -0.1700

Data Index: 3943503 (Open Web Text)

Max Activating Token Index: 964

Text #8

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.6163. Min Act: -0.1700

Data Index: 7037424 (Open Web Text)

Max Activating Token Index: 704

Text #9

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.6007. Min Act: -0.1700

Data Index: 2794132 (Open Web Text)

Max Activating Token Index: 900

Text #10

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.6163. Min Act: -0.1700

Data Index: 1947351 (Open Web Text)

Max Activating Token Index: 51

Text #11

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.6007. Min Act: -0.1700

Data Index: 1700370 (Open Web Text)

Max Activating Token Index: 935

Text #12

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.5850. Min Act: -0.1700

Data Index: 6707647 (Open Web Text)

Max Activating Token Index: 952

Text #13

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.5850. Min Act: -0.1700

Data Index: 7389087 (Open Web Text)

Max Activating Token Index: 263

Text #14

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.5224. Min Act: -0.1700

Data Index: 5463026 (Open Web Text)

Max Activating Token Index: 997

Text #15

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.5694. Min Act: -0.1700

Data Index: 4870179 (Open Web Text)

Max Activating Token Index: 157

Text #16

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.5694. Min Act: -0.1700

Data Index: 264972 (Open Web Text)

Max Activating Token Index: 1007

Text #17

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.5694. Min Act: -0.1700

Data Index: 5163920 (Open Web Text)

Max Activating Token Index: 819

Text #18

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.5537. Min Act: -0.1700

Data Index: 8613062 (Open Web Text)

Max Activating Token Index: 345

Text #19

Max Range: 3.7571. Min Range: -3.7571

Max Act: 3.5381. Min Act: -0.1700

Data Index: 3896949 (Open Web Text)

Max Activating Token Index: 635