Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1156 in Layer 1

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5620. Min Act: -0.1700

Data Index: 7752163 (Open Web Text)

Max Activating Token Index: 498

Text #1

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5741. Min Act: -0.1700

Data Index: 6494856 (Open Web Text)

Max Activating Token Index: 514

Text #2

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5348. Min Act: -0.1700

Data Index: 5279389 (Open Web Text)

Max Activating Token Index: 88

Text #3

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5329. Min Act: -0.1415

Data Index: 5801519 (Open Web Text)

Max Activating Token Index: 919

Text #4

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5279. Min Act: -0.1700

Data Index: 5224298 (Open Web Text)

Max Activating Token Index: 333

Text #5

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5082. Min Act: -0.1700

Data Index: 495091 (Open Web Text)

Max Activating Token Index: 508

Text #6

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5142. Min Act: -0.1700

Data Index: 5203442 (Open Web Text)

Max Activating Token Index: 254

Text #7

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5104. Min Act: -0.1700

Data Index: 4517500 (Open Web Text)

Max Activating Token Index: 50

Text #8

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5127. Min Act: -0.1700

Data Index: 1604420 (Open Web Text)

Max Activating Token Index: 492

Text #9

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.5002. Min Act: -0.1700

Data Index: 7573411 (Open Web Text)

Max Activating Token Index: 613

Text #10

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4986. Min Act: -0.1700

Data Index: 7700951 (Open Web Text)

Max Activating Token Index: 647

Text #11

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4972. Min Act: -0.1700

Data Index: 7783050 (Open Web Text)

Max Activating Token Index: 508

Text #12

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4906. Min Act: -0.1700

Data Index: 7234381 (Open Web Text)

Max Activating Token Index: 788

Text #13

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4886. Min Act: -0.1700

Data Index: 4569981 (Open Web Text)

Max Activating Token Index: 949

Text #14

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4871. Min Act: -0.1696

Data Index: 4951645 (Open Web Text)

Max Activating Token Index: 752

Text #15

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4781. Min Act: -0.1700

Data Index: 1873955 (Open Web Text)

Max Activating Token Index: 265

Text #16

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4856. Min Act: -0.1700

Data Index: 433331 (Open Web Text)

Max Activating Token Index: 417

Text #17

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4770. Min Act: -0.1700

Data Index: 5229812 (Open Web Text)

Max Activating Token Index: 766

Text #18

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4804. Min Act: -0.1697

Data Index: 5801526 (Open Web Text)

Max Activating Token Index: 1010

Text #19

Max Range: 1.5741. Min Range: -1.5741

Max Act: 1.4785. Min Act: -0.1700

Data Index: 835237 (Open Web Text)

Max Activating Token Index: 142