Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 1567 in Layer 0

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9284. Min Act: -0.1700

Data Index: 1200885 (Open Web Text)

Max Activating Token Index: 4

Text #1

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.8971. Min Act: -0.1700

Data Index: 7024643 (Open Web Text)

Max Activating Token Index: 4

Text #2

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9422. Min Act: -0.1700

Data Index: 6845702 (Open Web Text)

Max Activating Token Index: 4

Text #3

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9159. Min Act: -0.1700

Data Index: 6818622 (Open Web Text)

Max Activating Token Index: 5

Text #4

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9024. Min Act: -0.1700

Data Index: 6428939 (Open Web Text)

Max Activating Token Index: 4

Text #5

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9528. Min Act: -0.1700

Data Index: 5968591 (Open Web Text)

Max Activating Token Index: 4

Text #6

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9126. Min Act: -0.1700

Data Index: 94596 (Open Web Text)

Max Activating Token Index: 4

Text #7

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9084. Min Act: -0.1700

Data Index: 1412245 (Open Web Text)

Max Activating Token Index: 4

Text #8

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.8971. Min Act: -0.1700

Data Index: 1314886 (Open Web Text)

Max Activating Token Index: 4

Text #9

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9084. Min Act: -0.1700

Data Index: 5897482 (Open Web Text)

Max Activating Token Index: 4

Text #10

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9084. Min Act: -0.1700

Data Index: 537073 (Open Web Text)

Max Activating Token Index: 4

Text #11

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9084. Min Act: -0.1700

Data Index: 5705888 (Open Web Text)

Max Activating Token Index: 4

Text #12

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9084. Min Act: -0.1700

Data Index: 5395133 (Open Web Text)

Max Activating Token Index: 4

Text #13

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9140. Min Act: -0.1700

Data Index: 3987055 (Open Web Text)

Max Activating Token Index: 3

Text #14

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9084. Min Act: -0.1700

Data Index: 352177 (Open Web Text)

Max Activating Token Index: 4

Text #15

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.8971. Min Act: -0.1700

Data Index: 3352994 (Open Web Text)

Max Activating Token Index: 4

Text #16

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9139. Min Act: -0.1700

Data Index: 3244977 (Open Web Text)

Max Activating Token Index: 4

Text #17

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9084. Min Act: -0.1700

Data Index: 139854 (Open Web Text)

Max Activating Token Index: 4

Text #18

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9084. Min Act: -0.1700

Data Index: 126515 (Open Web Text)

Max Activating Token Index: 4

Text #19

Max Range: 6.9528. Min Range: -6.9528

Max Act: 6.9024. Min Act: -0.1700

Data Index: 552777 (Open Web Text)

Max Activating Token Index: 4