Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 760 in Layer 16

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.1016. Min Act: -0.1700

Data Index: 4145779 (Open Web Text)

Max Activating Token Index: 363

Text #1

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.0391. Min Act: -0.1700

Data Index: 7898641 (Open Web Text)

Max Activating Token Index: 823

Text #2

Max Range: 4.1016. Min Range: -4.1016

Max Act: 4.0391. Min Act: -0.1700

Data Index: 4850276 (Open Web Text)

Max Activating Token Index: 710

Text #3

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9141. Min Act: -0.1700

Data Index: 641907 (Open Web Text)

Max Activating Token Index: 240

Text #4

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9453. Min Act: -0.1700

Data Index: 8347127 (Open Web Text)

Max Activating Token Index: 804

Text #5

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9453. Min Act: -0.1700

Data Index: 518089 (Open Web Text)

Max Activating Token Index: 322

Text #6

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9453. Min Act: -0.1700

Data Index: 7323523 (Open Web Text)

Max Activating Token Index: 341

Text #7

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9453. Min Act: -0.1700

Data Index: 4501494 (Open Web Text)

Max Activating Token Index: 583

Text #8

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9141. Min Act: -0.1700

Data Index: 8631281 (Open Web Text)

Max Activating Token Index: 754

Text #9

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9141. Min Act: -0.1700

Data Index: 4902678 (Open Web Text)

Max Activating Token Index: 39

Text #10

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9141. Min Act: -0.1700

Data Index: 2840482 (Open Web Text)

Max Activating Token Index: 250

Text #11

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.9141. Min Act: -0.1700

Data Index: 2492431 (Open Web Text)

Max Activating Token Index: 745

Text #12

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8828. Min Act: -0.1700

Data Index: 3353631 (Open Web Text)

Max Activating Token Index: 304

Text #13

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8515. Min Act: -0.1700

Data Index: 364127 (Open Web Text)

Max Activating Token Index: 205

Text #14

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8828. Min Act: -0.1700

Data Index: 2472163 (Open Web Text)

Max Activating Token Index: 310

Text #15

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8515. Min Act: -0.1700

Data Index: 6078061 (Open Web Text)

Max Activating Token Index: 785

Text #16

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8515. Min Act: -0.1700

Data Index: 1976490 (Open Web Text)

Max Activating Token Index: 241

Text #17

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8515. Min Act: -0.1700

Data Index: 5481252 (Open Web Text)

Max Activating Token Index: 354

Text #18

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8203. Min Act: -0.1700

Data Index: 7002867 (Open Web Text)

Max Activating Token Index: 1007

Text #19

Max Range: 4.1016. Min Range: -4.1016

Max Act: 3.8203. Min Act: -0.1700

Data Index: 4675661 (Open Web Text)

Max Activating Token Index: 388