Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 88 in Layer 37

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')

Text #0

Max Range: 7.1109. Min Range: -7.1109

Max Act: 7.1109. Min Act: -0.1700

Data Index: 4432577 (Open Web Text)

Max Activating Token Index: 989

Text #1

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.7672. Min Act: -0.1700

Data Index: 3606538 (Open Web Text)

Max Activating Token Index: 387

Text #2

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.7672. Min Act: -0.1700

Data Index: 3175245 (Open Web Text)

Max Activating Token Index: 889

Text #3

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.6734. Min Act: -0.1700

Data Index: 7039532 (Open Web Text)

Max Activating Token Index: 196

Text #4

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.6422. Min Act: -0.1700

Data Index: 6575602 (Open Web Text)

Max Activating Token Index: 434

Text #5

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.6109. Min Act: -0.1700

Data Index: 6462684 (Open Web Text)

Max Activating Token Index: 455

Text #6

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.6109. Min Act: -0.1700

Data Index: 6831448 (Open Web Text)

Max Activating Token Index: 614

Text #7

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5797. Min Act: -0.1700

Data Index: 8712318 (Open Web Text)

Max Activating Token Index: 86

Text #8

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5484. Min Act: -0.1700

Data Index: 4000053 (Open Web Text)

Max Activating Token Index: 347

Text #9

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5172. Min Act: -0.1700

Data Index: 1688674 (Open Web Text)

Max Activating Token Index: 381

Text #10

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5172. Min Act: -0.1700

Data Index: 2025123 (Open Web Text)

Max Activating Token Index: 241

Text #11

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.5172. Min Act: -0.1700

Data Index: 4006616 (Open Web Text)

Max Activating Token Index: 951

Text #12

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.4859. Min Act: -0.1700

Data Index: 5344792 (Open Web Text)

Max Activating Token Index: 600

Text #13

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.4547. Min Act: -0.1700

Data Index: 8275580 (Open Web Text)

Max Activating Token Index: 866

Text #14

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.4547. Min Act: -0.1700

Data Index: 2886411 (Open Web Text)

Max Activating Token Index: 222

Text #15

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.4547. Min Act: -0.1700

Data Index: 3931012 (Open Web Text)

Max Activating Token Index: 624

Text #16

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.3609. Min Act: -0.1700

Data Index: 2333562 (Open Web Text)

Max Activating Token Index: 663

Text #17

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.3609. Min Act: -0.1700

Data Index: 6057764 (Open Web Text)

Max Activating Token Index: 963

Text #18

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.3609. Min Act: -0.1700

Data Index: 1399534 (Open Web Text)

Max Activating Token Index: 268

Text #19

Max Range: 7.1109. Min Range: -7.1109

Max Act: 6.3297. Min Act: -0.1700

Data Index: 2620994 (Open Web Text)

Max Activating Token Index: 333