Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 779 in Layer 6

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.5291. Min Act: -0.1700

Data Index: 3306104 (Open Web Text)

Max Activating Token Index: 305

Text #1

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.4765. Min Act: -0.1700

Data Index: 417972 (Open Web Text)

Max Activating Token Index: 954

Text #2

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.4561. Min Act: -0.1700

Data Index: 1398308 (Open Web Text)

Max Activating Token Index: 852

Text #3

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.4729. Min Act: -0.1700

Data Index: 8240204 (Open Web Text)

Max Activating Token Index: 615

Text #4

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.4345. Min Act: -0.1700

Data Index: 2239112 (Open Web Text)

Max Activating Token Index: 710

Text #5

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3859. Min Act: -0.1700

Data Index: 7409065 (Open Web Text)

Max Activating Token Index: 494

Text #6

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.4053. Min Act: -0.1700

Data Index: 8016068 (Open Web Text)

Max Activating Token Index: 229

Text #7

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3695. Min Act: -0.1700

Data Index: 977272 (Open Web Text)

Max Activating Token Index: 642

Text #8

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3509. Min Act: -0.1700

Data Index: 8269211 (Open Web Text)

Max Activating Token Index: 786

Text #9

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3779. Min Act: -0.1700

Data Index: 3587516 (Open Web Text)

Max Activating Token Index: 621

Text #10

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3135. Min Act: -0.1700

Data Index: 657758 (Open Web Text)

Max Activating Token Index: 938

Text #11

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3746. Min Act: -0.1700

Data Index: 3628403 (Open Web Text)

Max Activating Token Index: 975

Text #12

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3352. Min Act: -0.1700

Data Index: 4330739 (Open Web Text)

Max Activating Token Index: 943

Text #13

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3377. Min Act: -0.1700

Data Index: 152047 (Open Web Text)

Max Activating Token Index: 719

Text #14

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3434. Min Act: -0.1700

Data Index: 5852910 (Open Web Text)

Max Activating Token Index: 815

Text #15

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3014. Min Act: -0.1700

Data Index: 2937547 (Open Web Text)

Max Activating Token Index: 856

Text #16

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.3051. Min Act: -0.1700

Data Index: 6291366 (Open Web Text)

Max Activating Token Index: 617

Text #17

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.2740. Min Act: -0.1700

Data Index: 7060051 (Open Web Text)

Max Activating Token Index: 833

Text #18

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.2615. Min Act: -0.1700

Data Index: 5248773 (Open Web Text)

Max Activating Token Index: 238

Text #19

Max Range: 4.5291. Min Range: -4.5291

Max Act: 4.2752. Min Act: -0.1700

Data Index: 1230057 (Open Web Text)

Max Activating Token Index: 275