< Prev | Home | Model | Random | Next >

Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 6344 in Layer 26

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')



Text #0

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.7277. Min Act: -0.1700

Data Index: 7104270 (Open Web Text)

Max Activating Token Index: 51

Click toggle to see full text

Truncated

Full Text #0


Text #1

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.6027. Min Act: -0.1700

Data Index: 6690716 (Open Web Text)

Max Activating Token Index: 676

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.5402. Min Act: -0.1700

Data Index: 5178326 (Open Web Text)

Max Activating Token Index: 474

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.5089. Min Act: -0.1700

Data Index: 5288715 (Open Web Text)

Max Activating Token Index: 1011

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.5089. Min Act: -0.1700

Data Index: 7257237 (Open Web Text)

Max Activating Token Index: 359

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.4777. Min Act: -0.1700

Data Index: 6612690 (Open Web Text)

Max Activating Token Index: 844

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.4464. Min Act: -0.1700

Data Index: 8600021 (Open Web Text)

Max Activating Token Index: 152

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.4152. Min Act: -0.1700

Data Index: 1723632 (Open Web Text)

Max Activating Token Index: 531

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.4152. Min Act: -0.1700

Data Index: 4167803 (Open Web Text)

Max Activating Token Index: 706

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.3527. Min Act: -0.1700

Data Index: 7829359 (Open Web Text)

Max Activating Token Index: 640

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.3214. Min Act: -0.1700

Data Index: 8756856 (Open Web Text)

Max Activating Token Index: 664

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.3214. Min Act: -0.1700

Data Index: 2391349 (Open Web Text)

Max Activating Token Index: 980

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.3214. Min Act: -0.1700

Data Index: 1941023 (Open Web Text)

Max Activating Token Index: 503

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.3214. Min Act: -0.1700

Data Index: 593804 (Open Web Text)

Max Activating Token Index: 662

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.2902. Min Act: -0.1700

Data Index: 2871043 (Open Web Text)

Max Activating Token Index: 875

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.3214. Min Act: -0.1700

Data Index: 2886939 (Open Web Text)

Max Activating Token Index: 678

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.2277. Min Act: -0.1700

Data Index: 8204048 (Open Web Text)

Max Activating Token Index: 951

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.2277. Min Act: -0.1700

Data Index: 6197484 (Open Web Text)

Max Activating Token Index: 555

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.1964. Min Act: -0.1700

Data Index: 5769002 (Open Web Text)

Max Activating Token Index: 318

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 6.7277. Min Range: -6.7277

Max Act: 6.1964. Min Act: -0.1700

Data Index: 7447232 (Open Web Text)

Max Activating Token Index: 435

Click toggle to see full text

Truncated

Full Text #19