< Prev | Home | Model | Random | Next >

Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 310 in Layer 33

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')



Text #0

Max Range: 6.4709. Min Range: -6.4709

Max Act: 6.4709. Min Act: -0.1700

Data Index: 3245893 (Open Web Text)

Max Activating Token Index: 1010

Click toggle to see full text

Truncated

Full Text #0


Text #1

Max Range: 6.4709. Min Range: -6.4709

Max Act: 6.3772. Min Act: -0.1700

Data Index: 7885568 (Open Web Text)

Max Activating Token Index: 433

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 6.4709. Min Range: -6.4709

Max Act: 6.2209. Min Act: -0.1700

Data Index: 4472021 (Open Web Text)

Max Activating Token Index: 217

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 6.4709. Min Range: -6.4709

Max Act: 6.2209. Min Act: -0.1700

Data Index: 1425255 (Open Web Text)

Max Activating Token Index: 229

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 6.4709. Min Range: -6.4709

Max Act: 6.2209. Min Act: -0.1700

Data Index: 4543634 (Open Web Text)

Max Activating Token Index: 369

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 6.4709. Min Range: -6.4709

Max Act: 6.1584. Min Act: -0.1700

Data Index: 1740957 (Open Web Text)

Max Activating Token Index: 1017

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 6.4709. Min Range: -6.4709

Max Act: 6.1272. Min Act: -0.1700

Data Index: 5761809 (Open Web Text)

Max Activating Token Index: 839

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 6.4709. Min Range: -6.4709

Max Act: 6.0959. Min Act: -0.1700

Data Index: 6999175 (Open Web Text)

Max Activating Token Index: 364

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 6.4709. Min Range: -6.4709

Max Act: 6.0022. Min Act: -0.1700

Data Index: 950175 (Open Web Text)

Max Activating Token Index: 824

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.9709. Min Act: -0.1700

Data Index: 3418208 (Open Web Text)

Max Activating Token Index: 581

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.9709. Min Act: -0.1700

Data Index: 674066 (Open Web Text)

Max Activating Token Index: 959

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.9709. Min Act: -0.1700

Data Index: 6877166 (Open Web Text)

Max Activating Token Index: 564

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.9397. Min Act: -0.1700

Data Index: 6894722 (Open Web Text)

Max Activating Token Index: 964

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.9084. Min Act: -0.1700

Data Index: 449643 (Open Web Text)

Max Activating Token Index: 680

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.9084. Min Act: -0.1700

Data Index: 4225312 (Open Web Text)

Max Activating Token Index: 143

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.8772. Min Act: -0.1700

Data Index: 5108586 (Open Web Text)

Max Activating Token Index: 221

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.8772. Min Act: -0.1700

Data Index: 3985519 (Open Web Text)

Max Activating Token Index: 196

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.8459. Min Act: -0.1700

Data Index: 7289014 (Open Web Text)

Max Activating Token Index: 230

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.8459. Min Act: -0.1700

Data Index: 5981035 (Open Web Text)

Max Activating Token Index: 158

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 6.4709. Min Range: -6.4709

Max Act: 5.8147. Min Act: -0.1700

Data Index: 4141995 (Open Web Text)

Max Activating Token Index: 156

Click toggle to see full text

Truncated

Full Text #19