< Prev | Home | Model | Random | Next >

Model: GPT-2 Xl: 48 Layers, 6400 Neurons per Layer

Dataset: Open Web Text

Neuron 149 in Layer 24

Load this data into an Interactive Neuroscope

See Documentation here

Transformer Lens Loading: HookedTransformer.from_pretrained('gpt2-xl')



Text #0

Max Range: 5.1186. Min Range: -5.1186

Max Act: 5.1186. Min Act: -0.1700

Data Index: 5504412 (Open Web Text)

Max Activating Token Index: 986

Click toggle to see full text

Truncated

Full Text #0


Text #1

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.9936. Min Act: -0.1700

Data Index: 6253611 (Open Web Text)

Max Activating Token Index: 635

Click toggle to see full text

Truncated

Full Text #1


Text #2

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.9311. Min Act: -0.1700

Data Index: 8255700 (Open Web Text)

Max Activating Token Index: 612

Click toggle to see full text

Truncated

Full Text #2


Text #3

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8998. Min Act: -0.1700

Data Index: 955182 (Open Web Text)

Max Activating Token Index: 679

Click toggle to see full text

Truncated

Full Text #3


Text #4

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8998. Min Act: -0.1700

Data Index: 6441502 (Open Web Text)

Max Activating Token Index: 300

Click toggle to see full text

Truncated

Full Text #4


Text #5

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8686. Min Act: -0.1700

Data Index: 6289460 (Open Web Text)

Max Activating Token Index: 715

Click toggle to see full text

Truncated

Full Text #5


Text #6

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8373. Min Act: -0.1700

Data Index: 7411721 (Open Web Text)

Max Activating Token Index: 581

Click toggle to see full text

Truncated

Full Text #6


Text #7

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8373. Min Act: -0.1700

Data Index: 4849677 (Open Web Text)

Max Activating Token Index: 245

Click toggle to see full text

Truncated

Full Text #7


Text #8

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8373. Min Act: -0.1700

Data Index: 3426935 (Open Web Text)

Max Activating Token Index: 557

Click toggle to see full text

Truncated

Full Text #8


Text #9

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8373. Min Act: -0.1700

Data Index: 6221503 (Open Web Text)

Max Activating Token Index: 857

Click toggle to see full text

Truncated

Full Text #9


Text #10

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8373. Min Act: -0.1700

Data Index: 8476018 (Open Web Text)

Max Activating Token Index: 662

Click toggle to see full text

Truncated

Full Text #10


Text #11

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8373. Min Act: -0.1700

Data Index: 6430982 (Open Web Text)

Max Activating Token Index: 516

Click toggle to see full text

Truncated

Full Text #11


Text #12

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8373. Min Act: -0.1700

Data Index: 5649940 (Open Web Text)

Max Activating Token Index: 353

Click toggle to see full text

Truncated

Full Text #12


Text #13

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8061. Min Act: -0.1700

Data Index: 7890054 (Open Web Text)

Max Activating Token Index: 222

Click toggle to see full text

Truncated

Full Text #13


Text #14

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8061. Min Act: -0.1700

Data Index: 6430631 (Open Web Text)

Max Activating Token Index: 937

Click toggle to see full text

Truncated

Full Text #14


Text #15

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8061. Min Act: -0.1700

Data Index: 8623383 (Open Web Text)

Max Activating Token Index: 741

Click toggle to see full text

Truncated

Full Text #15


Text #16

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.8061. Min Act: -0.1700

Data Index: 3021369 (Open Web Text)

Max Activating Token Index: 695

Click toggle to see full text

Truncated

Full Text #16


Text #17

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.7748. Min Act: -0.1700

Data Index: 4743242 (Open Web Text)

Max Activating Token Index: 499

Click toggle to see full text

Truncated

Full Text #17


Text #18

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.7748. Min Act: -0.1700

Data Index: 7632693 (Open Web Text)

Max Activating Token Index: 976

Click toggle to see full text

Truncated

Full Text #18


Text #19

Max Range: 5.1186. Min Range: -5.1186

Max Act: 4.7748. Min Act: -0.1700

Data Index: 2422346 (Open Web Text)

Max Activating Token Index: 815

Click toggle to see full text

Truncated

Full Text #19