< Prev | Home | Model | Random | Next >

Model: GPT-2 Small: 12 Layers, 3072 Neurons per Layer

Dataset: Open Web Text

Neuron 10 in Layer 5

Load this data into an Interactive Neuroscope

See Documentation here

Hooked Transformer Loading: HookedTransformer.from_pretrained('gpt2-small')

Click the toggle to see the full text!

Text #0

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.6470. Min Act: -0.1700

Data Index: 6001339 (Open Web Text)

Max Activating Token Index: 729

Click toggle to see full text

Truncated

Full Text #0

Text #1

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.6191. Min Act: -0.1700

Data Index: 4119768 (Open Web Text)

Max Activating Token Index: 873

Click toggle to see full text

Truncated

Full Text #1

Text #2

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.5186. Min Act: -0.1700

Data Index: 2268041 (Open Web Text)

Max Activating Token Index: 847

Click toggle to see full text

Truncated

Full Text #2

Text #3

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.5047. Min Act: -0.1700

Data Index: 721951 (Open Web Text)

Max Activating Token Index: 625

Click toggle to see full text

Truncated

Full Text #3

Text #4

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.5125. Min Act: -0.1700

Data Index: 8798034 (Open Web Text)

Max Activating Token Index: 698

Click toggle to see full text

Truncated

Full Text #4

Text #5

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4884. Min Act: -0.1700

Data Index: 5152171 (Open Web Text)

Max Activating Token Index: 883

Click toggle to see full text

Truncated

Full Text #5

Text #6

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4409. Min Act: -0.1700

Data Index: 4171447 (Open Web Text)

Max Activating Token Index: 431

Click toggle to see full text

Truncated

Full Text #6

Text #7

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4407. Min Act: -0.1700

Data Index: 8350570 (Open Web Text)

Max Activating Token Index: 617

Click toggle to see full text

Truncated

Full Text #7

Text #8

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4603. Min Act: -0.1700

Data Index: 305126 (Open Web Text)

Max Activating Token Index: 616

Click toggle to see full text

Truncated

Full Text #8

Text #9

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4376. Min Act: -0.1700

Data Index: 930866 (Open Web Text)

Max Activating Token Index: 837

Click toggle to see full text

Truncated

Full Text #9

Text #10

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4223. Min Act: -0.1700

Data Index: 4665147 (Open Web Text)

Max Activating Token Index: 568

Click toggle to see full text

Truncated

Full Text #10

Text #11

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4320. Min Act: -0.1700

Data Index: 5559297 (Open Web Text)

Max Activating Token Index: 57

Click toggle to see full text

Truncated

Full Text #11

Text #12

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4139. Min Act: -0.1700

Data Index: 6389139 (Open Web Text)

Max Activating Token Index: 578

Click toggle to see full text

Truncated

Full Text #12

Text #13

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4141. Min Act: -0.1700

Data Index: 2344849 (Open Web Text)

Max Activating Token Index: 978

Click toggle to see full text

Truncated

Full Text #13

Text #14

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.3803. Min Act: -0.1700

Data Index: 1078781 (Open Web Text)

Max Activating Token Index: 644

Click toggle to see full text

Truncated

Full Text #14

Text #15

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.3918. Min Act: -0.1700

Data Index: 5152172 (Open Web Text)

Max Activating Token Index: 983

Click toggle to see full text

Truncated

Full Text #15

Text #16

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4129. Min Act: -0.1700

Data Index: 5337346 (Open Web Text)

Max Activating Token Index: 711

Click toggle to see full text

Truncated

Full Text #16

Text #17

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.3981. Min Act: -0.1700

Data Index: 3974877 (Open Web Text)

Max Activating Token Index: 277

Click toggle to see full text

Truncated

Full Text #17

Text #18

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.4127. Min Act: -0.1700

Data Index: 6261189 (Open Web Text)

Max Activating Token Index: 453

Click toggle to see full text

Truncated

Full Text #18

Text #19

Max Range: 2.6470. Min Range: -2.6470

Max Act: 2.3822. Min Act: -0.1700

Data Index: 5834741 (Open Web Text)

Max Activating Token Index: 904

Click toggle to see full text

Truncated

Full Text #19