Gradient over one-hot suffix
← Prev position
Next position →
position
1 / 32
token id
29407
batch
B=1
B>1
How "gradient with respect to discrete tokens" is defined.