Probable mistake in Eq. 19 in the arxiv paper "Eagle and Finch"

[oliverYoung2001]

The up and down subscripts in equation 19 should be $j=i+1$ and $t-2$ according to the code in "wkv6_cuda.cu".

[BlinkDL]

it's u @ t, 1 @ t-1, w @ t-2, w^2 @ t-3, ...

[oliverYoung2001]

Sorry, I provide the error picture of paper. I mean maybe there are mistakes in "Finch Time Mixing" in the below picture.


Just like codes in "wkv6_cuda.cu", variable $t$ is enumerated in forward order, i.e. traverse all tokens in a forward direction
. Thus every $x_{t}=k_{t}^T @ v_{t}$ will multiply with the $diag(w_{t'})$ after it rather than before it. Thus, maybe the up and down subscripts in equation 19 should be $j=i+1$ and $t-2$ ?

[oliverYoung2001]

Looking forward to any feedbacks, :)