Kimi Delta Attention utilizes bra-ket notation for clarity in mathematical derivations, where column vectors represent states, row vectors represent duals, numbers represent scalars, and matrices represent linear transformations. In this notation, vectors are oriented to the right by default, while keys are oriented to the left within the linear attention structure.

LoGeR enables dense 3D reconstruction of extremely long videos by processing them in chunks with a hybrid memory module, addressing quadratic complexity issues. It utilizes Sliding Window Attention for local alignment and Test-Time Training to maintain global consistency, effectively reducing drift over sequences of up to 19,000 frames.