Skip to content
中文

Compare methods

Compare structure rather than ranking incompatible benchmark scores. APE is absolute position encoding. RoPE rotates queries and keys. Not audited does not mean absent.

MethodRepresentationReconstruction or outputPosition scheme
VQGANgrid VQsingle-pass CNNlearned APE (prior)
VARmulti-scale VQsingle-pass CNNlearned APE + level
ViTcontinuous patchesclassification headlearned APE
RoPE-ViTcontinuous patchesclassification headaxial / mixed RoPE
TiTok1D discrete slotssingle-pass hybridlearned patch / slot APE
DiTcontinuous VAE gridlatent denoiser + VAEfixed 2D sin-cos
DiTocontinuous griditerative U-Netnot audited
FlowMoLFQ slotsiterative flow Transformermulti-axis RoPE
RAEhigh-dimensional featuressingle-pass ViTfixed 2D sin-cos (decoder)
MAETokcontinuous 1D slotssingle-pass decodernot audited
UniTokmulti-codebook gridsingle-pass decoderhybrid spatial structure
VILA-Uresidual-quantized codesimage decodernot audited
ATokensemantic / continuous / discreteTransformer decoderlearned APE + 4D RoPE
AIMcontinuous pixelspatch regression headsinusoidal APE
MARcontinuous latent tokensper-token diffusion MLPlearned APE
Fluidcontinuous / discreteper-token output headlearned positions discussed
CausalFusioncontinuous token groupsTransformer denoisingexperiment-dependent APE
NextStep-1text IDs + continuous imagesper-patch flow MLP1D RoPE (paper)
EOSTok1D IBQ codessingle-pass decoderlearned APE
AdaTokvariable-length VQbudget-conditioned decodernot audited
RAE-T2Ishared semantic featuresDiT + RAE decodermodule-dependent