About TiTok-BL-64 VQ Tokenizer

[Amos1109]

Can you tell me what VQ and VAE stand for in TiTok-BL-64 VQ Tokenizer or TiTok-LL-32 VAE Tokenizer? I didn't find it in the paper.

[cornettoyu]

Hi,

"VQ" is for VQ tokenizer (discrete tokenizer that is usually used for transformer models), "VAE" is for VAE tokenizer (continuous tokenizer that is usually used for diffusion models) and "BL" stands for ViT-B for encoder and ViT-L for decoder; "LL" for ViT-L for both encoder and decoder.

You can refer to the config yaml file for detailed differences; these new checkpoints are not covered in the paper yet and we expect to update the paper with more details on these checkpoints later.