Question about the MaskGIT

[deJQK]

Thanks for this great work! What is the training cost of the generator for MaskGIT? From Table 1, the codebook size is 1024. Is the tokenizer available online? Also, what is the training setting and shell command for training this MaskGIT generator? Would it be sufficient to run train_maskgit.py directly? Thanks!

[cornettoyu]

Hi,

Not sure if I understand it correctly, are you trying to train the original MaskGIT with MaskGIT-VQ using this codebase? That should be doable, please refer to the training instructions. For training cost of MaskGIT w/ TiTok, it should be ~ 1 day using 32 A800 for 32 tokens and ~2 days for 128 tokens if I remember them correctly

[deJQK]

Hi,

Not sure if I understand it correctly, are you trying to train the original MaskGIT with MaskGIT-VQ using this codebase? That should be doable, please refer to the training instructions. For training cost of MaskGIT w/ TiTok, it should be ~ 1 day using 32 A800 for 32 tokens and ~2 days for 128 tokens if I remember them correctly

Thanks a lot! Yes, that is what I meant. Thanks very much for answering. This repo is very clean and helpful for reproducing experiment results.