Two different models for geometry and texture.

[linziqu]

Thank you for your kind response for my previous issue.

I have one more question regarding the different model used for the geometry images and material images.
The model for geometry images is Dit, which flattens the image to 1-D for processing, and the model for material images is imagen, which directly inputs the 2-D images. Why not using the Dit for material images generation?

[QhelDIV]

Hi, thanks for the question.
In theory, yes, DiT can also generate material maps conditioned on the generated geometry.
In practice, we find imagen can learn mateiral maps more easily, while DiT can learn the geometry better.