Template based on Img2Txt Diffusion finetuning?

[TomLucidor]

Anyone tried to take a stab as post-DPO optimization of Diffusion Image Models?

• KTO https://github.com/jacklishufan/diffusion-kto
• MaPO https://github.com/mapo-t2i/mapo
• SePPO https://github.com/DwanZhang-AI/SePPO
• SPO https://github.com/RockeyCoss/SPO?
• RPO https://github.com/yigu1008/Diffusion-RPO

Q1: How do you get the AI to reference all of these repos and papers beforehand?
Q2: Can AI Scientist fetch code an datasets on their own?

[conglu1997]

Q1. Likely the most effective route would be to provide some of the base code for the above in the template.
Q2. It can fetch datasets it knows the names of from things like torch / huggingface.