Embeded classifier free guidance?

[kinam0252]

Thank you for your amazing work! 😊

In this model, it seems to use embedded CFG rather than the usual approach of predicting noise first and then applying CFG.
Could you provide insights into how exactly this works? Or are there any previous works that might be helpful?

[jiawangbai]

Thanks for your interest in our work. It is more efficient to use embedded CFG compared to two separated branches during inference (approximately 1.9x acceleration). For more details, please refer to Section 5.2 of our technical report (https://arxiv.org/pdf/2412.03603).