Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question regarding entropic OT #128

Open
Luciennnnnnn opened this issue Jul 28, 2024 · 0 comments
Open

Question regarding entropic OT #128

Luciennnnnnn opened this issue Jul 28, 2024 · 0 comments

Comments

@Luciennnnnnn
Copy link

Hi, I have read the paper "Simulation-free Schr"odinger bridges via score and flow matching", interesting work and very nice presentation!

After read through it, I have some questions.

According to Proposition 2.1, the solution to the Schrödinger bridge problem is derived from the entropic OT plan. However, in Appendices A.1 and D.2, you mention that the entropic OT plan does not perform as well as exact optimal transport in settings with smaller batch sizes and higher dimensions. According to Algorithm 4 in the appendix, the sigma in the entropic OT plan is the same as the sigma in p(x|x_0, x_1). When we use exact optimal transport, does this mean that the sigma in p(x|x_0, x_1) needs to be set to 0? (this will ruin the stochasticity however). Additionally, what is the motivation or practical guidance for setting sigma?

Furthermore, I noticed that you always use larger batch sizes in your experiments. However, I am more concerned with high-dimensional image tasks, such as unpaired super-resolution, where we typically use larger networks and relatively smaller batch sizes like (16, 32 or 64). Can we expect SF2M to perform well under these settings? If minibatch OT does not perform well, and we degrade to the independent coupling of p(x_0) and p(x_1), does SF2M imply very slow convergence and potential poor performance compared to CycleGAN? CycleGAN seems to ensure more reliable convergence due to its explicit consistency loss.

Any replies or answers are appreciated!

Best regards,
Xin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant