Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Slomo frame insertion problem #54

Open
yanchi-3dv opened this issue Jul 25, 2023 · 1 comment
Open

Slomo frame insertion problem #54

yanchi-3dv opened this issue Jul 25, 2023 · 1 comment

Comments

@yanchi-3dv
Copy link

Thanks for your nice work!
I try to use your code to generate events from video, however, frame insertion results show like below.

7.25.1.mov

In the process of acceleration motion of the camera, the video obtained by inserting frames will have serious blurring.
I wonder if the problem is caused by the optical flow insertion frame or my parameters are not set properly. And how can I improve the performance.
Thanks!

@tobidelbruck
Copy link
Collaborator

Could you please share the source video? I suspect the frame shifts are too large or else SuperSloMo just does not generalize to this data. It's probably time to update the synthetic slomo model but it could be a lot of work. SuperSloMo estimates interframes between the last 2 adjacent frames using estimated optical flow. Any newer/better model with the same form could be used. And SuperSloMo could be fine tuned further past the monocrhomme model that we trained for v2e.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants