Glitchy output

[anothermartz]

My outputs are all shakey and the lips do not track properly.

Even the provided example saved in the git is glitchy, what's going on?

https://github.com/semchan/HyperLips/raw/main/results/result_voice.mp4

For anyone wanting to try for themselves but don't want the hassle of setting it all up, I made a colab which can be found in my fork:

https://github.com/anothermartz/Easy-HyperLips

You can find another example of the glitchy lips saved within the colab.

[lukasschmit]

Also having issues, even for video/audio pairs from the same speaker in mead! it works perfectly for the same audio/video sample though. Is the Inference_hyperlips.py the correct thing to be running for a lipsync use case?

audio_from_mead.mp4

[quizzy5889]

Same problem here. Did anybody find a solution for that? Would be nice to at least replicate the results shown in the demo video.

[ms-ufad]

遇到了相同的问题，生成的视频lip抖动，是因为加入了sketch热力图作为引导导致的吗？还是说在后处理贴合上seg不准确？

[aishoot]

Same problem. The lip trembles incessantly.

[visonpon]

+1

[Wangman1]

请问各位，这个问题有解决吗

[Angtrim]

Any news on this issue?