Hello all. Thanks in advance for any input I can get on this issue:
From the very beginning of using CrazyTalk 7, I am repeatedly having a strange and recurring problem with any character I work on within CrazyTalk 7. At certain points in the lip-syncing process (and ONLY at certain points), regardless of the phonetic lip-sync I use or the degree of expressiveness I choose, the model will suddenly get a distorted, almost evil-looking "face-freeze" appearance. For example, if I choose the "M" sound where this happens, instead of the mouth being relaxed and closed (as you would expect the model to appear with that letter), the mouth with appear still slightly open with lips stretched and thinned out horizontally, and the entire face will contort as well at that spot (all of the facial expressions will become more intense in an exaggerated way). If I move before or beyond the point of where this occasionally happens, the model will not appear like that, and the phonetic lip-sync I use will react normally
. This only happens at certain points in the audio.
I've attached and image of President Trump to demonstrate. At the point I outputted this image, the "M' sound is what he is supposed to be forming with his mouth ("m' lip-sync phonetic is added there at 50%). But you'll notice the mouth is not fully closed and the extra-thinned-out lips I described appear. I've tried changing the phonetic sound, unchecking "lip sync constraint to auto motion" and lowering the expressiveness to even "0" at the point this happens, but nothing makes it go away.
Does anyone have any idea what could be going on, and how I might fix this bug? Again, thanks to anyone who my be able to offer a solution.
- Steve VZ