Character Lip sync for Chinese


https://forum.reallusion.com/Topic332924.aspx 		Print Topic | Close Window

By aeronyc - 9 Years Ago
Dear all, 
We just purchase CTA and still learning how to use it. One of the main problems that we are unable to solve is the lip sync. 
Our animations are in Chinese, and the lip sync for Chinese language is almost totally off >.< 
It doesn't have to be perfect but we are hoping to be able to make it reasonably good. What can we do to achieve this? 
Or is there any add-on that we can purchase? 
Any help would be very much appreciated. 
Thanks 
By but0fc0ursee - 9 Years Ago
aeronyc (7/7/2017)
...Our animations are in Chinese, and the lip sync for Chinese language is almost totally off >.<

iClone's speech engine is very accurate using properly made audio. (Clear with no background noise)

Nevertheless... All speech engines (that's used to create auto lip sync) is comprised of a specific set of phonetic values.
Look at 3dxchange's expression editor. "It shows exactly what phonemes are used."
English and Chinese have very different phonemes.

Mandarin: 21 phonemes can work.
If iClone's speech engine doesn't have those (specific) phonemes....
You should place this request in the "FeedBack Tracker."

For phonetics that are much different from English... I use (3rd party software)...
and progressively morph the phonemes.