Standalone Lip-Syncing Mouth


https://forum.reallusion.com/Topic544129.aspx 		Print Topic | Close Window

By Bigus - 2 Years Ago
I am trying to create a mouth unit, which can be attached to different objects, and make the mouth speak with lip sync.
I made 12 mouth shapes in Blender, no bones or anything just different shapes, intending to morph theme.
I tried to transfer them together with a proper Iclone G5 skeleton through 3Dxchange and create the expression editing there. I didn't succeed.
Also with CC4 I didn't see a way to do it.

Can anyone point me in the right direction?

Thank you!
By 4u2ges - 2 Years Ago
Why not do the opposite...
Extract the mouth with blend-shapes from CC character and return in back to CC as a Humanoid.

This one took me 10 min to make: https://drive.google.com/file/d/1dpUvOPxsNbRPpJrFQlYfqoWz8mx9UMD_/view?usp=sharing
(it has Kevin's talking animation)

You basically export a CC3+ character with Mesh and Expression Sequence.
Import to Blender and delete all mesh except the desired shape of the mouth (I left teeth and tongue as well). Mouth could be reshaped as well.
At least 2 faces for the feet bottom should not be deleted (one for each feet). This is for character stability. Delete unnecessary materials.
Import this character back to CC, switch to Extended face profile and then import blend-shapes with "FBX with Frame sequence" from the same file you import the character with.
By Bigus - 2 Years Ago
This is an interesting direction. thank you very much.
I'm aiming for a toon mouth (see reference image), and I'm wondering how much can the realistic mouth be changed before it breaks.
https://forum.reallusion.com/uploads/images/5ec4b125-a69e-40d9-999f-d826.jpg

I assumed that it would be possible to define the shapes I created, as expressions on top of an existing skeleton. It is not possible?
By 4u2ges - 2 Years Ago
Something like this could be made with just mouth/lips morph sliders in CC.

https://forum.reallusion.com/uploads/images/f43a2f75-e216-422b-8ef7-970b.jpg

Then in Blender it could be further tweaked, subdivided and teeth extruded from the lip mesh up and down.
It should work fine.

Making a character from an existing mouth/parts is probably possible, by weighting to CC3 armature in Blender (particularly to Head bone) and importing to CC as Humanoid.
Then importing Blendshapes separately from the same file as Custom and then reassigning them one by one to Visemes.
By Bigus - 2 Years Ago
An interesting approach. thank you very much.
Continues experiments.
By Bigus - 2 Years Ago
It was a loooong day :))
I think I've got it now.
Again, thanks Mr. 4u2ges