Profile Picture

Standalone Lip-Syncing Mouth

Posted By Bigus Last Year
You don't have permission to rate!
Author
Message
Bigus
Idea.png
Bigus
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 9 days ago
Posts: 138, Visits: 1.7K
I am trying to create a mouth unit, which can be attached to different objects, and make the mouth speak with lip sync.
I made 12 mouth shapes in Blender, no bones or anything just different shapes, intending to morph theme.
I tried to transfer them together with a proper Iclone G5 skeleton through 3Dxchange and create the expression editing there. I didn't succeed.
Also with CC4 I didn't see a way to do it.

Can anyone point me in the right direction?

Thank you!



Embrace simplicity
Reduce selfishness
Have few desires
(Lao Tzu) 

Edited
Last Year by Bigus
4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 5.3K, Visits: 16.4K
Why not do the opposite...
Extract the mouth with blend-shapes from CC character and return in back to CC as a Humanoid.

This one took me 10 min to make: https://drive.google.com/file/d/1dpUvOPxsNbRPpJrFQlYfqoWz8mx9UMD_/view?usp=sharing
(it has Kevin's talking animation)

You basically export a CC3+ character with Mesh and Expression Sequence.
Import to Blender and delete all mesh except the desired shape of the mouth (I left teeth and tongue as well). Mouth could be reshaped as well.
At least 2 faces for the feet bottom should not be deleted (one for each feet). This is for character stability. Delete unnecessary materials.
Import this character back to CC, switch to Extended face profile and then import blend-shapes with "FBX with Frame sequence" from the same file you import the character with.




Edited
Last Year by 4u2ges
Bigus
Bigus
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 9 days ago
Posts: 138, Visits: 1.7K
This is an interesting direction. thank you very much.
I'm aiming for a toon mouth (see reference image), and I'm wondering how much can the realistic mouth be changed before it breaks.
https://forum.reallusion.com/uploads/images/5ec4b125-a69e-40d9-999f-d826.jpg

I assumed that it would be possible to define the shapes I created, as expressions on top of an existing skeleton. It is not possible?

Embrace simplicity
Reduce selfishness
Have few desires
(Lao Tzu) 

4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)Distinguished Member (22.2K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 5.3K, Visits: 16.4K
Something like this could be made with just mouth/lips morph sliders in CC.

https://forum.reallusion.com/uploads/images/f43a2f75-e216-422b-8ef7-970b.jpg

Then in Blender it could be further tweaked, subdivided and teeth extruded from the lip mesh up and down.
It should work fine.

Making a character from an existing mouth/parts is probably possible, by weighting to CC3 armature in Blender (particularly to Head bone) and importing to CC as Humanoid.
Then importing Blendshapes separately from the same file as Custom and then reassigning them one by one to Visemes.




Edited
Last Year by 4u2ges
Bigus
Bigus
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 9 days ago
Posts: 138, Visits: 1.7K
An interesting approach. thank you very much.
Continues experiments.


Embrace simplicity
Reduce selfishness
Have few desires
(Lao Tzu) 

Bigus
Bigus
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 9 days ago
Posts: 138, Visits: 1.7K
It was a loooong day Smile)
I think I've got it now.
Again, thanks Mr. 4u2ges


Embrace simplicity
Reduce selfishness
Have few desires
(Lao Tzu) 




Reading This Topic