Profile Picture

Facial Animation from Voice Track

Posted By Dan Miller 5 Years Ago
You don't have permission to rate!
Author
Message
Dan Miller
Dan Miller
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 365, Visits: 1.8K
I would like to learn how to animate from a voice track. I looked in the training videos but didn't see that one. If you guys have any tips or specific guidelines that would be great. Thanks.
thedirector1974
thedirector1974
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 783, Visits: 5.2K
I made a tutorial concerning a important part of the facil animation - cleaning the viseme track. Hope it helps a bit ...



Greetings, Direx

Dan Miller
Dan Miller
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 365, Visits: 1.8K
Hi Direx,

This is a big help. I spent hours last night doing a one minute voice track. After watching your video I can see a couple of things I can do differently right away that should help out. My workflow is from the manual but not sure if that is going to be the best. The manual shows I should use Crazy Talk 8 first so:

Crazy Talk 8 -> iClone 7

I end up with a lot of lip markers and I think that actually makes it harder. Also, it adds in many eye movements that I don't want. Do you use Crazy Talk 8 first or just import directly into iClone 7? How do I delete some eye movements? I've been searching for it in the Timeline but not finding the key frames. Thanks for making this video. It helps to watch someone go through the process and I like your results.
thedirector1974
thedirector1974
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)Distinguished Member (6.9K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 783, Visits: 5.2K
I don't use Crazy Talk 8. I just load my sound files into the project and start cleaning the viseme track ...
Dan Miller
Dan Miller
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 365, Visits: 1.8K
thedirector1974 (4/21/2019)
I don't use Crazy Talk 8. I just load my sound files into the project and start cleaning the viseme track ...


Sounds good, I would prefer to drop Crazy Talk from the workflow. However, with my current animation I finished the viseme track but now I have unwanted eye movements that came over from Crazy Talk. Do you know how I can delete those movements? I just can't seem to find it in the Timeline. Thanks.

animagic
animagic
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)

Group: Forum Members
Last Active: 1 hour ago
Posts: 15.7K, Visits: 30.5K
The eye movement data is in the Expression track, which has three sub-tracks: Muscle, Eyeball(R/L), and Head. The Eyeball track should allow you to fix the eyes.

There is indeed no particular advantage to using CrazyTalk for lip-syncing as the underlying functionality is the same for both programs.

If RL would put some work in the lip-syncing function by adding textual support (similar to Papagayo) the results could be greatly improved. Has been requested numerous times, by the way.


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

Dan Miller
Dan Miller
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 365, Visits: 1.8K
animagic (4/22/2019)
The eye movement data is in the Expression track, which has three sub-tracks: Muscle, Eyeball(R/L), and Head. The Eyeball track should allow you to fix the eyes.

There is indeed no particular advantage to using CrazyTalk for lip-syncing as the underlying functionality is the same for both programs.

If RL would put some work in the lip-syncing function by adding textual support (similar to Papagayo) the results could be greatly improved. Has been requested numerous times, by the way.



I'm not seeing the data in the expression track, eyeball. I keep looking in that area unless the vertical lines mean there is data stored in that area. I was looking for keyframes. I attached a picture so you can see what I'm looking at. The Crazy Talk workflow put a whole bunch of eye movements that I didn't want.

Good to know regarding Crazy Talk. They really should update their manual because it says I really should use it because it is greatly improved over the iClone viseme method. Probably old information.

I wonder why they are not adding the textual support. The lip syncing is obviously a huge component and needs to be correct, or at least very close.

https://forum.reallusion.com/uploads/images/7f7fe419-6e17-4ca4-8875-c0db.jpg
Dan Miller
Dan Miller
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 365, Visits: 1.8K
Or do I have to delete the entire track on the Expression row? Maybe everything is baked in and can't just fix the eyes.
Dan Miller
Dan Miller
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 365, Visits: 1.8K
I deleted the entire expression track to correct the problem. I think it may have been the only way so another reason why the Crazy Talk workflow is not a good idea.
Dan Miller
Dan Miller
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)Distinguished Member (5.1K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 365, Visits: 1.8K
I started over with Create Script, Audio File, in iClone 7. One of the first things I noticed when playing back is the hair flying around. How do I disable that? Thanks.



Reading This Topic