I don't own a facial mocap device yet, but was curious how the movement of the lips is handled.  If the actor is talking (and you record the audio) is the motion good enough to use for lip sync?  Or do you need to replace w/viseme?  Can you mix/blend the 2, or is it only one or the other.  Thanks.

Reallusion Certified Director / Reallusion Best Visual Award / Reallusion Certified Content Developer
See all the G-Tools Plug-Ins available for iClone here: G-Tools Plug-Ins

Well, *I* think it's good enough, but you should look at the MANY examples (including those I've posted on my channel) to make up your own mind before you invest.

You can capture audio at the same time but it will only be the tongue movement -- you can't mix visemes with the lips movement.

---

Alienware Aurora R12, Win 10, i9-119000KF, 3.5GHz CPU, 128GB RAM, RTX 3090 (24GB), Samsung 960 Pro 4TB M-2 SSD, TB+ Disk space
Mike "ex-genius" Kelley

Same topic - different question(s):  Is the audio recorded by iClone sufficient quality to use in finished production?  (Not played back by iClone, but recorded into iClone during Facial Mocap).
My assumption would be that it records in whatever quality your input device uses (i.e., 44.1kHz, 16-bit), or does iClone require a specific audio format?  I couldn't find and technical specs re: audio in the iClone manual. 
Also, can you then export the audio file (.wav?) from iClone to a DAW for post-production and re-mixing back into a video editor?  How would one go about doing that?  Is it embedded in a MotionPlus file or available stand-alone in a directory somewhere?

Reallusion Certified Director / Reallusion Best Visual Award / Reallusion Certified Content Developer
See all the G-Tools Plug-Ins available for iClone here: G-Tools Plug-Ins

It seems to be of sufficient quality, at least in the things I've done (and you can view my channel for many examples).  And you can export the audio separately out of iClone (it's render and you just choose "audio" and get a .WAV).

For critical things just use whatever audio capture you normally would and sync up in your video editor with the outputted audio (assuming the iClone capture isn't good enough for you).  

---

Alienware Aurora R12, Win 10, i9-119000KF, 3.5GHz CPU, 128GB RAM, RTX 3090 (24GB), Samsung 960 Pro 4TB M-2 SSD, TB+ Disk space
Mike "ex-genius" Kelley

I always prepare audio for dialog outside of iClone with one file for each speaking person. Those files are only used for lip-syncing.

Any audio treatment such as reverb to simulate room acoustics is done separately. So I don't rely on iClone's audio export. I believe it's now 44.1k (used to be 32k), which I don't use as everything is standardized at 48k.

---

Understood about post-processing.  I guess my question is, if LiveFace is capturing motion and you want to record the audio at the same time, iClone can do that, but how good is it?  And would you be able to run an audio program simultaneously to LiveFace to capture the audio with 'better fidelity' and control?  Seems like the mocap would be pretty h/w intensive...

Reallusion Certified Director / Reallusion Best Visual Award / Reallusion Certified Content Developer
See all the G-Tools Plug-Ins available for iClone here: G-Tools Plug-Ins

But you wouldn't need to do that -- most modern video editors can easily sync sound, so you can, for example, use a digital audio recorder for each actor, record them as you also capture the face, and then sync all up in your editor with the audio track exported from iClone.  And apply post processing as needed.  Exactly the way the pros do.

---

Alienware Aurora R12, Win 10, i9-119000KF, 3.5GHz CPU, 128GB RAM, RTX 3090 (24GB), Samsung 960 Pro 4TB M-2 SSD, TB+ Disk space
Mike "ex-genius" Kelley