It looks like the mods moved this post from where I originally made it in the iClone forum to Character Creator... which isn't accurate. In fact, it seems CC alone decidedly does not work at all for this purpose, as far as I can tell. Exporting directly from CC does not get me Facial Mocap, which has to be done in iClone, nor does it get me ARKit Expressions used for that. Using a character exported directly from CC before Mocap is made, importing that into Unity, and then later mapping on a separate motion-only export from iClone / CC into Unity also doesn't work perfectly. Only base non-expression facial animation remains in tact with auto blinking. It even fails to automatically rig up the eyes.
The issue is how to export the Facial Mocap performance from iClone so I can get it into Unity, just as I wrote in the OP. This is an iClone topic.
After some more experimentation since this post was made (and the gap between approval), I got it to work.
Part of why I asked this is because original characters created with Headshot in CC and then brought into iClone would fail to export to FBX. So I was stuck trying to set ranges for the Collected Clip layer and exported MotionPlus files directly to then import into CC and export as motion-only from there or export MotionPlus to 3DXchange. Then I would apply that in Unity into a CC-only exported character. All elements brought in via the Unity CC_Assets pipeline. Both methods apparently fail to translate facial expressions, in part. Head movement seemed to be the only thing in tact. No blinking. No facial muscle capture. What made this confusing is on top of everything else the characters would look as-intended with facial mocap in iClone, but not upon MotionPlus export and Unity import. So what was missing?
Today, I started a new document directly in iClone with stock Kevin and did a facial mocap test. I was able to export him out as an FBX for Unity. I figured there was something unique about the avatar I wasn't aware of with my Headshot-CC created character. Some Facial Expressions / morphs mapping I'd need to apply? That nothing is telling me about? I have to scour the Internet and YouTube to get a clue on this?
I opened up the same original Headshot made character and sent him to iClone. Facial Mocap could connect to LIVE Face but the character wouldn't move during Preview or Record. Back in CC, I applied CC3 Motion and Expressions > _Default.iTalk to the character based on some other random forum post I found from like 5 years ago. I'm not sure if this did anything but when I sent him back to iClone, I had to again apply ARKit Expressions, but then it worked. I've gotten the character to work with facial mocap before but then ran into the 'Failed to Export to FBX' error.
Well during this attempt, for whatever reason, I was able to export the character with facial mocap and audio recorded to FBX for Unity via iClone directly. No 'Failed to Export FBX' error. Brought it into Unity and it worked perfectly. I also have no idea how Unity is reading facial morphs (like muscles) / expressions and applying them because all I can see in Unity are Humanoid rigging and bones.
I'm not exactly sure what's going on but it was a bit frustrating to run into this when, honestly, it should just work. It's also not comforting to discover a method that apparently sometimes works? We chose Reallusion specifically as a solution for Unity that could be our Unity alternative for Unreal's exclusive Metahuman Creator. We would love it if Reallusion doubles, triples down on direct integration with Unity, like the Unreal Live Link plug-in. CC3 characters should be ready to go for Mocap without iClone having to apply anything to it and especially to get it to successfully Export to FBX for Unity or better yet to just automagically send to Unity live. And there should absolutely be up to date tutorials for doing exactly this... which to us is the entire point of using any of these tools at all. I mean, why else would we be using CC if not to make characters that work with iClone in a few clicks? And we want iClone for its Mocap tools.
All of that being said, we are generally very happy with the Reallusion software, but, the point is, this could be made a lot
less tedious and confusing yet.
Anyway, relived to have got it working. If anyone can shed some light on this, that'd not only be helpful to me but others I'm sure.
3 Years Ago by