Question about features before I buy...


https://forum.reallusion.com/Topic548251.aspx 		Print Topic | Close Window

By midnightjesus00 - Last Year
I'm interested in integrating motion capture technology to animate only my face in 3D, while keeping my real body and the background in view. Additionally, it's crucial for me to interact with real-world objects, like instruments, in a way that they can occlude the animated face, appearing in front of it as needed. Can iClone with AccuFace (and CC4?) provide this functionality in both live scenarios and pre-recorded videos? Ideally, I'm looking for a solution that functions similarly to a Snapchat filter but offers more advanced capabilities.
By Sophus - Last Year
IClone uses 3d cameras from IPhones or Nvidia RTX-based face recognition. As far as I have read it in the forum, the recognition has already problems if the captured person has a beard. Then it cannot recognize mouth movements correctly. So I don't think you can cover the face in any way.

Both technologies also need to have the face captured in close-ups, like sitting in front of a webcam or holding the iPhone in front of the face to unlock its screen.

I believe Snapchat only recognizes basic facial features like edges from eyes and mouth and layers a 2d image or a basic 3d model on them which is then distorted by the movement of the recorded person. 3D animation needs much more information for face capture so it's not as easy.
By Kelleytoons - Last Year
Both Accuface and the iPhone thingee (sorry, don't remember right at the moment and WAY too lazy to boot up my machine) don't have problems with beards or glasses, and "sort of" ignore things in front of the mouth (it will interfere with capture accuracy but it's pretty acceptable).

But I'm not sure if Real-Time will work well for you - however, since there are free demos of both of the plugins why don't you just try it yourself to see?
By midnightjesus00 - Last Year
I am trying out accuface, but as far as I can tell it can't just animate a face only overtop of my body. And if it does, I can't find any tutorials on how to do it. 
By Kelleytoons - Last Year
You could animate it on top of your body (by hiding the body of the second figure - easy-peasy) but as to how you're going to keep that animated head "attached" to your real body behind it I would have NO idea (simple to do it in post, but to do it live would require $$$ - a mocap suit would be ideal).  If you are going to keep your real body rigid and unmoving then, sure, again easy to do but I'm guessing you want something like a snapchat filter (or whatever the heck the kids do nowadays to make their faces look like cats and other stuff).

That is NOT the purpose of iClone or the RL world.
By AutoDidact - Last Year


midnightjesus00 (3/3/2024)
I am trying out accuface, but as far as I can tell it can't just animate a face only overtop of my body. And if it does, I can't find any tutorials on how to do it. 


This might help you with Live facial replacement/tracking during live stream but it only seems made for goofy Masks.
also your hands do not occlude but pass “behind “ the mask.
Anything more advanced  will move you into the realm of Digital head replacement that you see in  big movies where an actors head is placed on the stunt mans body etc, which of course is only done by Big hollywood VFX studios 
By midnightjesus00 - Last Year
Ohh yeah, I have snap camera. Snapchat got rid of it, luckily a github project has preserved some of it.