Profile Picture

iPhone face mocap: noise & jitter

Posted By Mikay² 6 Years Ago
You don't have permission to rate!
1
2
3

Author
Message
StyleMarshal
StyleMarshal
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 5.8K, Visits: 14.3K
https://forum.reallusion.com/uploads/images/faca5409-5093-4c5d-9ba3-f61f.gif
Dmyricks
Dmyricks
Posted 6 Years Ago
View Quick Profile
New Member

New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 3, Visits: 121
Connected the USB direct and problem fixed! Thank you so much!
Eric C (RL)
Eric C (RL)
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (11.8K reputation)Distinguished Member (11.8K reputation)Distinguished Member (11.8K reputation)Distinguished Member (11.8K reputation)Distinguished Member (11.8K reputation)Distinguished Member (11.8K reputation)Distinguished Member (11.8K reputation)Distinguished Member (11.8K reputation)Distinguished Member (11.8K reputation)

Group: Administrators
Last Active: 3 Weeks Ago
Posts: 552, Visits: 6.0K
Hello @Dmyricks,

Here's the manual demonstrating how to connect to Live Face. https://bit.ly/3cHHLsN
Using a USB is highly recommended and it should solve your problem. :-) 

Dmyricks
Dmyricks
Posted 6 Years Ago
View Quick Profile
New Member

New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 3, Visits: 121
Yes. I use Live Face on my iphone using wifi connected to iclone link.  I use my laptop which is also connected to wifi.
Was not sure how to connect via USB. Will this help with the jitter?
kungphu
kungphu
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (4.1K reputation)Distinguished Member (4.1K reputation)Distinguished Member (4.1K reputation)Distinguished Member (4.1K reputation)Distinguished Member (4.1K reputation)Distinguished Member (4.1K reputation)Distinguished Member (4.1K reputation)Distinguished Member (4.1K reputation)Distinguished Member (4.1K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 997, Visits: 7.1K
Never even dawned on me to use the unreal curve editor. )insert facepalm) ugh... nice tip! Now I guess I better read up on the curve editor.

My "NEWEST" Latest:)  Movie Made With Amaaaazing iClone


—> High Noon”ish” in Narrow Valley<—



StyleMarshal
StyleMarshal
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 5.8K, Visits: 14.3K
Are you capturing over WiFi ?
Dmyricks
Dmyricks
Posted 6 Years Ago
View Quick Profile
New Member

New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)New Member (23 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 3, Visits: 121
I'm having a similar problem. I am getting gitter when I render. Is there any way to smooth this? I selected "smooth head" in live face. I changed the FPS, and minimized the face controls, but I still am getting gitter. Looks more robotic then natural.
Its a daz Gen 8 character 



Any advice?
Please help.
Mikay²
Mikay²
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 76, Visits: 1.3K
This does indeed look very promising! I did not yet notice the smoothing button, thanks for pointing that out. The curve editor in unreal is a great solution!

Thanks so much for putting the effort into giving me this answer! 
StyleMarshal
This post has been flagged as an answer
StyleMarshal
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 5.8K, Visits: 14.3K
Here is a Test Video I did some time ago , nothing cleaned.
Morphs are looking nice , only the "Facial Bone"  jitters a little bit when the mouth is closed , but you can clean up by deleting the "Muscle Keys" at the parts where the mouth is jittering.



You also have a Smooth Head function in the settings :

https://forum.reallusion.com/uploads/images/19d597f8-a1d8-4420-8d65-c95a.jpg

Whats missing is a Curve Editor for facials , that's what we are waiting for.

You also can clean up or fine tune the facials in Unreal Engine , or any other 3D App with Curve Editor :




For me the Live-Face Recording works great  , happy with it !
Mikay²
Mikay²
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 76, Visits: 1.3K
Kelleytoons (4/19/2020)
Sorry, but you're wrong. 

After doing some more research I found pretty jittery stuff that was recorded with the Iphone X on the web: https://youtu.be/Wxw6MwkfXUI?t=28 

But then I found something with pretty good results: https://www.youtube.com/watch?v=XTHvekIJzcs
Turns out this was done with "Face cap" from bannaflak.

And guess what they suggest as best practice in their documentation"Post process your recording by filtering out noise/jitter/glitches."
And guess what they have in their app - a smoothing button that does exactly what I said is needed:

https://forum.reallusion.com/uploads/images/cbb14664-6c87-496d-89d5-50a0.png


So to get back to my question: Is it possible to get the data in Iclone (e.g.,through python) to smooth it?
It would be cool to have the curves available like in the face cap app.



1
2
3



Reading This Topic