Profile Picture

LIVE FACE limitation.

Posted By tatoforever 6 Years Ago
You don't have permission to rate!
Author
Message
tatoforever
tatoforever
Posted 6 Years Ago
View Quick Profile
New Member

New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)

Group: Forum Members
Last Active: 5 Years Ago
Posts: 5, Visits: 26
Just wanted to say that I stopped using iclone for the time being. I shoul'dve tried before buying. Silly me.
See ya next year.
tatoforever
tatoforever
Posted 6 Years Ago
View Quick Profile
New Member

New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)

Group: Forum Members
Last Active: 5 Years Ago
Posts: 5, Visits: 26
No body?
tatoforever
tatoforever
Posted 6 Years Ago
View Quick Profile
New Member

New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)

Group: Forum Members
Last Active: 5 Years Ago
Posts: 5, Visits: 26
What I did so far is to compare iclone ARKIT implementation with others existing implementations and iclone is lacking behind.
Some blendweights are missing or the data is not parsed correctly, other blendweights like the tongue are not mapped.
Also, you can interpolate the incoming ARKIT data from previous frames to avoid the constant shake/jagginess.
This is also something that others ARKIT plugin does to easy shakes.
The example I've provided above is raw live data from iPhone into Unity.

animagic
animagic
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 15.8K, Visits: 31.4K
One of our forum members is a frequent AND critical user of LiveFace, so it will be interesting to see his comments.


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

tatoforever
tatoforever
Posted 6 Years Ago
View Quick Profile
New Member

New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)

Group: Forum Members
Last Active: 5 Years Ago
Posts: 5, Visits: 26
I think I found the problem with Live FACE.
Jaw lateral and frontal movements are not read, the value never goes beyond 0.04 where in my phone i can read 0 to 1 with different ARKIT facial mocap apps.
Tongue value is read correctly 0 to 1 but is not mapped to the character tongue.
Some lips values have the same problem, never goes beyon 0.0X.
This is clearly bugs to me cause same phone, same ARKIT but others similar App (FaceCap, Unreal Live Link, etc) character deforms a lot better.
tatoforever
Problem.png
tatoforever
Posted 6 Years Ago
View Quick Profile
New Member

New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)New Member (95 reputation)

Group: Forum Members
Last Active: 5 Years Ago
Posts: 5, Visits: 26
Hi,
I was trying the ARKIT implementation on iClone and found out that the Tongue is not animated, the Jaw is not animated sideways (only up/down) and the lips are not animated either. Well it is but is strangelly limited you can only do duck, and smile very limited to the sides. Also the mouth is shaking a lot, like constantly.
I'm not sure but I believe the ARKIT implementation on iClone is either old or incomplete (or both). Not great compared to others implementations (FaceCap, Unreal Live Link, etc).
This is the solution I tried with FaceCap, works out of the box:
https://drive.google.com/file/d/1NYrTXFCOh05AtCeQkVvibeMd6UpVcpfF/view
Also the examples I saw with Faceware and Faceshift in iClone are really subpar compared to what you can achieve with those softwares.
I will use another solution untill this is improved, hopefully next year when we start our new project in Unreal all this get solved for now is un-usable. :(
PS: I'm using a default CC3+ character that I sent to iclone to do Live Face mocap.



Reading This Topic