Profile Picture

New video about my new iClone plug-in: Import facial animation (coming soon)

Posted By mrtobycook Last Year
Rated 5 stars based on 1 vote.
1
...
8
9
10
11
12
13
14

New video about my new iClone plug-in: Import facial animation (coming...

Author
Message
rosuckmedia
rosuckmedia
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (9.4K reputation)Distinguished Member (9.4K reputation)Distinguished Member (9.4K reputation)Distinguished Member (9.4K reputation)Distinguished Member (9.4K reputation)Distinguished Member (9.4K reputation)Distinguished Member (9.4K reputation)Distinguished Member (9.4K reputation)Distinguished Member (9.4K reputation)

Group: Forum Members
Last Active: 3 Weeks Ago
Posts: 3.2K, Visits: 4.8K
Hello
Face importer plugin. (Beta) πŸ‘πŸ‘πŸ‘
Today I have Live Link Face Arkit for the first time,
tried it with my new iphone 13 mini.
I have to say it works much better than my IPhone X.
Greetings Robert



StyleMarshal
StyleMarshal
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 5.8K, Visits: 14.3K
hahaha , grossartig Rob , awesome πŸ‘
mtakerkart
mtakerkart
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 3.2K, Visits: 29.2K
rosuckmedia (8/25/2023)
Hello
Face importer plugin. (Beta) πŸ‘πŸ‘πŸ‘
Today I have Live Link Face Arkit for the first time,
tried it with my new iphone 13 mini.
I have to say it works much better than my IPhone X.
Greetings Robert




@Rosuckmedia
Very cool Rosuckmedia. You have just confirmed to me that the range of Iphone mini works.:P
@Toby
  I have a problem because of the morphology of my mouth. As you can see in this photo
my lip comissures droop when at rest.

https://forum.reallusion.com/uploads/images/1dc0cb48-496a-4069-bb53-4583.jpg

I did not find a way to calibrate livelinkface for ARKit mode which results in Livelinkface applying it to characters.
I could fix it with the "Face key" panel but every frame has a keyframe and there isn't the
possibility of applying/blending it from one shot to the entire timeline.

https://forum.reallusion.com/uploads/images/af6fa30a-987f-48ae-869b-9e8e.png

https://forum.reallusion.com/uploads/images/c3c40488-2dbf-4f32-804e-ff70.png

So I have 2 questions:
1- would it be possible to put our own values in the
magic performance?

https://forum.reallusion.com/uploads/images/b7dc3f3c-8f3a-4168-a4b4-5222.png

2- would it be possible to add other muscles settings?

Thanks in advance

Marc
charly Rama
charly Rama
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)

Group: Forum Members
Last Active: 4 days ago
Posts: 1.9K, Visits: 17.3K
rosuckmedia (8/25/2023)
Hello
Face importer plugin. (Beta) πŸ‘πŸ‘πŸ‘
Today I have Live Link Face Arkit for the first time,
tried it with my new iphone 13 mini.
I have to say it works much better than my IPhone X.
Greetings Robert



Heey Rob what a great test you've done here, love this pumpkin head :D:D:D






     


mrtobycook
mrtobycook
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)

Group: Forum Members
Last Active: 2 Weeks Ago
Posts: 425, Visits: 2.7K
Everyone’s tests look amazing! I’m slammed at work so I’m sorry I haven’t had a chance to reply properly to your messages.

Marc: there’s lots of ways to fix this, but the best way is to make sure you’re settings your calibration pose properly before you record. Are you definitely doing that? No matter what shape your mouth makes when it’s β€œneutral”, it should then remember that. So no matter what your mouth does it should look good.

But yes it’s definitely possible to add more features to performance magik and I definitely will.

You can also use the curve editor in iClone to really easily achieve what you’re asking.

- - - - - - - - - - - - - - - - - - - - - - - - - - - - 
https://forum.reallusion.com/uploads/images/d11fc97b-7387-4f19-bb1e-0785.png
virtualfilmer.com | youtube

mtakerkart
mtakerkart
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 3.2K, Visits: 29.2K
mrtobycook (8/26/2023)
Everyone’s tests look amazing! I’m slammed at work so I’m sorry I haven’t had a chance to reply properly to your messages.

Marc: there’s lots of ways to fix this, but the best way is to make sure you’re settings your calibration pose properly before you record. Are you definitely doing that? No matter what shape your mouth makes when it’s β€œneutral”, it should then remember that. So no matter what your mouth does it should look good.

But yes it’s definitely possible to add more features to performance magik and I definitely will.

You can also use the curve editor in iClone to really easily achieve what you’re asking.


Thank you so much for your answer. It's better now with the calibration that I didn't find....

On other subject , I find this very interesting here :
http://filmicworlds.com/blog/solving-face-scans-for-arkit/

my knowledge being zero in programming I did not understand everything.
However he seems to say that the Arkit of the Iphone would have problems in certain situations.
"ARKit under-the-hood has a very specific meaning for each of the shapes. 
The solver on the iPhone expects the combinations of shapes to work a certain way. 
And there are many circumstances where two shapes are activated in a way that counteract each other.
 ARKit uses combinations of these shapes to make meaningful movements to the rig, 
but if the small movements in your rig don’t match the small movements in the internal solver 
then the resulting animation falls apart. 
And that’s why my previous tests of ARKit failed…"

I noticed that sometimes the livelinkFace did not reproduce the shape of my lips correctly.
If you have time to look, could you explain to me more simply what he modified in the ARKit?
Thank you 

https://developer.apple.com/documentation/ARKit/arfaceanchor/blendshapelocation


info_282760
info_282760
Posted Last Year
View Quick Profile
New Member

New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)

Group: Forum Members
Last Active: Last Year
Posts: 5, Visits: 31
Looks awesome, How can I try it out?
PavelTejeda
PavelTejeda
Posted Last Year
View Quick Profile
New Member

New Member (8 reputation)New Member (8 reputation)New Member (8 reputation)New Member (8 reputation)New Member (8 reputation)New Member (8 reputation)New Member (8 reputation)New Member (8 reputation)New Member (8 reputation)

Group: Forum Members
Last Active: Last Week
Posts: 1, Visits: 30
first of all! I want to say thank you very much for the plugin! it's a miracle! but... I have a problem. recorded in rokoko legacy. and I can’t convert the face using blender. Here's a mistake. tell me what to do? THANK YOU!)

mrtobycook
mrtobycook
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)Distinguished Member (2.8K reputation)

Group: Forum Members
Last Active: 2 Weeks Ago
Posts: 425, Visits: 2.7K
Unfortunately it only works in Rokoko studio - check out the help instructions here:

https://virtualfilmer.com/iclone-plugins/iclone-plugin-face-animation-importer-rokoko-face/


- - - - - - - - - - - - - - - - - - - - - - - - - - - - 
https://forum.reallusion.com/uploads/images/d11fc97b-7387-4f19-bb1e-0785.png
virtualfilmer.com | youtube

RowdyWabbid
RowdyWabbid
Posted Last Year
View Quick Profile
Junior Member

Junior Member (214 reputation)Junior Member (214 reputation)Junior Member (214 reputation)Junior Member (214 reputation)Junior Member (214 reputation)Junior Member (214 reputation)Junior Member (214 reputation)Junior Member (214 reputation)Junior Member (214 reputation)

Group: Forum Members
Last Active: Last Month
Posts: 12, Visits: 334
I have to say your plugin is awesome and I'm pretty chuffed with the results. I would definitely get Magik to support your endeavors. For some reason I can't get dollars or Accuface to run well but this just works for me and it's free. 😊

I made this pitch for funding and used your plugin to import the Livelink face data from my iPhone SE gen2.


1
...
8
9
10
11
12
13
14



Reading This Topic