Profile Picture

Animate MetaHuman in Unreal with iClone Unreal Live Link

Posted By Charlene (RL) 4 Years Ago
Rated 5 stars based on 3 votes.
1
...
5
6
7
8
9
...
19

Animate MetaHuman in Unreal with iClone Unreal Live Link

Author
Message
cedric_119526
cedric_119526
Posted 4 Years Ago
View Quick Profile
New Member

New Member (12 reputation)New Member (12 reputation)New Member (12 reputation)New Member (12 reputation)New Member (12 reputation)New Member (12 reputation)New Member (12 reputation)New Member (12 reputation)New Member (12 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 5, Visits: 48
[quote]Bassline303 (7/8/2021)
Thx ,  I don't know if its all , but you forgot something to wire :)

   Thanks for noticing this, it however did not solve the problem.




Also , you can't use the head bones of the CC3 Character , you have to use the MH Dummy for this.
What you can do is to use the face key , face puppet or IPhone Live Face to make the head move around.

   Ok, cool, I didn't know that.  This part of the problem is solved.

If your ExPlus Expressions are still not working re-download the IC to MH Blueprints again and overwrite the old once in UE4 , RL did some updates on it , maybe you have the old one.

   I've just redownloaded and reinstalled the MH Blueprints, but still no exPlus expressions working

Thanks again for your help


7imprice
7imprice
Posted 4 Years Ago
View Quick Profile
Senior Member

Senior Member (287 reputation)Senior Member (287 reputation)Senior Member (287 reputation)Senior Member (287 reputation)Senior Member (287 reputation)Senior Member (287 reputation)Senior Member (287 reputation)Senior Member (287 reputation)Senior Member (287 reputation)

Group: Forum Members
Last Active: Last Year
Posts: 17, Visits: 158
Metahuman Livelink floating head:
I'm having a little trouble with my metahuman livelink setup. Everything works great but the head is floating outside of the body animation. Does anyone know how to correct this? Thanx
https://forum.reallusion.com/uploads/images/69517c36-88f1-433b-8b1e-676a.jpg
StyleMarshal
StyleMarshal
Posted 4 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 5.8K, Visits: 14.3K
7imprice (7/11/2021)
Metahuman Livelink floating head:
I'm having a little trouble with my metahuman livelink setup. Everything works great but the head is floating outside of the body animation. Does anyone know how to correct this? Thanx
https://forum.reallusion.com/uploads/images/69517c36-88f1-433b-8b1e-676a.jpg


be sure you have the face BP loaded :




deepak_270696
deepak_270696
Posted 4 Years Ago
View Quick Profile
Junior Member

Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 6, Visits: 100
Does this work for custom metahumans as well? Would they need any retargeting?
StyleMarshal
StyleMarshal
Posted 4 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 5.8K, Visits: 14.3K
deepak_270696 (7/12/2021)
Does this work for custom metahumans as well? Would they need any retargeting?


Works with custom MHs too , no retargeting needed. All Quixel MHs will work.

deepak_270696
deepak_270696
Posted 4 Years Ago
View Quick Profile
Junior Member

Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 6, Visits: 100
https://forum.reallusion.com/uploads/images/66876b15-8b44-4fff-809c-e753.png
Somehow I am unable to save the sequencer recording on "take recorder", on Unreal. It says graph is linked to object(s) in external map. It specifically gives the name of the metahuman and indicates hair as well. Any clues as to what could be wrong? Have spent a lot of time on this. Thanks very much for helping out!
PS: Here's what I found on the logs: Can't save ../../../../../../Users/deepa/Documents/Unreal Projects/JimKokoDemo/Content/Cinematics/Takes/2021-07-14/Scene_1_40_Subscenes/BP_ProfessorJim_Scene_1_40.uasset: Graph is linked to object GroomComponent /Game/StarterContent/Maps/Minimal_Default.Minimal_Default:PersistentLevel.BP_ProfessorJim_15.Hair (AttachParent) in external map

StyleMarshal
StyleMarshal
Posted 4 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 5.8K, Visits: 14.3K
Tick " No " and continue.
To avoid this , tick "possessable" (in the Take Recorder settings) when recording :

https://forum.reallusion.com/uploads/images/666fb897-513b-4479-a546-6adc.png
deepak_270696
deepak_270696
Posted 4 Years Ago
View Quick Profile
Junior Member

Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 6, Visits: 100
Thank you! That worked! One final thing I've been struggling with for the last hour and a half :-(
The head of my metahuman separates from the body. When I set the animation mode to use animation blueprint and set the facial animation blueprint, it gets resolved. However, when using take recorder, even if I set the face animation mode to use blueprint before recording, after the recording, I see it go to custom. And even if I make edits to one frame to fix it, other frames in the recording still have the face "severed". Its hard for me to manually go fix all frames in my recording. Any advice would be much appreciated. I've searched in the forum but couldn't find this exact issue with take recorder mentioned.  https://forum.reallusion.com/uploads/images/d2a394a4-125b-4460-9c91-49f5.png
StyleMarshal
StyleMarshal
Posted 4 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)Distinguished Member (14.4K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 5.8K, Visits: 14.3K
Do you mean this body problem ?

https://youtu.be/qvZmr22vdsU?t=43

There is also a new Video from Reallusion about Take Recorder :


deepak_270696
deepak_270696
Posted 4 Years Ago
View Quick Profile
Junior Member

Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)Junior Member (182 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 6, Visits: 100
Thanks to you all for helping me ramp up on iClone and on this project! 
I had a lot of issues getting ok FPS on the iClone to Unreal recording using "take recorder". Just following the things in the reallusion videos was not enough. I tried a whole bunch of experiments, and finally got it to work well! I now have 80fps in unreal and close to 60fps in iClone. I read on forums that a lot of people had similar issues. So, figured I'd pay it forward for so many of you helping me with my questions - by sharing some of the things I learned. 

(1) Settings on the nVIDIA control panel for the GPU - These make a huge difference. I changed the application settings for Unreal and iClone. Changed the power management mode to "max performance" instead of the default normal.  Changed the low latency mode to "ultra" instead of the default "on". My performance was being limited by Unreal fps, so I set a max frame rate for iClone fps so that both iClone and Unreal go above my threshold for being able to record.
(2) Turned off visibility for everything - Every single character and prop in both iclone and unreal was turned off. This burned less system resources and allowed greater FPS.
(3) 2k resolution vs 8k resolution for metahuman - did not make a difference to fps performance. I spent time exploring this option, thinking a lower resolution would improve FPS performance. It did not.
(4) Turned off fixed frame rate on unreal - my character was standing in one place. I read in one of the forums that this improves performance - people had data for that. 
(5) Transferred all props, characters and animations other than the metahuman using FBX transfer - the metahuman was the only one on live link. I added props and other characters and animations after the FPS sensitive metahuman recording was completed. Not sure how much benefit this gave, didn't do A/B testing on this. 
(6) All settings on unreal were set to low - for engine scalability, material quality, etc
(7) I also installed the nvidia's DLSS plug in which is supposed to improve GPU performance - don't know how much impact this made, but thought it wouldn't hurt. Didn't A/B test this with this transfer though. 
In addition, I tried all the other tips mentioned in the Reallusion video to boost fps: Unreal Live Link Plug-in Tutorial - How to Increase FPS - YouTube Also, my system configuration is Intel i9, nVIDIA GTX 3080, 64GB RAM, 1TB SSD. Wish I had an AMD Ryzen 9, that's supposed to be better vs the Intel i9 for these sort of things. 

1
...
5
6
7
8
9
...
19



Reading This Topic