How to Animate CC3+ Character with Unreal Live Link Face


https://forum.reallusion.com/Topic476282.aspx
Print Topic | Close Window

By Miranda (RL) - 4 Years Ago
From Character Creator v3.4, CC3+ Characters are equipped with ExpressionPlus (ExPlus) blend-shapes which include ARKit blend-shapes. The support of ARKit blend-shapes makes CC3+ Character fully compatible for 3D tools with iPhone facial capture capability, such as Unreal Engine and Unity. 

Required Tools
  • Character Creator 3.4 or above; iClone 7.9 or above (3DXChange 7 Pipeline required)
  • Unreal Live Link Face
  • Character Creator & iClone Auto Setup 1.2 for Unreal 
  • Live Link Face sample files (DOWNLOAD HERE)
    • ExPlus_Remap.uasset (replace ExPlus blendshape to LLF)
    • LLF_AnimBP_Sample.uasset (map to the LLF animation)

Note: iClone Unreal Live Link and Unreal Live Link Face cannot work on the same character simultaneously.

Official Tutorial:


Walkthrough Tutorial (no dubbing):


Step 1: Check if your CC3+ Character has ExPlus blendshapes.
If it's not, please check HERE to make your existing characters to support ExPlus blendshapes. 
https://forum.reallusion.com/uploads/images/c8bef046-83e6-40de-b68a-3ae3.png

Step 2: Connect to Unreal Live Link Face:
https://forum.reallusion.com/uploads/images/5ed21f20-b6bc-4d4a-8345-0be5.png

Step 3: Copy LLF_AnimBP_Sample.uasset to your character folder:
https://forum.reallusion.com/uploads/images/a9f40cf8-fd47-46c3-ad22-df5f.png

Step 4: Re-target to your character by right-clicking on the Anim blueprint:
https://forum.reallusion.com/uploads/images/4cb78c23-8609-45fa-99dc-d319.png

Step 5: Remap ExPlus to Live Link Face:
  • Double-click on Anim blueprint.
  • Go to AnimGraph and select Live Link Pose.
  • Choose your iPhone device and set the re-target assets to ExPlus.
https://forum.reallusion.com/uploads/images/7222eb02-1bd0-4807-84d1-14ad.png

Step 6: Assign jaw/head animation.
Double-click anim blueprint, go to Event Graph, and choose your iPhone device:
https://forum.reallusion.com/uploads/images/dd3559ce-f195-4ba7-b7f7-1a00.png

Step 7: Drag the Anim blueprint to the scene, and enable Update Animation in Editor.
https://forum.reallusion.com/uploads/images/cd7f4e7a-fbb9-465a-baec-d027.png

By vadim+2 - 4 Years Ago
Great tutorial, worked like a charm!
Want to mention that at some point, you will need to do a calibration for your character, here is a great tutorial I found online that helps with it - video
By donmeeet - 4 Years Ago
i might be missing something but i have an issue
im only getting jaw open and eye rotation in my character
no other part of the face is moving
is there anything im missing?
By StyleMarshal - 4 Years Ago
Sounds like you didn't Remap :  
  • ExPlus_Remap.uasset (replace ExPlus blendshape to LLF)
Above on the right , put the ExPlus inside :

https://forum.reallusion.com/uploads/images/e47de684-dd0d-422f-8da9-c78c.png

Also be sure you imported the CC3 Character with the new Arkit morphs.(ExPlus)

Works for me , but as Vadim+2 said , you have to calibrate some curves and the jaw bone to get good results.


By Ghetzi - 4 Years Ago
Bassline303 (3/30/2021)
Sounds like you didn't Remap :  
  • ExPlus_Remap.uasset (replace ExPlus blendshape to LLF)
Above on the right , put the ExPlus inside :

https://forum.reallusion.com/uploads/images/e47de684-dd0d-422f-8da9-c78c.png

Also be sure you imported the CC3 Character with the new Arkit morphs.(ExPlus)

Works for me , but as Vadim+2 said , you have to calibrate some curves and the jaw bone to get good results.




I'm having the same issue and did the remap.  Great results with mouth, eyebrows, eyes, but no head movement.  Doubled checked the checklist, not sure what I missed.  Any ideas?

UPDATE:  For anyone else with this issue, go into the Live Link Face app and make sure to enable "Stream Head Rotation" in the settings.  Works perfectly now!

By thesnowcult - 4 Years Ago
I've updated my character the ExPlus in CC3 3.4, I've also installed the latest Auto Setup in my project.
For some reason, only the jaw moves, no other facial movements. Just the jaw opening and closing (and head moving around).
By lianchiu - 4 Years Ago
Try this Tutorial to see if it helps!
By yazata3d - 4 Years Ago
Cant choose ex_plus, i click on it but it changes back to "none"
all do like in video pls help!
By lianchiu - 4 Years Ago
were you using CC3+ Base Character?
By StyleMarshal - 4 Years Ago
With the UE4.27 release there will be an "Auto Calibration" for the Live Link Face App.
Till it is released you can do it manually like in this video :


By entropychef - 4 Years Ago
I am experiencing the same issue. The model definitely has everything and I've gone through this 5x. Everything is good right up to getting the dropdown to appear. It doesn't.
I try and select ExPlus_remap and it reverts dropdown to "none".
The model was previously worked on with Substance Painter Pro - would that make a difference?
I'm stuck. Every step has been followed and happy to share my project. 
https://forum.reallusion.com/uploads/images/04fcb445-047c-4efe-8512-d55f.jpg

By ccw0511 - 4 Years Ago
I have a same issue, using CC3+ still cant make it
By bo-ba - 4 Years Ago
It worked the first time I tried it, but the in another project I am facing the issue of Explus_remap going back to NONE in the Retarget Asset Dropdown --  just like other guys were.

The log says the following

EditorErrors: Error: Failed to load class /Game/LLF_Sample/ExPlus_remap.ExPlus_remap_C

Any clues on how to fix this path problem?

Thanks.
By sam_716445 - 4 Years Ago
You need to open up the actual ExPlus_remap and just resave / compile it and it will start showing up
By brian_52_80 - 4 Years Ago
I'm having the same issue with no blendshapes coming through, only the eye rotation and jaw movement. I noticed that the exPlus_remapu.asset file is empty. I've downloaded it 3 times to be sure, but there's nothing in there. I don't know if that's the problem or not.
By mindless.code - 4 Years Ago
i had the same issue, till i checked to see if my character was indeed cc3+

you'll need to ensure that it's using the facial profile that they mentioned in the link here
https://forum.reallusion.com/476420/Whats-New-in-Character-Creator-34#bm476426


By josemojica - 3 Years Ago
Any chance these blueprints have been updated for CC4 characters?

ExPlus_Remap.uasset (replace ExPlus blendshape to LLF)
LLF_AnimBP_Sample.uasset (map to the LLF animation)

Thanks!
By sterlingy - 3 Years Ago
josemojica (7/15/2022)
Any chance these blueprints have been updated for CC4 characters?

ExPlus_Remap.uasset (replace ExPlus blendshape to LLF)
LLF_AnimBP_Sample.uasset (map to the LLF animation)

Thanks!


I would also like to see an update. I have been redoing the REMAP, but there seem to be many blendshapes in ARKit that I can't figure out how to remap because they might require several CC4 morph targets to be animated. 

ARKit has a cheek blow blendshape, but CC4 needs data applied to cheek left and cheek right. How can this be accomplished?

Frankly, with all the other amazing things and integration that RL has brought to UE4, I'm kind of surprised they haven't set this up. They probably have it internally for their own use.

-Sterling
By Ibis Fernandez - 2 Years Ago
Can CC4 characters not be used for this process? It seems that characters that use the cc4 profiles don't work, while older characters work fine. Is there something I'm missing or are we stuck having to make our characters for cc3?
By cynsegura - 2 Years Ago
Many thanks for this great tutorial. Is it possible to use Unreal live link face with cc4 characters with the better profiles than 3 plus with the wrinkle system? Any advice. I need without using the live link from reallusion that I don't have it.
Many thanks for your time.
By cynsegura - 2 Years Ago
Many thanks always for your great participation in this group!
I was following all the tutorials. I was placing the explus, do retargeting and remap. I placed a video of elf man Have a look at this. It doesn't move the neck and doesn't open the jaw. Do you know what it can be? Click here to see the problem
Elf man : there are errors in the movement of the jaw, does not open and close the mouth, only the movement of lips and eyes works. - does not move the neck. Here it is the character with the blueprint. I was using for all of them unreal 5.2.1 and iphone 10 and i have windows 10 operative system PROJECT FILE IN UNREAL WITH BLUEPRINT AS IT IS EXPLAINED IN INSTRUCTIONS FROM TUTORIALS. https://drive.google.com/file/d/1Iz9CQDiIOMUyO2753E9a9XgDcPjSgf5K/view?usp=drive_link  Female elf : only have jaw and neck movement. Does not capture eye and lip movement https://drive.google.com/file/d/1HzSXseypDwmvxBhZ2JB68oTIOL95IbvO/view?usp=drive_link Many thanks!!! 

By info_282760 - 2 Years Ago
I noticed in the offline capture data the bone names don't match the remapped names. I got it to work by matching the remapping to the bone names.
By info_282760 - 2 Years Ago
I noticed in the offline capture data the bone names don't match the remapped names. I got it to work by matching the remapping to the bone names.