English


Profile Picture

Rokoko Animation to iClone - Dancing couple

Posted By s.app Last Year
You don't have permission to rate!

Rokoko Animation to iClone - Dancing couple

Author
Message
s.app
s.app
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 108, Visits: 1.7K
Hello everyone,I have the problem that animation recorded using Rokoko Mocap is not displayed in iClone as it was recorded.

The following information about my software versions:
1) iClone 7.93
2) 3DXChange 7.81
3) Character Creator 3.44

I recorded a dancing couple with the help of Rococo Mocap.The animation was exported and converted using 3DXChange and transferred to iClone.I also created two characters with CC3 (approximate size of the two people) and transferred them to iClone.I then assigned the animation to the characters.

The result, compared to the original animations from Rokoko (FBX simply inserted into iClone via drag & drop --> white dummy characters), looks like this:

Frame 7
73% of original size (was 687x397) - Click to enlarge
Frame 174
73% of original size (was 687x397) - Click to enlarge

Problem:
The step size seems too big. My two CC3 characters are too far apart.
No matter how I resize my characters in CC3, the animation doesn't change. Or the characters don't come closer together.

Can someone tell me how I can make it so that, analogous to the original animations (white dummy characters), I can transfer this to my other CC3 characters.
If possible, describe the route in detail.
Or is there already a tutorial that I couldn't find.

Many thanks in advance

Stephen
4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 5.3K, Visits: 16.6K
First, try to identify where the problem is - retargeting or character scaling.
While exporting a motion from 3DX check "Export Geometry" as well.
Then apply created dummy character, apply exported motion and compare with the dummy prop (from FBX drag/drop).
You may want to zero out location for both - dummy character and dummy prop to make sure they occupy the same space.
If they do not match substantially, then you have a problem with bones re-targeting.

And if they do match, replace dummy with real character and compare proportions while dummy and a character occupy the same space.
You may just need to shorten the legs (to match steps) and extend arms (for hands contact) in CC.





s.app
s.app
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 108, Visits: 1.7K
Hello,
thanks for the tipps.
I brought my character and also the dummy (actually a prop) to the same position with Reset (Zero out).
73% of original size (was 687x397) - Click to enlarge
Frame 7 now looks like this
73% of original size (was 687x397) - Click to enlarge

Frame 172 like this.
73% of original size (was 687x397) - Click to enlarge
It looks like the foot positions are correct.

However, the CC3 character seems to have tipped backwards.
Thinking if I could get my CC3 character's tilt forward and maintain the foot position, then that might be the solution.

How can I correct that?

Stephan
4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 5.3K, Visits: 16.6K
With CC character it would always be a mismatch.
But again, you need to identify the source of the problem.

Did you verify the dummy character vs dummy prop match?
If bones are mapped correctly there should be a minimal discrepancy.

Like this one. Red is a dummy prop and white is the dummy character. I consider this a successful re-targeting.
73% of original size (was 687x397) - Click to enlargehttps://forum.reallusion.com/uploads/images/317c5938-160e-44a3-82c1-5b01.jpg
Do you have the same match?

If it matches, then you probably want to use a Pose Offset in CC to tweak the posture of your characters.
Also in 3DX there a Hip Offset control you may use before hitting "Convert" (not sure if it's going to help much)
73% of original size (was 687x397) - Click to enlargehttps://forum.reallusion.com/uploads/images/34254942-12e7-45bc-9216-d34d.jpg


But if dummies upper body do NOT match at all, you need to redo the bone mapping. Maybe you missed one spine bone.




s.app
s.app
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 108, Visits: 1.7K
Hello,
I'm sorry, but I don't think I fully understand what I should do exactly (unfortunately I'm still inexperienced with iClone)

Currently I'm using CC3 characters and Rokoko's animation
When exporting from Rokoko, I can choose between the following export options
HumanIK, Mixamo, iClone
However, they all look the same to me.
Which one should I use?

I've now used HumanIK
First I dragged and dropped the animation into iClone.
Then transferred my customized CC3 character and assigned the previously converted animation via 3DXChange (with Export Geometry).
I use this setting. Is that right?


Then I reset both with (Reset Zero Out).
Then it looks like this:

It doesn't match like it did for you.
How do I get that fixed?

But if I understood it correctly, it should look like this:
Correct this manuelly.
    
Frame 7 looks like that


"However, if the dummy's torso does NOT match at all, you will need to repeat the bone mapping. You may have missed a spinal bone."
What exactly do I have to do? And where exactly can I do that?
Unfortunately I don't know how and where to do the retargeting!

Where do I actually get the dummy character so that it looks exactly like the prop?

Best regards
Stephan


4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 5.3K, Visits: 16.6K
I've now used HumanIK
First I dragged and dropped the animation into iClone.
Then transferred my customized CC3 character and assigned the previously converted animation via 3DXChange (with Export Geometry).

So this is the key. I understand you just select "Maya Human-IK" profile for conversion (another word for it is retargeting or bones mapping).
There is also Custom - manual bones mapping option which I thought you are using.

But anyway, each time you select "
Export Geometry" a dummy character is created in Custom Avatar content section.
And they usually named the same as a motion clip.
73% of original size (was 687x397) - Click to enlargehttps://forum.reallusion.com/uploads/images/4cd206a2-b51b-4815-a835-c4fb.jpg
Check it, you probably have quite a few by now. Those I meant to be compared with dummy props.
See if that matches.

Otherwise I'd say it would be a quite a tough job to couple them together precisely.
I've never seen any tutorial about the subject as it might vary greatly from case to case.
In your case it would mostly involve setting a matching posture for upper torso bones (in both IK and FK modes) on first animation staring frame (not T-pose frame).





s.app
s.app
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 108, Visits: 1.7K
Hi,
thanks for the informations.
After I use the Mixamo-Export-Animation, the Prop and the dummy match pretty good.

Frame 7:



Frame 174



Thanks for this important step.

Aber irgendwie klappt's mit dem CC3-Charakter immer noch nicht.
After Reset (Zero Out)
        

I'll test it further tomorrow.

I would be grateful for further tips.

Thank you once again.

Stephan


s.app
s.app
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 108, Visits: 1.7K
Hello everyone,
I need more help again.

After exporting the animation in Rokoko and importing it into Iclone, I tried to set almost the exact size in CC3. Unfortunately, I can't do this 100%.
So I suspect that my character doesn't follow the actual animation exactly.
For the CC3 character I then set the Hip Offset Forward value to -41% using 3DXchange.


The positioning of the animation/character looks quite good when I assign the animation to the character and press reset (zero out).

73% of original size (was 687x397) - Click to enlarge
Unfortunately my character doesn't seem to completely match the animation.
Actually I should correct the X position to -1,700. However, that doesn't help.
In later frames my character runs away from the animation.



Here too I would have to constantly correct the X and Y positions, which is too time-consuming.
Isn't there a way to align my character with the dimensions of the animation so that they match exactly?

What else should I change in CC3 so that I can get a better result?
I tried various things, but unfortunately without success.

Is there actually the option in CC3 to set the Hip Offset Forward to -41% so that I don't always have to use 3DXChange?

Can someone help me here?
Does anyone have the same problem with animations from Rokoko and has a different solution?

Thank you very much

Stephan








Reading This Topic

0 active, 0 guests, 0 members, 0 anonymous.
No members currently viewing this topic!