Profile Picture

Motion capture with a video only

Posted By mtakerkart Last Year
You don't have permission to rate!
1
2
3
4

Motion capture with a video only

Author
Message
4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)

Group: Forum Members
Last Active: 10 days ago
Posts: 5.3K, Visits: 16.7K
Have you looked at this?
https://courses.reallusion.com/home/iclone/character-motions?product=iClone&version=8&keyword=motion+correction&v=iclone-8-tutorial-motion-correction-for-footstep-and-handprint




mtakerkart
mtakerkart
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 3.2K, Visits: 29.2K
Kelleytoons (9/2/2024)
I'd advise folks to try the freeware Rokoko Vision.

It works pretty solid and unlike a lot of other solutions is COMPLETELY free (no limitations on anything).  It will work with a video or a webcam.

(They DO have a paid version but it works with two cameras for better capture.  But the single camera version is pretty damn good.  You should at least check it out - it comes into iClone just fine with no fiddling at all if you use the Mixamo export).


Thank you Kelleytoons. I made a trial and the one cam is a completely mess. The problem for me with 2 cam features enforce to have a PC online on set . That's not my case.

Rokoko one cam



I send them an email to make 2 cam record offline.

I redo a test with meshcapade but this time with a more marked gait. Little bit better but I REALLY need more explanations
with the motion correction. The user manual doesn't help... Yes the feet are not slidding any more  but  they are stuck like magnets.


Kelleytoons
Kelleytoons
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (37.8K reputation)Distinguished Member (37.8K reputation)Distinguished Member (37.8K reputation)Distinguished Member (37.8K reputation)Distinguished Member (37.8K reputation)Distinguished Member (37.8K reputation)Distinguished Member (37.8K reputation)Distinguished Member (37.8K reputation)Distinguished Member (37.8K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 9.2K, Visits: 22.1K
I'd advise folks to try the freeware Rokoko Vision.

It works pretty solid and unlike a lot of other solutions is COMPLETELY free (no limitations on anything).  It will work with a video or a webcam.

(They DO have a paid version but it works with two cameras for better capture.  But the single camera version is pretty damn good.  You should at least check it out - it comes into iClone just fine with no fiddling at all if you use the Mixamo export).



Alienware Aurora R16, Win 11, i9-149000KF, 3.20GHz CPU, 64GB RAM, RTX 4090 (24GB), Samsung 870 Pro 8TB, Gen3 MVNe M-2 SSD, 4TBx2, 39" Alienware Widescreen Monitor
Mike "ex-genius" Kelley
sunnyviewtech
sunnyviewtech
Posted Last Year
View Quick Profile
Senior Member

Senior Member (351 reputation)Senior Member (351 reputation)Senior Member (351 reputation)Senior Member (351 reputation)Senior Member (351 reputation)Senior Member (351 reputation)Senior Member (351 reputation)Senior Member (351 reputation)Senior Member (351 reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 27, Visits: 459


With our monocular camera-based motion capture software, Dollars MONO,
you can also capture motion in real-time from a camera or video file and transfer the motion capture data to iClone.
We also support facial and finger capture.
mtakerkart
mtakerkart
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 3.2K, Visits: 29.2K
4u2ges (9/2/2024)
I made that profile. Most any FBX files have a rest pose as T-pose.
So I imported fbx from MoCapade to Blender (export Unreal without blend shapes option form MoCapade), switched to the Rest pose and exported without baking animation.
Then imported to CC, in Characterization tweaked bones to have the Unreal T-pose look more like an RL T-pose (hardest part - specifically for fingers).
And then mapped bones and saved 3dx profile as custom.

Regarding feet slide, I have more or less stable routine working with reach targets.
It is pretty much similar to Motion Correction, only manual where I have more control over it.
I have 2 same characters with same movement where I move feet of one character with mostly L/R Reach objects (actively using transition curves)
while having second character as a reference and trying to match planted foot without sliding.

I do not have a video of a process itself, but I have a video of a result.
And yes, although it's time consuming, the achieved result can be perfect with zero sliding.




Thank you again , now it's very easy to import in Iclone. 
Meshcapade is in beta so I imagine they will refine the sliding issue.
There is still some 
root jittering   but the result is quite encouraging considering the simplicity of the mocap.


AutoDidact
AutoDidact
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 2.1K, Visits: 13.6K
I Installed the Desktop Meshcapade app on my Imac
several months ago
the FBX files retarget great with my Blender ARP rigs 




RAG DOLL COLLISION ANIMATIONS FOR ICLONE 8 & 7
---------------------------------------------------------------------------------------------------------------------
Ghost Origins
My latest Feature length film created with Iclone.
93% of original size (was 540x16) - Click to enlargehttps://forum.reallusion.com/uploads/images/adf9b210-df59-4cb6-aa1b-9de5.jpg
My Sci- Fi Graphic Novel on Amazon: https://a.co/d/9k3cwoY


4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)

Group: Forum Members
Last Active: 10 days ago
Posts: 5.3K, Visits: 16.7K
I made that profile. Most any FBX files have a rest pose as T-pose.
So I imported fbx from MoCapade to Blender (export Unreal without blend shapes option form MoCapade), switched to the Rest pose and exported without baking animation.
Then imported to CC, in Characterization tweaked bones to have the Unreal T-pose look more like an RL T-pose (hardest part - specifically for fingers).
And then mapped bones and saved 3dx profile as custom.

Regarding feet slide, I have more or less stable routine working with reach targets.
It is pretty much similar to Motion Correction, only manual where I have more control over it.
I have 2 same characters with same movement where I move feet of one character with mostly L/R Reach objects (actively using transition curves)
while having second character as a reference and trying to match planted foot without sliding.

I do not have a video of a process itself, but I have a video of a result.
And yes, although it's time consuming, the achieved result can be perfect with zero sliding.






mtakerkart
mtakerkart
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 3.2K, Visits: 29.2K
Wow! Cool it works. Where did you find it ?

For the slidding foot I didn't see descent tutorial. Only this one wich assume that motion correction detect all the foot contact.
But in my case it detect only 2 positions of my right foot.



4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)

Group: Forum Members
Last Active: 10 days ago
Posts: 5.3K, Visits: 16.7K
I was actually referring to custom 3dx profile for direct import of MoCapade Unreal fbx into iClone and CC.

But I made one anyway. Just drop it to C:\Program Files\Reallusion\iClone 8\Program\Assets\Share\CharaterizeProfiles
and  C:\Program Files\Reallusion\Character Creator 4\Program\Assets\Share\CharaterizeProfiles
Then it will be fetched and applied (after IC/CC restart):

93% of original size (was 540x16) - Click to enlargehttps://forum.reallusion.com/uploads/images/a4141aca-ed36-4038-b18d-f9b6.jpg

Foot sliding notorious for any mocap (not to mention from a video).
Unless they come up with reliable AI foot planting, it's just a toy or can only be used while hiding feet with camera.
Or else a lot of manual work with reach targets would require (not with motion correction - which is another toy).




Attachments
MeshCapadeMe.zip (34 views, 1.00 KB)
mtakerkart
mtakerkart
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)Distinguished Member (16.8K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 3.2K, Visits: 29.2K
4u2ges (9/1/2024)
Interesting. Did you make a .3dxProfile for importing into IC/CC FBXs exported directly from MoCapade?



I don't have the option to export to 3ds file, only unreal.

93% of original size (was 540x16) - Click to enlargehttps://forum.reallusion.com/uploads/images/476f2319-275e-4666-84af-f58d.png

As I feared, there is a problem of foot slidding, and I cannot correct it with the motion correction.
I willingly kept my right foot as a pivot because even with my neuron mocap it is a recurring problem.





1
2
3
4



Reading This Topic

0 active, 0 guests, 0 members, 0 anonymous.
No members currently viewing this topic!