MOCAP without owning an iPhone


https://forum.reallusion.com/Topic405725.aspx
Print Topic | Close Window

By Askjerry - 6 Years Ago
I do not own an iPhone... and I don't have any plans to get one.

I do have a webcam on  my Windows-10 PC...  I have a GoPro that can be plugged in as a high-resolution camera... and I have an Android phone.

Do I have any options for doing mocap... or is it strictly limited to only Apple users?

Thanks,
Jerry
By sonic7 - 6 Years Ago

That's a very good question ...
I'd be very keen to know the possiblities myself.
(thnx for posting Jerry)
By Kelleytoons - 6 Years Ago
Well, it's pretty silly (given the cost of the iPhone XR is under $500) but if you want to spend around $700 more you can get Faceware.  It's not nearly as good (I own both) but it WILL work and some folks like it a lot (I have not used it since I switched and I don't miss it any -- it's a PITA).  So total iClone cost is about $1300 (compared to around $600 or so for the iPhone solution -- I'd have to check the prices to be sure, so don't quote me.  But it's definitely more).

It will use your webcam (most likely -- needs a decent one but not extraordinary).
By nealtucker - 6 Years Ago
I posted on this before as I can not understand why Faceware is so expensive? maybe it's a licensing issue or something, if they got the price down I reckon they would clean up.
By Askjerry - 6 Years Ago
So I take it the current situation is that you either go out and buy an iPhone for $500 or so, or spend $1300 on iClone.
The video that shows off the mocap feature in the product announcement doesn't point this out. Additionally... if they can write the software for iPhone... they should be able to do an Android port... both have a camera, both can access WiFi... or use the Windows laptop built-in camera.

So... does it need to be an iPhone currently active? I can only speak from the Android world... but I have a couple of Androids that are older phones... not assigned to any wireless carrier... but I can still use WiFi to download software... so they get used as a function generator, etc on my workbench. can I get a cheap iPhone from eBay or something and use it as a dedicated mocap device without needing to register it with Apple service? Basically... like buying "mocap device". Is that possible? Or is your software limited to only active Apple users???

Just got the software (like 4 hours ago) so far not impressed by the lack of a major selling point.
Jerry
By Rampa - 6 Years Ago
The iPhoneX mocap is reliant on the Truedepth 3D infra-red sensor. Currently no Android phones have such a sensor.
By Askjerry - 6 Years Ago
Ahh... I see. So it must be not only an iPhone, but a specific model that has the infrared sensor.

Then I suppose that I'll have to either see if any of my friends have that phone, wait for a dedicated USB device, or simply realize that that feature is not available to me. :-(

Ok... back to animation with the puppet controls... which I'm fairly well versed with.

thanks,
Jerry
By Kelleytoons - 6 Years Ago
The iPhone does not have to have service.  Supposedly you can get one for $445 or so (I have no idea what the offer is like or what it means).  I would not live without my iPhones (both my wife and I own them) so I can't speak for anything else, but the quality of mocap is superb and would be worth switching even if I *was* an Android fan.
By animagic - 6 Years Ago
The iPhone does most of the necessary processing for Mocap, so it's not simply a matter for RL to write software for the Android or other device.

The price of FaceWare is dependent on whatever FaceWare charges, so RL has limited control over that. I got it for the introductory price which wasn't too bad.
By The-any-Key - 6 Years Ago
I was in your situation not so long ago.
I was thinking to try use my current equipment and buy Face-ware or Kinect. But as I read the reviews I did see a pattern of problems and bad results with the whole camera thing and that it involved so much cleanup work. So I ended up with an iPhone XR that I only use for mocap (are an Android person). And I am very happy with the result. The iPhone depth camera is very good at record your face. Note that you need a sim-card for it if you want to connect the iPhone via USB. Else it wont allow you to start tethering to enable the network connection between the PC and phone. But most people do use the wifi connection instead.
By Rampa - 6 Years Ago
If you buy the phone unlocked, you can get a free account from Freeup.com. They are an ATT MVNO, so actually useful if you want the voice line. Sim is a fiver.
By nealtucker - 6 Years Ago

I thought there was something going on with the pricing for Faceware, generally, although the Iclone add-ons are not cheap they are of a good standard and mostly keenly priced.

 
animagic (2/23/2019)
The iPhone does most of the necessary processing for Mocap, so it's not simply a matter for RL to write software for the Android or other device.

The price of FaceWare is dependent on whatever FaceWare charges, so RL has limited control over that. I got it for the introductory price which wasn't too bad.


By Askjerry - 6 Years Ago
It appears I just need to wait a bit longer... when I upgraded to CTA 3 it made me eligible for the new Cartoon Animator... and I just got this in email...

Cartoon Animator 4 WOW Features for Speed Production                                                                                                                                                                                                This year, Reallusion will launch Cartoon Animator 4 (CTA 4), the re-branded CrazyTalk Animator. With Smart IK and the 360 Head Creator, you can easily turn a 2D art into a 3D animation. Facial mocap using regular webcam makes your animation process even easier and is perfect for live shows on Twitch, YouTube and Facebook live.

So it looks like I'll have the ability by next month.
Jerry

                                       
By animagic - 6 Years Ago
Rampa (2/23/2019)
If you buy the phone unlocked, you can get a free account from Freeup.com. They are an ATT MVNO, so actually useful if you want the voice line. Sim is a fiver.

The link is: https://www.freeupmobile.com/.
By Ibis Fernandez - 6 Years Ago
Facial mocap aside, you can do body mocap using any means such as xbox kinect, theres several opensource packages out there, as well as some paid ones or hacked methods using those $3 playstation eye cameras. As long as you can get the VBH output you should be able to convert it to something compatible with CTA's G2 characters (using 3dxchange as part of the pipeline, VBHacker is free and can be used for re targeting and stuff like that if needed)
By Save the spaceman - 6 Years Ago
Hello guys
Just out of curiosity, is it possible to use the iPhone features with a "morph" head?
Thanks in advance
Jude
By Peter (RL) - 6 Years Ago
Save the spaceman (2/26/2019)
Hello guys
Just out of curiosity, is it possible to use the iPhone features with a "morph" head?
Thanks in advance
Jude


Hi Jude... Yes, iPhone Live Face can be used with Morph based heads.
By Save the spaceman - 6 Years Ago
Thanks Peter.
By Askjerry - 6 Years Ago
I can hardly wait to get the web-cam version rolling. I mean... simple things like doing a wave... you can puppet it... but how do you know the right frame movement? If I made a video of me waving... scaled it and put it in as a background... I could align the character over it... then delete the video. But being able to just go to that point in the video and wave... MUCH easier.

Tick Tock... come on folks... push that revision!
(At least I figured how to rig a very complex character [IMO] and it worked correctly... so I'm making progress.)


Jerry

By InfoCentral - 6 Years Ago
Ibis Fernandez (2/25/2019)
VBHacker is free and can be used for re targeting and stuff like that if needed)

I couldn't find a download site for that program?
By dogged2003 - 6 Years Ago
InfoCentral (3/2/2019)
Ibis Fernandez (2/25/2019)
VBVHacker is free and can be used for re targeting and stuff like that if needed)

I couldn't find a download site for that program?

http://bvhacker.com/

Happy IC :laugh:
By Anonymous2020 - 6 Years Ago
I hope that, this time around, the facial MOCAP in the new Cartoon Animator can be accomplished without $500 to $1,000 worth of third-party add-ons. (Reallusion has an unfortunate habit of being very vague of how much extra you will need to spend to get MOCAP running in their products.)