Cartoon Animator 4.2 & Motion LIVE 2D 1.1 Leak


https://forum.reallusion.com/Topic432801.aspx
Print Topic | Close Window

By Ola(RL) - 6 Years Ago
To All Cartoon Animator Users


This thread will be about the Work In Progress videos of Cartoon Animator 4.2 and Motion LIVE 2D 1.1


------------------------------------
Posted on the 8th of April, 2020


This is the first video for CTA body mocap warm up.
As you can see in this video, the animated character (from Warwick Hays) is not yet moving forward in-time with the performer, but you will see this in action in the next video.



------------------------------------
Posted on the 27th of February, 2020



This is the final video for CTA hand mocap warm up. Then we move on to 2D Body Mocap. 






------------------------------------

Posted on the 29th of January, 2020



After the hands, now we move on to elbows.






------------------------------------

Posted on the 21st of January, 2020


The third video is here for you to comment.





------------------------------------

Posted on the 15th of January, 2020



Time for the second video.




------------------------------------
Posted on the 8th of January, 2020

Check out the first video.


Hope you will like what you see.

BR,
Ola
By scribbley3rd - 6 Years Ago
Looks very promising and it'll be nice to finally use my leap motion for something constructive :)  Glad I kept it now.    Also glad that with the newer patches for me CTA has become more stable on mac which is too a good thing. :) I think when these features are added V4 will finally be that leap forward for me :) 

Happy to help test if ever needed with leap motion testing. :)  I do wonder if the leap motion could be used to add full body puppeteering to CTA4.  Link finger movement to bones like hands and even feet and then move them around to move limbs around in a 2D space.  Imagine running on the spot with your fingers and watch legs follow the movement etc with a little help from IK.  If finger movement is possible it's def possible to add this in the future with a little creative thinking.  I had my leap since day one (kickstarter) so have had a fair few years experience playing with it. :) 

Great work on this. :) 
By garylearntech - 6 Years Ago
Hi Ola - this is, of course, good news.  But I'm wondering is we Mac users are going to be disappointed?  Like scribbley3rd, I've had a Leap Controller for many years - but it's been uninstalled for a long time.  When I looked at their site recently, I discovered that while their Windows driver software had reached v4, the Mac equivalent was never developed beyond v2.  In fact, under the "What's Included?" tab, they actually say "Minimum system requirements (desktop): Windows 7+ or Mac OS X 10.7 (note that OSX is no longer formally supported);…".

It would be great if those v2 drivers would support your integration with CA4, but I've been in this game long enough to know not to hold my breath…
By brothertcoleman - 6 Years Ago
Got my Leap Motion Controller recently and willing to do some Beta testing if needed also.
This looks great and is something I’ve been waiting for besides the Kinect V2 for CTA4.
By valeriacora - 6 Years Ago
Will the Leap Motion Controller be mandatory to control hand's movement?
By brothertcoleman - 6 Years Ago
When I was looking closely at the video ,it showed a Perception Neuron hand option also.
By brothertcoleman - 6 Years Ago
Very impressive videos, this will take CTA4 to another level.
Hurry up and take my money before my wife spends it on bills,groceries and stuff like that.
By brothertcoleman - 6 Years Ago
Will this be available for free bone projects also?

Thanks Tim
By vidarshanan_225066 - 6 Years Ago
when it will be available 
By Ola(RL) - 6 Years Ago
I dare not to say.
Hopefully before June 2020.
By wu_tone - 6 Years Ago
Nice! Please let us know what the mandatory requirements for this are...!? I believe someone had asked and I kept coming back here to see if any reply was given toward the first request.... But from what I keep seeing, this LEAP motion gadget is mandatory for this to work alongside of the LIVE 2D plugin, correct? Want to know so I can get this bad boy as soon as it drooooooops! Thanks
By o2u - 6 Years Ago
I want to join a beta test program if RL has.
How do you think everyone?
By the way, I have already purchased Leap Motion:P:P:P
By feelingood - 6 Years Ago
Hi, is it possible to use two same hands, like two people shaking hand or saying cheers with drinks? or is it limited only to the left and right hand?
By wu_tone - 6 Years Ago
It's been 3 months and I still haven't received a response to my post, SMH
By kungphu - 6 Years Ago
@wu_tone

I would quote your post but you’ve got a command line to repeat scroll for some strange reason in your response. RL is probs still working on this if I had to guess they’re trying to tinker with Leap Motion to see how usable it is and refine it before stating too much.

As it stands now LM is part of motion live for Iclone and it works great as a finger capture device. It can capture up to elbows which are shown on the videos here. In iclone it’s hit or miss capturing forearms and using IK to move the rest of the body parts around. But that’s where it stops. There is no additional capture from LM.

The first vid clearly shows a full Mocap suit, looks like Perception Neuron Pro or Studio without the gloves. I’d venture that you’ll need that for full body motion capture. The LM you place on your desktop and move your hands/arms around it. Can’t see a way that would include full body like a walk cycle, jumping kicking etc. They would have tried that in iclone already.

Motion live will probs support both devices, but LM will be limited to finger, hand and forearm movement maybe up to the shoulders and such if they can figure a way to work that, but no way full body mocap. However, if they are able to translate 3D motions to 2D that’s great news because we “should” be able to use 3D imotions with the new gen characters like you can with Gen 2 characters. That’s pretty cool and will open some doors!
By wu_tone - 6 Years Ago
kungphu (4/25/2020)
@wu_tone

I would quote your post but you’ve got a command line to repeat scroll for some strange reason in your response. RL is probs still working on this if I had to guess they’re trying to tinker with Leap Motion to see how usable it is and refine it before stating too much.

As it stands now LM is part of motion live for Iclone and it works great as a finger capture device. It can capture up to elbows which are shown on the videos here. In iclone it’s hit or miss capturing forearms and using IK to move the rest of the body parts around. But that’s where it stops. There is no additional capture from LM.

The first vid clearly shows a full Mocap suit, looks like Perception Neuron Pro or Studio without the gloves. I’d venture that you’ll need that for full body motion capture. The LM you place on your desktop and move your hands/arms around it. Can’t see a way that would include full body like a walk cycle, jumping kicking etc. They would have tried that in iclone already.

Motion live will probs support both devices, but LM will be limited to finger, hand and forearm movement maybe up to the shoulders and such if they can figure a way to work that, but no way full body mocap. However, if they are able to translate 3D motions to 2D that’s great news because we “should” be able to use 3D imotions with the new gen characters like you can with Gen 2 characters. That’s pretty cool and will open some doors!




Thank you for the response. I'm aware of the gear that may be used with this plug-in feature. I just wanted to know if the LEAP controller was mandatory so I could make the decision to invest in getting the controller now or wait until more concrete details are provided about this. Did some due diligence on the LEAP controllers available as they have several different types out. Some of the feedback on the controller itself resulted in some very buggy performance issues. I'm glad everything did actually pan out the way it did now because I don't want to fall victim to making any hasty decisions

By Garry Pye (RL) - 6 Years Ago
I have added your name to the list of volunteers for the Beta Testing program. If you are successful, you will be notified by Reallusion. Thanks for your interest. 
By kungphu - 6 Years Ago
@wu tone

You’ll definitely need the Leap Motion controller for live capture unless you go with a full body suit. The LM is just for the hands. Keep in mind over the sample vid shows the character moving their head and neck, but they also clearly show that is head tracking via a separate app. I believe that will be via live face, so if you have a recent iPhone you’re in luck! You’ll just need a LM controller. This still won’t give you full body mocap. But this ability to use mocap “should” mean you can purchase iclone 3D motion packs and apply them to the new gen G3 characters which is beyond friggin awesome!


@Gary Pye

Hey Gary, don’t know you but your work is great! I don’t use Animator often, I’m trying to get into it more. Made a few short vids. One thing to really bring me into the mix is full body control similar to what you could coax with the G2 characters and imotions. I do a lot of mocap work with Perception Neuron and iClone. My signature link will take you to my YT channel. All the animations there are a mix of mostly PN, key frames and mangled imotions. I’d be interested in Beta Testing as well to give it a whirl and help work out the kinks from a PN standpoint. I have a Gen 1 32 Neuron Suit and a new PN Studio with gloves that I can use to test. Thanks!
By wu_tone - 6 Years Ago
kungphu (4/28/2020)
@wu tone

You’ll definitely need the Leap Motion controller for live capture unless you go with a full body suit. The LM is just for the hands. Keep in mind over the sample vid shows the character moving their head and neck, but they also clearly show that is head tracking via a separate app. I believe that will be via live face, so if you have a recent iPhone you’re in luck! You’ll just need a LM controller. This still won’t give you full body mocap. But this ability to use mocap “should” mean you can purchase iclone 3D motion packs and apply them to the new gen G3 characters which is beyond friggin awesome!



Absolutely Kungphu,

I wish I could get hands on a mocap motion suit. Seen several videos and have also been eyeing them here and there trying to figure out why there are so many of them and why they're also so darn expensive. Unfortunately, I don't own an iPhone so I'm counted out for LIVEFace software.

Seen your Youtube video by the way, looks pretty awesome.
By kungphu - 6 Years Ago
Agh!!’ Bummer on the iPhone. Maybe find a used one on eBay or something? Don’t need cell service just WiFi connection. As far as mocap, that stuff is usually hella expensive. These perception Neuron suits are really cheap for full body mocap, relatively speaking. They come up on the used market from time to time. Should still be able to get customer service even if they’re used. Noitom is actually really good with customer service. At first it was hard to get ahold of them since they were based overseas. They do have limitations with magnetism though.
By Garry Pye (RL) - 6 Years Ago
Hey Kungphu, I checked out your Youtube video. I really like your camera work. And I see what youre doing with motions. Drop me an email at garrypye@reallusion.com to say hi and if theres anything i can do to help, just let me know.
By Peter (RL) - 6 Years Ago
wu_tone (4/24/2020)
It's been 3 months and I still haven't received a response to my post, SMH


Hi Wu_Tone

This thread was intended as sneak peak at what we have coming for CTA4 in 2020. Unfortunately as development is still ongoing it is not possible to answer questions until the information is finalised. I'm sure you would agree that giving wrong information or information that may change is not a good idea. However, you can be sure that when we have more news to share we will do so.

Regarding Leap Motion, this will be required for hand animation but the final list of supported hardware will be coming nearer to release.
By o2u - 6 Years Ago
Which device is used on this new video?
Will it be supported on new version?
By jp_784895 - 6 Years Ago
How disappointing...... not available for mac users!
By zephyrrr - 6 Years Ago
I too am very disappointed that this isn't available for mac users. :( Is this due to hardware compatibility issues? I hope this is not a sign of things to come. 
By garylearntech - 6 Years Ago
@zephyrrr - see this new document in the Reallusion FAQ's: Is there a Mac version for the Leap Motion Profile?

The last Mac driver released for the Leap Motion device came out in August 2015.  Mac development was then abandoned - this is not Reallusion's fault.  I expect that if Ultraleap were to change their current stance ("note that OSX is no longer formally supported") and produce a driver in sync with the Windows one, then Reallusion would jump on it.  Why would they not?
By maskedsonic - 6 Years Ago
Ultra leap tweeted " Our V2 software is compatible with MacOC" 
https://twitter.com/ultraleap_devs/status/1258020493787041792


By scribbley3rd - 6 Years Ago
Really disappointing to see the mac not being supported with leap motion.  So I take it Reallusion will allow users to run on PC as well as mac moving forward as this feature has been promoted for a while and no mention of mac not being included.  I'll happily use a windows version to do this "one" feature.   Maybe Reallusion will be kind and let me merge 2 accounts into 1 as I kept things separate ( long story) a while back.  

I'm sure if Reallusion really wanted to they could support mac as the visualiser and SDK is still very serviceable and I saw both my hands move on the screen really well using the test software.  I understand that supporting the PC only is cheaper and easier to do which is fine if customers had a cross platform license as lets be real here, the option of hand has been included in the live2D for a while on mac hinting at support further down the line.  This was also true I believe in the trial which is perhaps misleading? 

Reallusion has 3 options. 
1. Ignore their mac customers. 
2. Reinvestigate mac support as the driver still exists and is still functional
3. Let users log into PC and Mac with the 2D live plugin on both machines with a single account. 

Many years of Tech support experience would say lets do option 3 and aim for 2.  :D 

On a positive side, it's great to see these features being added for PC users and future developments. :)   So keep up the good work and put in that extra bit of effort for some of your valued customers. :) 
By brothertcoleman - 6 Years Ago
I really just want to say thank you to Realllusion for all the hard work and innovation you guy put into your products, just the little time I did testing the Motion LIVE 2D with the Leap Motion device ,all I could say is WOW ! Watching the Cartoon Animator 4 Tutorial;Getting Started with the Leap Motion Controller video is a must to making everything work properly though.


Thank you
By scribbley3rd - 6 Years Ago
It's great if you have purchased the license on a PC.  :) 
Can't wait to see what PC license owners can do with this great new PC tool :) 

Look forward to seeing the great work that I am sure will appear. :) 
By Peter (RL) - 6 Years Ago
brothertcoleman (5/18/2020)
I really just want to say thank you to Realllusion for all the hard work and innovation you guy put into your products, just the little time I did testing the Motion LIVE 2D with the Leap Motion device ,all I could say is WOW ! Watching the Cartoon Animator 4 Tutorial;Getting Started with the Leap Motion Controller video is a must to making everything work properly though.

Thank you


Thanks for the kind words. I have passed this to the CTA team. :)
By Peter (RL) - 6 Years Ago
scribbley3rd (5/17/2020)
Really disappointing to see the mac not being supported with leap motion.  So I take it Reallusion will allow users to run on PC as well as mac moving forward as this feature has been promoted for a while and no mention of mac not being included.  I'll happily use a windows version to do this "one" feature.   Maybe Reallusion will be kind and let me merge 2 accounts into 1 as I kept things separate ( long story) a while back.  

I'm sure if Reallusion really wanted to they could support mac as the visualiser and SDK is still very serviceable and I saw both my hands move on the screen really well using the test software.  I understand that supporting the PC only is cheaper and easier to do which is fine if customers had a cross platform license as lets be real here, the option of hand has been included in the live2D for a while on mac hinting at support further down the line.  This was also true I believe in the trial which is perhaps misleading? 

Reallusion has 3 options. 
1. Ignore their mac customers. 
2. Reinvestigate mac support as the driver still exists and is still functional
3. Let users log into PC and Mac with the 2D live plugin on both machines with a single account. 

Many years of Tech support experience would say lets do option 3 and aim for 2.  :D 

On a positive side, it's great to see these features being added for PC users and future developments. :)   So keep up the good work and put in that extra bit of effort for some of your valued customers. :) 


Thank you also for the feedback. The reason for there not being a Mac version is explained HERE.

However, I have passed on the other points you raised for consideration. :)
By scribbley3rd - 6 Years Ago
Thanks Peter, 

I have been in contact with UltraLeap and the mac version is at 2.3 and there is documentation so a Mac version is I'm sure doable if it was deemed financially viable when it comes to development time and resources. 
https://developer-archive.leapmotion.com/documentation/index.html

To be fair the link doesn't really explain the lack of mac support just that it would require additional effort and possibly comunication with the UltraLeap team.  I still strongly believe that it's doable on a technical level.  C'mon your devs are certainly talented enough. :) 

It's also been very much hinted that the Mac hasn't been forgotten when it comes LeapMotion support which is very encouraging.  Would be nice if the Reallusion dev team could take a look and just do some tentative tests to see if it is doable from a development point of view. 

Don't get me wrong it's a great achievement and an exciting one which is why I'm keen to see it accessible to all CTA4 users who have purchased the Live 2D plugin. 

PS.  Is it possible to merge 2 Reallusion accounts into 1 single one as I set up a seperate one when I was testing a PC build?  This would allow me to give the leap motion features a go if this was possible :)  Totally my mistake, I just wanted to keep things tidy as I intended to stick with the mac version which I have to say has been incredible stable with updates since the first release which too deserves a big thank you.  It's really come a long way with stability :)