Profile Picture

Exporting iClone's great viseme lipsync data TO Daz Studio

Posted By Jeffglobal 9 Years Ago
You don't have permission to rate!

Exporting iClone's great viseme lipsync data TO Daz Studio

Author
Message
Jeffglobal
Jeffglobal
Posted 9 Years Ago
View Quick Profile
Senior Member

Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)

Group: Forum Members
Last Active: 9 Years Ago
Posts: 13, Visits: 58
I've just started to learn iClone's products and Daz Studio.  What I'd like to do, given the iRay engine in Daz Studio, is to use CrazyTalk to make a 3D head from pictures, animate in iClone and render in Daz.   I do not have the Indigo plugin and it looks like I'm screwed out of getting that for now.   All I want to do is export a character model I made with not Scarlet (Johansson) not singing badly, her song "Last Goodbye" with the lipsync data created for the purpose with that character model.  After I better understood the mechanics of the program, the lipsyncing looked reasonable even to me, and now I want to use that data, with iRay to render a cgi model that doesn't look worse than an old GI Joe action figure I had as a kid.  It blows I just can't use Indigo, but both iRay and Indigo are intermediaries to V-Ray and Maya, because I need to practice composition and storytelling now, given, just cause you can use tools doesn't make you a Da vinci.  Look at JJ Abrams, he has the best craftsmen and makes [choose your favorite word or phrase for "give me back those hours I watched your movie, yo!"].

I've been looking around for a few hours now, over a couple of days, and I can't find out if I can do so.  I know I can export motion and motionplus stuff to 3dxchange into an fbx, but I don't see any way to export the lipsync.  It looks like the youtube tutorials both of RL and freelance tutorial guys/gals specifically don't show how to do what I want to do. 

Am I a complete noob and don't realize the motionplus has the viseme data and therefore, duh, there you go?  Cause Daz lipsync is horrifyingly bad, at least given what I've seen on youtube as "great" work.

---------------------------------------------2nd question, since I may have ur attention...
The second question is exporting the mesh as an fbx but with the right parameters so Zbrush doesn't destroy it when I swipe and press T.  Zbrush, in my experience loves objs, and wants to chew fbxs.  Maybe my best choice is to export it as an obj.  If I do so, can I recombine my obj character model with the animation data (that an fbx would conserve?) simply in 3Dxchange?

My 3D head I made of not Scarlet looks more like not Britney Spears I've been told, which is amazing, given I used very reasonable pics of not her face to make the 3D head in CrazyTalk.  I noticed the CrazyTalk export to iClone changes the head in ways I'd rather it didn't.  Kinda makes her look emaciated.  I'm pretty sure I made sure I pulled the slider to the left to maximize the morph and not the head the body came with...  I thought I could move around the mesh nicely in Zbrush, to fix the weird distortion the transfer to iClone created imo. idk.  Focusing on a beautiful woman's face not at the moment yelling at me, is something I enjoy.

Thank you for any feedback that helps.
wendyluvscatz
wendyluvscatz
Posted 9 Years Ago
View Quick Profile
Senior Forum Member

Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 2.5K, Visits: 19.4K
DAZ studio will not iimport the FBX but if it is an iClone character with bone based facial animation using a motion plus animation Carrara 8.5 will.
while certainly not not iray and PBR Carrara render engine is not too bad.


edit
correction DS will import the FBX as a jumbled mess




sidroy
sidroy
Posted 9 Years Ago
View Quick Profile
Junior Member

Junior Member (192 reputation)Junior Member (192 reputation)Junior Member (192 reputation)Junior Member (192 reputation)Junior Member (192 reputation)Junior Member (192 reputation)Junior Member (192 reputation)Junior Member (192 reputation)Junior Member (192 reputation)

Group: Forum Members
Last Active: Last Year
Posts: 12, Visits: 1.9K
And all the time I thought that " jumbled mess " was only happening to me :):)
Jeffglobal
Jeffglobal
Posted 9 Years Ago
View Quick Profile
Senior Member

Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)

Group: Forum Members
Last Active: 9 Years Ago
Posts: 13, Visits: 58
Hey guys, this is what I got as a response from RL while trolling youtube praying I may stumble across an answer from the youtube gods/goddesses:
https://www.youtube.com/watch?v=_mPgBEmwD4U&list=WL&index=2
Can I animate my character in iClone but then export the animations back to Daz Studio, or Vray in Maya for final rendering of video? Is it as simple as exporting as an fbx? From my perspective, even though the Indigo renderer of iClone is unbiased, PBR, etc, like the Iray renderer in Daz Studio, with the Iray material converters and especially light emitters, and with their SSS shaders, Iray gives a more realistic look to my humanoid avatars, given my current understanding of both programs. I'm I missing something in iClone? YES I WAS. I didn't have the Indigo Plugin! whoops!
Reallusion
+Jeffrey Spinner You can definitely export your characters and animations from iClone to Daz/Maya or whatever other software you use by exporting via FBX/OBJ/BVH/SKP format. However keep in mind that you need the Pipeline version of 3DXchange to do this.
Jeffrey Spinner
+Reallusion OK, tyvm. I saw a document showing Iclone to daz, but it was for a prior version of iClone, and I couldn't tell given my level of ignorance if it would bring the viseme data, but I'll follow that and see what happens. A person on your forum (not a moderator) said it would import the fbx as a jumble. I will suspend disbelief and just do it. Woo Hoo!


We have a difference of opinion...So, I DID get a Genesis2 girl into iClone, no problem, and Idr (it's only been like 4 hrs, so I have no excuse) if I used the facekey.duf or not, I think I did, and I did see today your facekey.duf try for Genesis3 models somewhere wendyluzscatz, but I was trying to keep it simple.  Then I collected my lipsync and motion data in one fell swoop with the thingie on the timeline you can highlight what to export to 3DXchange, and I exported.  THEN, I reset 3DXchange, and I first loaded up the genesis2 model, cause, it freakin' loaded up the default dude the first time and he danced like a little girl...then I exported the motionplus stuff again and it freakin worked...so far so good.  Then I noticed the viseme data was super exaggerated, like she was on PCP, so I corrected all the morphs one at a time, hoping beyond hope it would save those corrections when I exported as one giant clump of an fbx.  I even had to practice after I got half way thru, cause I didn't turn on autokey. fk.  So, I thought, yo, good to go!

Well, I missed a step, ok, I think at least two, cause in Daz it said I was missing a bone or something and I left constraints on, so it had bone mapping errors, BOTH of which I saw in some videos somewhere to make sure I didn't do!  Mofo.  So, after I picked up my laptop of the bounce from the wall and the floor, and told it I wouldn't be mean to it like that ever again, I downloaded the youtube videos I think I need, so I can remember to make sure before I think I failed to do it right.  But it ain't happening today.  Ok, maybe today...

There's a guy named Warlord on youtube with a thick southern accent that knows to attach the hips right for the export and I forgot, and there's a command I have to have it ignore, but when I saw the dialogue box, it was already using the name of the model so it was confusing because it was not like the 3 year old RL youtube tutorial.  Can't have in one line: 1, Genesis 2, [tons of bones data or something] and then 0, Genesis2, ignore or so I ass u me d incorrectly.

So even with the dumbahhsss fails, it imported into Daz face down nude, which was a little scary (not the nude, the face down) but I rotated it and checked what it was doing.  Well it was trying to sing, but more like a 70 year old with dentures trying to fall out.  I consider that close to a success.  I think all I need is to actually attach the cgi bone version of L1 instead of the L2 it always attaches to for the hips and somehow get the dialogue box to ignore what it needs to ignore...

But I will persist, cause my ability to suspend disbelief boarders on living in my own world. 







wendyluvscatz
wendyluvscatz
Posted 9 Years Ago
View Quick Profile
Senior Forum Member

Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 2.5K, Visits: 19.4K
BVH will work on Genesis 3 using my facekey
As I said FBX not as likely, OK it might be more successful with Genesis than iClone figures but still not right
With BVH you have to tick all the facial bones in advanced
I thought you said iClone characters not DAZ ones, your post seems longer.




Jeffglobal
Jeffglobal
Posted 9 Years Ago
View Quick Profile
Senior Member

Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)

Group: Forum Members
Last Active: 9 Years Ago
Posts: 13, Visits: 58
K, ty, Ms. Wendy.  I will try your facekey file...though I have to find it again.  I appreciate the effort, and htf did you make the facekey file? [Edit] Ok, found the links, ty will see what happens...

I've been torturing myself in Daz, but do you guys know if the Indigo renderer can do this pic in 3.5mins on a i7 gtx600seriesmoble gpu? at 30% normal render setting with max 500 samples/secs? 
Test Render
Don't worry, her facial expression and gesture is only for me...

I've been looking for professional looking stuff produced by either iclone or daz ppl, and I really don't see anything with ppl talking on Youtube.  I'm kinda concerned.  The stuff made with Unity is cute, but I need to see something with a human face, that is as nice as their trick robot render short film.  Especially since the uncanny valley was crossed 7 years ago in real time by Image Metrics
CG Emily

All I want really, at this time, is to make animations for Fallout 4, cause both their graphics and animations suuuuuuuuuuuuuuuck.  Which starts the *bvh to *hkx conversions, which I have no clue how to start to try to do...

I'm trying to make an addon: Pusses in Hoods, so I should have lots of leeway for reality.  I made a silly little Crazytalk video about my FUCs (Feline Urban Commandos), but that ain't what I'm looking for...and I was only 2 weeks into learning CrazyTalk.
Grumbly Cat Reporting on the FUCs (first week)
Grumbly Cat Demands Inclusion in Any FO4 Movie (second week)

Thanks for the responses.
Jeffglobal
Jeffglobal
Posted 9 Years Ago
View Quick Profile
Senior Member

Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)

Group: Forum Members
Last Active: 9 Years Ago
Posts: 13, Visits: 58
sw00000p (3/22/2016)
wendyluvscatz (3/22/2016)
...your post seems longer.

It was "Edited" Ms. Wendy.


No, Sw0000p.  Hmmm, I can't tell that joke...it was funny though... [took out a zero sw0000p cause of a rounding error]
















Reading This Topic

0 active, 0 guests, 0 members, 0 anonymous.
No members currently viewing this topic!