Profile Picture

[iClone & 3DXchange 7.21] Optimized Genesis 8 and Daz Import Pipeline

Posted By Grace (RL) 6 Years Ago
Rated 5 stars based on 1 vote.

[iClone & 3DXchange 7.21] Optimized Genesis 8 and Daz Import Pipeline

Author
Message
Grace (RL)
Grace (RL)
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)

Group: Administrators
Last Active: Last Year
Posts: 497, Visits: 5.0K
Optimized Genesis 8 and Daz Import Pipeline

To give Daz Genesis 8 characters truly expressive facial animations, 63 x custom facial morphs have been created for optimal iClone Facial Mocap and Animation Editing. In the meantime, a brand new texture import pipeline has been introduced to greatly reduce effort when reassigning Daz character materials.
Edited
6 Years Ago by Grace (RL)
Grace (RL)
Grace (RL)
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)

Group: Administrators
Last Active: Last Year
Posts: 497, Visits: 5.0K
63 Custom Facial Morphs for Daz Genesis 8

We provide custom morphs and bone adjustments for Daz G3 and G8 characters so that their facial expressions can give better performances with iClone Facial Mocap and Face Puppet.

https://forum.reallusion.com/uploads/images/fe90ce14-4c1d-4b26-9af4-4c1d.gif


Installation Guide

1. 
Login to the Register Product & Download Patch/Bonus page and download the updated iClone_Daz_Genesis_Extension_v4_IC7.zip.


 
2. The downloaded resources will include G1, G2, G3, and G8 expression data.  This update is mainly for G3 and G8 male and female expression data. You can will see a folder, daz data file, and a text file inside the Genesis8_Male folder.

  • Reallusion folder contains 64 morph data sets in (*.dsf) format.
  • Genesis8_Male_iCloneFaceKey.duf contains the Daz face key sequences.
  • How to use Genesis8 duf file.txt readme is also available for getting started immediately.
https://forum.reallusion.com/uploads/images/e045d177-1a00-41d0-80ba-1ec7.jpg

3. There are a total of 82 poses in the iClone expression system: Muscle x60, Jaw x6,  Viseme x15.  A total of 63 custom expressions are provided, mapping separately into the iClone expression system. Check the video for the detailed workflow.

https://forum.reallusion.com/uploads/images/012cda36-bc7a-4f42-9cec-6a17.jpg
  • Muscle Mapping 1 to 60
https://forum.reallusion.com/uploads/images/be033b1c-1d66-4c20-b284-5853.jpg
  • Jaw Mapping 61 to 66
https://forum.reallusion.com/uploads/images/27387fdf-e1ec-44e5-8df5-f774.jpg
  • Viseme Mapping 67 to 81
https://forum.reallusion.com/uploads/images/91b15f8a-a824-4274-98b7-6b82.jpg


Visual Comparison

1. Simple Workflow Explanation
The following video will show you how to bring custom morph data into Daz and export a (*.fbx) into iClone via 3DXchange. 


2. Expression Enhancement Comparison
Prior generation expression data relied on the default Daz morph set to create facial expressions in iClone.  The custom expression morphs used on the face to the right are more compatible with iClone animation control systems.  


3. G3 & G8 Female Facial Mocap
G3 and G8 expression data has received equal treatment for more detailed and expressive results with Facial Mocap.


4. G8 Male Facial Mocap
The new generation of facial expressions can better express the nuances of the Facial Mocap performance.


5. G3 & G8 Truly Expressive Facial Animation
The following video demonstrates the improved facial animation quality after 7.21 Facial Custom Morph for iClone is applied to Genesis 3 and 8 characters.




Edited
6 Years Ago by Grace (RL)
Grace (RL)
Grace (RL)
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)

Group: Administrators
Last Active: Last Year
Posts: 497, Visits: 5.0K
Automatic Material Assignment and Batch Load Texture Mechanism

1. Automatic Material Assignment - 3DXchange

The iClone-optimized material settings for Daz Genesis characters will now be applied automatically when using the Import FBX > Auto-convert to Non-standard Character workflow.
A new pop-up message will appear when a Daz Genesis Character (*.fbx) is imported. 

https://forum.reallusion.com/uploads/images/a43cd019-3ace-4f9f-973c-09c5.jpg

Before & After comparison: v7.2 vs v.7.21: 3DXchange auto-convert to non-standard character in iClone.

https://forum.reallusion.com/uploads/images/c420fcf6-8d6f-49f7-adea-b0fa.jpg

New Modify > Material > Load Material Profile for Daz Genesis can be used to apply the proper material presets to Daz Genesis character
If iClone-optimized material settings fail to apply, resort to manual assignment instead.

https://forum.reallusion.com/uploads/images/f1dc83f8-5bc0-4667-b1ed-baf7.jpg


 
2. Batch Load Texture Mechanism - iClone

Design concept: Exported Daz 3D characters in FBX format are not equipped with a complete set of textures for skin, oral cavity, fingers, and eyes.  For example, the G3 and G8 default characters do not export with bump and specular maps.  Some packs do not even export the normal map, needing additional steps to find the said texture.  iClone 7.21's new Batch Load & Save Textures uses designated texture naming conventions to efficiently fulfill this need.

Before & after comparison:

On the left, the character has only the diffuse texture taken from 3DXchange Convert to Non-standard function.
On the right, the character is aptly supplied with the diffuse, specular, and bump textures taken from iClone 7.21 Batch Load Textures function. 

https://forum.reallusion.com/uploads/images/c199b77a-d664-4146-b081-f7a6.jpg

Detail comparison:

https://forum.reallusion.com/uploads/images/4e07e949-6d75-4923-aae4-78de.jpg

Instructions:

Step 1: Output the other missing textures such as the bump, glossiness, roughness, and specular maps from Daz3D.


* Daz Genesis high detail textures can be as large as 4K.  Shrinking this size first according to your needs will also make it faster to load the textures in iClone. 
* First examine the texture file formats.  If the format is (*.tif) then save it in an iClone compatible format like (*.jpg) to make the entire process go faster.  One 4k (*.tif) image is usually around 40 mb, which if not converted to another format can cause the loading time to hang and the final avatar size to increase substantially.

Step 2: Classify the exported texture maps into separate folders.  Take Genesis 8 as an example, one would classify the missing bump and specular maps into the "Arm", "Face", "Leg", "Torso," "Eye ball", and "Oral cavity" categories by using folders with corresponding names. 



Step 3: Change the texture names by following the texture naming rules set by iClone according to the Online Manual.  Watch the following video and know how to process other Daz specific texture names not mentioned in the online manual:



iClone applies special treatment to texture names with key Daz suffixes.  

Key Daz suffix 1 & 2: "TextureName__DazGlossiness"  and "TextureName__DazSpecular" maps will be inverted with brightness decreased by 18% then applied to the roughness channel. 
  • On the left, the specular map is directly applied to the roughness channel with results that are incorrect.
  • On the right, the specular map is first inverted then applied to the roughness channel with results that are more inline with expectations.
https://forum.reallusion.com/uploads/images/6f64c97c-3e38-403a-9b3c-e3db.jpg

The specular and glossiness maps can be converted for the roughness channel to increase the level of detail of the materials.  With some internal testing, we found that initial conversion of the specular and glossiness maps gave a very flat roughness texture.  Therefore, an additional brightness reduction of 18% was performed to increase the surface reflectivity.  See the difference after specular conversion in the following illustrations:

Specular map not used, with the roughness channel as flat grey:

https://forum.reallusion.com/uploads/images/9e8ed5cf-4487-4bfc-ba38-75cd.jpg

After the specular map is converted for the roughness channel:

https://forum.reallusion.com/uploads/images/97b617b3-551e-4351-bcee-def9.jpg


Key Daz Suffix 2: "TextureName__DazBump" maps will decrease brightness to 10% so to avoid excessive bumpiness.
Key Daz Suffix 3: "TextureName__DazNormal" maps will not receive any special treatment.  Therefore the suffix "__Normal" does not need to be changed as the handling method is the same. 

The aforementioned treatments can be edited under "\Program\Assets\Share\TextureImport\MaterialPresetConversion.ini".

https://forum.reallusion.com/uploads/images/34b56566-0d01-480b-9cc2-400e.png

Step 4: Deploy the standard texture folder structure with iClone Save All Object Textures and assign Daz Genesis textures to the appropriate folder (see the illustration below).
It is best practice to remove any unnecessary textures and folders to keep everything organized.  

Daz Genesis material and texture relation using Genesis 8 as an example:
  • A-"Arm" texture map: used for Arm and Fingernail materials.
  • B-"Face" texture map: used for Ears, EyeSocket, Face, and Lips materials.
  • C-"Leg" texture map: used for Legs and Tonnail materials.
  • D-"Torso" texture map: used only for the Torso material.
  • E-"Eyeball" texture map: used for Irises, Pupils, and Sclera materials.
  • F-"Oral cavity" texture map: used for Mouth and Teeth materials.
https://forum.reallusion.com/uploads/images/47ab6b92-77f4-4bbb-ab8f-c820.jpg



Step 5: 
Use Load All Object Textures and execute Auto-Link Texture, then finish by saving the iAvatar.



If the texture sizes were not reduced in the prior step, then re-export the iAvatar and clamp down the texture size with 
Max. Texture Size:

https://forum.reallusion.com/uploads/images/18fd7313-f2af-4ec5-970f-1ddc.jpg

https://forum.reallusion.com/uploads/images/d4ff8089-63d0-4bd8-8b9d-1d09.jpg

Edited
6 Years Ago by Grace (RL)
TonyDPrime
TonyDPrime
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (12.6K reputation)Distinguished Member (12.6K reputation)Distinguished Member (12.6K reputation)Distinguished Member (12.6K reputation)Distinguished Member (12.6K reputation)Distinguished Member (12.6K reputation)Distinguished Member (12.6K reputation)Distinguished Member (12.6K reputation)Distinguished Member (12.6K reputation)

Group: Forum Members
Last Active: 4 days ago
Posts: 3.4K, Visits: 12.4K
I have no idea what I am looking at yet. 
But all I can say is,
YEEEEESSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS!!!!!! 
THANK YOU RL FOR THIS WORK AND DEVELOPMENT!!!!
...Mmmmmmuah!  (Kiss)

Edited
6 Years Ago by TonyDPrime
Kelleytoons
Kelleytoons
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (35.6K reputation)Distinguished Member (35.6K reputation)Distinguished Member (35.6K reputation)Distinguished Member (35.6K reputation)Distinguished Member (35.6K reputation)Distinguished Member (35.6K reputation)Distinguished Member (35.6K reputation)Distinguished Member (35.6K reputation)Distinguished Member (35.6K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 9.1K, Visits: 21.8K
PBR Shader Type
  • Base Color channel:   MaterialName__Diffuse
  • Opacity channel:   MaterialName__Opacity
  • Bump channel:   MaterialName__Normal
  • Bump channel:   MaterialName__Bump
  • Ambient Occlusion channel:   MaterialName__AO
  • Matellic channel:   MaterialName__Matellic
Just to be clear here, Miranda -- is the Metallic texture REALLY renamed to be "Matellic"?  (This per the manual).  I realize English is a second language to your programmers, but this misnamed convention is going to cause a lot of confusion (because the channel itself in iClone is spelled correctly).  Or is this just a typo in the manual?






Alienware Aurora R12, Win 10, i9-119000KF, 3.5GHz CPU, 128GB RAM, RTX 3090 (24GB), Samsung 960 Pro 4TB M-2 SSD, TB+ Disk space
Mike "ex-genius" Kelley
Edited
6 Years Ago by Kelleytoons
Dr. Nemesis
Dr. Nemesis
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (2.9K reputation)Distinguished Member (2.9K reputation)Distinguished Member (2.9K reputation)Distinguished Member (2.9K reputation)Distinguished Member (2.9K reputation)Distinguished Member (2.9K reputation)Distinguished Member (2.9K reputation)Distinguished Member (2.9K reputation)Distinguished Member (2.9K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 258, Visits: 5.4K
GenThanks x1000, Reallusion. These are problems that have seriously plagued me in the past few months. These features are EXACTLY what I needed.

Edit: Aaaaaaand  seems like I spoke too soon. I still can't get Gen 3 characters importing properly. Now it's not even auto characterizing the skeleton. Amazingly, 3DXchange has got worse for me.
Edited
6 Years Ago by Dr. Nemesis
MnerosNaRa
MnerosNaRa
Posted 6 Years Ago
View Quick Profile
Veteran Member

Veteran Member (758 reputation)Veteran Member (758 reputation)Veteran Member (758 reputation)Veteran Member (758 reputation)Veteran Member (758 reputation)Veteran Member (758 reputation)Veteran Member (758 reputation)Veteran Member (758 reputation)Veteran Member (758 reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 98, Visits: 1.5K
Where Can i find the new "expression data" file? In the "my account there is no updated daz Expression file to be found. 
Joanne (RL)
Joanne (RL)
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)

Group: Administrators
Last Active: Last Week
Posts: 300, Visits: 4.9K
Dr. Nemesis (4/12/2018)
GenThanks x1000, Reallusion. These are problems that have seriously plagued me in the past few months. These features are EXACTLY what I needed.

Edit: Aaaaaaand  seems like I spoke too soon. I still can't get Gen 3 characters importing properly. Now it's not even auto characterizing the skeleton. Amazingly, 3DXchange has got worse for me.


Hello,
Does any characterization UI pop up?
If no, please help team to check this following file is still there?
https://forum.reallusion.com/uploads/images/e6dd2da3-8f5d-40ef-8e24-87b7.png

Thanks,
Joanne
Grace (RL)
Grace (RL)
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)

Group: Administrators
Last Active: Last Year
Posts: 497, Visits: 5.0K
MnerosNaRa (4/12/2018)
Where Can i find the new "expression data" file? In the "my account there is no updated daz Expression file to be found. 


Hi MnerosNaRa,

Please login to the Register Product & Download Patch/Bonus page again and click the Download.
There should be iClone_Daz_Genesis_Extension_v4_IC7.zip under the Bonus section for you to get the latest version.



Best Regards,
Grace

Edited
6 Years Ago by Grace (RL)
Grace (RL)
Grace (RL)
Posted 6 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)Distinguished Member (10.4K reputation)

Group: Administrators
Last Active: Last Year
Posts: 497, Visits: 5.0K
Kelleytoons (4/12/2018)
PBR Shader Type
  • Base Color channel:   MaterialName__Diffuse
  • Opacity channel:   MaterialName__Opacity
  • Bump channel:   MaterialName__Normal
  • Bump channel:   MaterialName__Bump
  • Ambient Occlusion channel:   MaterialName__AO
  • Matellic channel:   MaterialName__Matellic
Just to be clear here, Miranda -- is the Metallic texture REALLY renamed to be "Matellic"?  (This per the manual).  I realize English is a second language to your programmers, but this misnamed convention is going to cause a lot of confusion (because the channel itself in iClone is spelled correctly).  Or is this just a typo in the manual?




Hi Kelleytoons,

Thank you for pointing out this mistake.  We've corrected it in the manual.
https://forum.reallusion.com/uploads/images/f1e96080-d232-4473-b1a3-a0d1.jpg

Cheers,
Grace


Edited
6 Years Ago by Grace (RL)



Reading This Topic