Profile Picture

iClone 7.9 AccuLips & Lipsync Animation Updates

Posted By Eric C (RL) 3 Years Ago
Rated 5 stars based on 2 votes.
Author
Message
Eric C (RL)
Eric C (RL)
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)

Group: Administrators
Last Active: Yesterday
Posts: 549, Visits: 5.9K
IC 7.9 AccuLips & Lip-sync Animation Updates

iClone provides the most intuitive way to generate procedural, editable lips-ync animations, allowing users to easily create accurate, natural, and smooth talking animations.
https://forum.reallusion.com/uploads/images/05f49f95-3a0e-43e9-bb34-8802.jpg

Learn more information by visiting the Lipsync Animation page.

What is AccuLips?

A brand new lip-sync technology that allows characters to achieve smoother and accurate lip-sync results. Save a massive amount of time when animating dialogue scenes.
AccuLips detects and extracts text and viseme from audio or import a prepared script to get more precise lip-syncing. Main features of AccuLips include: 
  • Accurate: Detect and generate precise text and visemes from the editable English viseme dictionary.
  • Natural: Enhanced viseme and co-articulated design (including "schwa" sounds, slightly open enunciation, and phoneme pairs)
  • Smooth: Down-sampled and enhanced phoneme pair curves.

Check the following four fundamental tutorials and start making lip-sync animations with AccuLips:
Three levels of lip strength adjustments: Project, Clip, and Individual Level

This indicates how the viseme changes within your project. >>> (manual)

Also take a look at our new 
Talking Style Editor. The strength of lips and jaw movements vary due to how people speak. It can be influenced by utterance and mood of the situation. For example, whispering is different from yelling, mumbling is different from enunciating. The Talking Style Presets provides quick setup for lips, jaw and viseme strengths catering to different manners of speaking. >>(learn more)
>>>
 (manual)

https://forum.reallusion.com/uploads/images/6d6a9e8c-75c2-4c98-8ce9-42ec.jpg


*Notification:

1. AccuLips supports English language only, 
and can only be use on CC3+ Character with ExpressionPlus (ExPlus) blend-shapes.
For other languages, please check the general lipsync function.
To update your existing CC3+ Characters with ExPlus, please check this post.

2. When 
alignment fails, please check if the uploaded audio file is clear, without background noise, and the pronunciation is correct.


Edited
3 Years Ago by Eric C (RL)
Eric C (RL)
Eric C (RL)
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)Distinguished Member (11.5K reputation)

Group: Administrators
Last Active: Yesterday
Posts: 549, Visits: 5.9K
Other Enhancements

The strength of the viseme shapes will be shown when the cursor hovers over the track.

https://forum.reallusion.com/uploads/images/c3903120-41e9-4444-84d7-435a.jpg

Mute/solo
: IC7.9 Audio tracks now have a mute and solo option making it possible to focus solely on the track.



Show All audio tracks:
New 
Show All Audio Tracks button in IC7.9 can be used to show every existing track in the project.

Edited
3 Years Ago by Eric C (RL)
ReiniWien
ReiniWien
Posted 3 Years Ago
View Quick Profile
Senior Member

Senior Member (480 reputation)Senior Member (480 reputation)Senior Member (480 reputation)Senior Member (480 reputation)Senior Member (480 reputation)Senior Member (480 reputation)Senior Member (480 reputation)Senior Member (480 reputation)Senior Member (480 reputation)

Group: Forum Members
Last Active: 6 Months Ago
Posts: 27, Visits: 578
great news, is there a chance to support the german language in the near future?
facr73
facr73
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 215, Visits: 23.5K
And also Portuguese...
Angel Alonso
Angel Alonso
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (2.1K reputation)Distinguished Member (2.1K reputation)Distinguished Member (2.1K reputation)Distinguished Member (2.1K reputation)Distinguished Member (2.1K reputation)Distinguished Member (2.1K reputation)Distinguished Member (2.1K reputation)Distinguished Member (2.1K reputation)Distinguished Member (2.1K reputation)

Group: Forum Members
Last Active: 6 Months Ago
Posts: 341, Visits: 1.3K
GREAT ERIC !!! thanks for this
   Smile
rogyru
rogyru
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (4.0K reputation)Distinguished Member (4.0K reputation)Distinguished Member (4.0K reputation)Distinguished Member (4.0K reputation)Distinguished Member (4.0K reputation)Distinguished Member (4.0K reputation)Distinguished Member (4.0K reputation)Distinguished Member (4.0K reputation)Distinguished Member (4.0K reputation)

Group: Forum Members
Last Active: 9 Months Ago
Posts: 497, Visits: 1.3K
A long time coming, but a very good update works great so far
jason_770227
jason_770227
Posted 3 Years Ago
View Quick Profile
Junior Member

Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)

Group: Forum Members
Last Active: Last Month
Posts: 8, Visits: 344
iClone 7.9 and CC3.4 are amazing. Thanks for the awesome updates.

Question re Acculips: Is there a way to change which blendshapes are being triggered by the Vismes? Eg:I'd like to use the "Mouth Open" Arkit blendshape mesh based animation for the "AE" and "Ah" or "Merged Mouth" rather than having those trigger a bone based /  jaw bone animation. 

One solution might be allowing for editing of the Viseme mapping? Or creating custom Vismes?

Thanks for the great products.  
Edited
3 Years Ago by jason_770227
Tom4891
Tom4891
Posted 3 Years Ago
View Quick Profile
New Member

New Member (74 reputation)New Member (74 reputation)New Member (74 reputation)New Member (74 reputation)New Member (74 reputation)New Member (74 reputation)New Member (74 reputation)New Member (74 reputation)New Member (74 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 16, Visits: 220
Eric C (RL) (3/24/2021)
...

1. AccuLips supports English language only, 
and can only be use on CC3+ Character with ExpressionPlus (ExPlus) blend-shapes.
For other languages, please check the general lipsync function.
...



Looks like a great update.
Are there any plans to include other languages in the future? Will there be any solutions for the user to use AccuLips with other languages?
I would need it for German.
rendooo.lab
rendooo.lab
Posted 3 Years Ago
View Quick Profile
New Member

New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)

Group: Forum Members
Last Active: 3 Years Ago
Posts: 1, Visits: 2
Technology looks great! we are thinking of including it in our workflow. We work mostly with DAZ and MD. Did not yet do animation. Is there any bridge with DAZ3D?
Regards!
jason_770227
jason_770227
Posted 3 Years Ago
View Quick Profile
Junior Member

Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)Junior Member (131 reputation)

Group: Forum Members
Last Active: Last Month
Posts: 8, Visits: 344
hey there,
When I'm exporting the new acculips and expressions to Unity from iClone the strength adjustments that I make in iClone are not carrying over to Unity via FBX. Is this possible? It seems that my acculips capture come in at a neutral middle ground setting. Thanks for you help.



Reading This Topic