|
By Eric C (RL) - 4 Years Ago
|
IC 7.9 AccuLips & Lip-sync Animation Updates
iClone provides the most intuitive way to generate procedural, editable lips-ync animations, allowing users to easily create accurate, natural, and smooth talking animations.
Learn more information by visiting the Lipsync Animation page.What is AccuLips?
A brand new lip-sync technology that allows characters to achieve smoother and accurate lip-sync results. Save a massive amount of time when animating dialogue scenes.
AccuLips detects and extracts text and viseme from audio or import a prepared script to get more precise lip-syncing. Main features of AccuLips include:
- Accurate: Detect and generate precise text and visemes from the editable English viseme dictionary.
- Natural: Enhanced viseme and co-articulated design (including "schwa" sounds, slightly open enunciation, and phoneme pairs)
- Smooth: Down-sampled and enhanced phoneme pair curves.
Check the following four fundamental tutorials and start making lip-sync animations with AccuLips:
Three levels of lip strength adjustments: Project, Clip, and Individual Level
This indicates how the viseme changes within your project. >>> (manual)
Also take a look at our new Talking Style Editor. The strength of lips and jaw movements vary due to how people speak. It can be influenced by utterance and mood of the situation. For example, whispering is different from yelling, mumbling is different from enunciating. The Talking Style Presets provides quick setup for lips, jaw and viseme strengths catering to different manners of speaking. >>(learn more)
>>> (manual)
*Notification:
1. AccuLips supports English language only, and can only be use on CC3+ Character with ExpressionPlus (ExPlus) blend-shapes.
For other languages, please check the general lipsync function.
To update your existing CC3+ Characters with ExPlus, please check this post.
2. When alignment fails, please check if the uploaded audio file is clear, without background noise, and the pronunciation is correct. 
|
|
By Eric C (RL) - 4 Years Ago
|
Other Enhancements
The strength of the viseme shapes will be shown when the cursor hovers over the track.
Mute/solo: IC7.9 Audio tracks now have a mute and solo option making it possible to focus solely on the track.
Show All audio tracks: New Show All Audio Tracks button in IC7.9 can be used to show every existing track in the project.
|
|
By ReiniWien - 4 Years Ago
|
great news, is there a chance to support the german language in the near future?
|
|
By facr73 - 4 Years Ago
|
|
And also Portuguese...
|
|
By Angel Alonso - 4 Years Ago
|
GREAT ERIC !!! thanks for this
:)
|
|
By rogyru - 4 Years Ago
|
A long time coming, but a very good update works great so far
|
|
By jason_770227 - 4 Years Ago
|
iClone 7.9 and CC3.4 are amazing. Thanks for the awesome updates.
Question re Acculips: Is there a way to change which blendshapes are being triggered by the Vismes? Eg:I'd like to use the "Mouth Open" Arkit blendshape mesh based animation for the "AE" and "Ah" or "Merged Mouth" rather than having those trigger a bone based / jaw bone animation.
One solution might be allowing for editing of the Viseme mapping? Or creating custom Vismes?
Thanks for the great products.
|
|
By Tom4891 - 4 Years Ago
|
Eric C (RL) (3/24/2021)
...
1. AccuLips supports English language only, and can only be use on CC3+ Character with ExpressionPlus (ExPlus) blend-shapes.
For other languages, please check the general lipsync function.
...
Looks like a great update.
Are there any plans to include other languages in the future? Will there be any solutions for the user to use AccuLips with other languages?
I would need it for German.
|
|
By rendooo.lab - 4 Years Ago
|
Technology looks great! we are thinking of including it in our workflow. We work mostly with DAZ and MD. Did not yet do animation. Is there any bridge with DAZ3D?
Regards!
|
|
By jason_770227 - 4 Years Ago
|
hey there,
When I'm exporting the new acculips and expressions to Unity from iClone the strength adjustments that I make in iClone are not carrying over to Unity via FBX. Is this possible? It seems that my acculips capture come in at a neutral middle ground setting. Thanks for you help.
|
|
By LightofThunder - 4 Years Ago
|
dumb quest Ion: D o i have to buy acculips somewhere or is an update??
|
|
By michaelrbarton - 4 Years Ago
|
It's the 7.9 update from March. It's in the Create A Script panel.
|
|
By charly Rama - 4 Years Ago
|
|
There's never dumb question :) , you're welcome for all questions, there 's always someone answering you on this forum, there are even some boss who avoid headaches for us :) . So the good news is acculips is a free update at Iclone. For having it, you just have to convert your character to CC3+
|
|
By LightofThunder - 4 Years Ago
|
Ah, thanks!
|
|
By Antonello - 4 Years Ago
|
|
Hi everyone, is it possible that acculips will also be supported for Italian? Thanks for the reply
|
|
By Peter (RL) - 4 Years Ago
|
|
Antonello (7/23/2021)
Hi everyone, is it possible that acculips will also be supported for Italian? Thanks for the reply
Unfortunately AccuLips only supports English and there are no immediate plans for any other languages. However, in the future this may change so never say never.
|
|
By animagic - 4 Years Ago
|
There is some more discussion about this in this thread: https://forum.reallusion.com/487864/AccuLips-other-languages.
I used to work in the Natural Language Processing field and know that there is enough speech-recognition support in other languages available to make it happen, so I disagree with RL's position on this. Any smartphone is able to understand a variety of languages other than English.
In fact, the remnants for German are already there (see C:\Program Files\Reallusion\iClone 7\Resource\ICTextToSpeech\Dictionary) and were functional during testing.
It would be good if we got some more voices in support of this as it it would be quite useful. Maybe shift some resources back to iClone's core functionality?
|
|
By facr73 - 4 Years Ago
|
Yes definitely should have more languages. Portuguese too.
|
|
By animagic - 4 Years Ago
|
|
facr73 (7/23/2021)
Yes definitely should have more languages. Portuguese too.
I frankly don't understand the reluctance. Its availability in other languages would AccuLips make even more desirable.
As far as I can see you need three things:
- A language model - this exists for multiple languages.
- A pronunciation dictionary - this exists for multiple languages.
- A phoneme to viseme mapping, which is simply a table.
You could even get an intern with the right background to work on it...:P
For more, check out Vosk at: https://github.com/alphacep/vosk-api.
|
|
By Antonello - 4 Years Ago
|
I agree. AccuLips saves a lot of time and the results look great. with the normal Lipsynch in Italian I have to work enough on the synchronization and visemes. I have been using iclone for many years and I would like this aspect to improve. less time spent means a lot in choosing a software
|