Profile Picture

iClone 7.9 AccuLips & Lipsync Animation Updates

Posted By Eric C (RL) 5 Years Ago
Rated 5 stars based on 2 votes.
1
2
3

Author
Message
Peter (RL)
Peter (RL)
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)

Group: Administrators
Last Active: 2 Years Ago
Posts: 23.1K, Visits: 36.6K
dmaslyn (9/10/2021)
Is there any way to use this with a custom character, like one made in Blender, assuming I set up the shape keys properly?


AccuLips can only be used with standard CC3+ characters.. You can't use it with non-standard characters.


                                                                

Peter
Forum Administrator

www.reallusion.com


dmaslyn
dmaslyn
Posted 5 Years Ago
View Quick Profile
New Member

New Member (53 reputation)New Member (53 reputation)New Member (53 reputation)New Member (53 reputation)New Member (53 reputation)New Member (53 reputation)New Member (53 reputation)New Member (53 reputation)New Member (53 reputation)

Group: Forum Members
Last Active: 5 Years Ago
Posts: 2, Visits: 8
Is there any way to use this with a custom character, like one made in Blender, assuming I set up the shape keys properly?
Antonello
Antonello
Posted 5 Years Ago
View Quick Profile
New Member

New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)

Group: Forum Members
Last Active: 4 Years Ago
Posts: 2, Visits: 147
I agree. AccuLips saves a lot of time and the results look great. with the normal Lipsynch in Italian I have to work enough on the synchronization and visemes. I have been using iclone for many years and I would like this aspect to improve. less time spent means a lot in choosing a software
animagic
animagic
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)

Group: Forum Members
Last Active: 5 Months Ago
Posts: 15.8K, Visits: 31.4K
facr73 (7/23/2021)
Yes definitely should have more languages. Portuguese too.


I frankly don't understand the reluctance. Its availability in other languages would AccuLips make even more desirable. 

As far as I can see you need three things:
  1. A language model - this exists for multiple languages.
  2. A pronunciation dictionary - this exists for multiple languages.  
  3. A phoneme to viseme mapping, which is simply a table.
You could even get an intern with the right background to work on it...:P

For more, check out Vosk at: https://github.com/alphacep/vosk-api.



https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

facr73
facr73
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: 3 Months Ago
Posts: 215, Visits: 23.8K
Yes definitely should have more languages. Portuguese too.

animagic
animagic
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)

Group: Forum Members
Last Active: 5 Months Ago
Posts: 15.8K, Visits: 31.4K
There is some more discussion about this in this thread: https://forum.reallusion.com/487864/AccuLips-other-languages.

I used to work in the Natural Language Processing field and know that there is enough speech-recognition support in other languages available to make it happen, so I disagree with RL's position on this. Any smartphone is able to understand a variety of languages other than English.

In fact, the remnants for German are already there (see C:\Program Files\Reallusion\iClone 7\Resource\ICTextToSpeech\Dictionary) and were functional during testing.

It would be good if we got some more voices in support of this as it it would be quite useful. Maybe shift some resources back to iClone's core functionality?


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

Peter (RL)
Peter (RL)
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)Distinguished Member (124.4K reputation)

Group: Administrators
Last Active: 2 Years Ago
Posts: 23.1K, Visits: 36.6K
Antonello (7/23/2021)
Hi everyone, is it possible that acculips will also be supported for Italian? Thanks for the reply


Unfortunately AccuLips only supports English and there are no immediate plans for any other languages. However, in the future this may change so never say never.


                                                                

Peter
Forum Administrator

www.reallusion.com


Antonello
Antonello
Posted 5 Years Ago
View Quick Profile
New Member

New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)New Member (19 reputation)

Group: Forum Members
Last Active: 4 Years Ago
Posts: 2, Visits: 147
Hi everyone, is it possible that acculips will also be supported for Italian? Thanks for the reply
LightofThunder
LightofThunder
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (2.3K reputation)Distinguished Member (2.3K reputation)Distinguished Member (2.3K reputation)Distinguished Member (2.3K reputation)Distinguished Member (2.3K reputation)Distinguished Member (2.3K reputation)Distinguished Member (2.3K reputation)Distinguished Member (2.3K reputation)Distinguished Member (2.3K reputation)

Group: Forum Members
Last Active: 3 Months Ago
Posts: 169, Visits: 416
Ah, thanks!


Asus Prime 2390, Intel Corev i9-9900k, 64GB RAM, 1TB SSD, nVidia GeForce RTX 2080ti, Win10v Pro
charly Rama
charly Rama
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)Distinguished Member (8.1K reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 1.9K, Visits: 17.3K
There's never dumb question :) , you're welcome for all questions, there 's always someone answering you on this forum, there are even some boss who avoid headaches for us :) . So the good news is acculips is a free update at Iclone. For having it, you just have to convert your character to CC3+ 


     



1
2
3



Reading This Topic