Profile Picture

Montreal-forced-aligner

Posted By mtakerkart 3 Years Ago
You don't have permission to rate!
Author
Message
mtakerkart
mtakerkart
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 3.1K, Visits: 28.2K
Does someone have this folder "montreal-forced-aligner" in their Iclone folder here ?
"C:\Program Files\Reallusion\iClone 7\Resource\ICTextToSpeech\montreal-forced-aligner"

If yes , what's for???
Data Juggler
Data Juggler
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (12.5K reputation)Distinguished Member (12.5K reputation)Distinguished Member (12.5K reputation)Distinguished Member (12.5K reputation)Distinguished Member (12.5K reputation)Distinguished Member (12.5K reputation)Distinguished Member (12.5K reputation)Distinguished Member (12.5K reputation)Distinguished Member (12.5K reputation)

Group: Forum Members
Last Active: 3 hours ago
Posts: 1.7K, Visits: 5.4K
Question 1: Yes

Question 2: Who the heck knows?

My Question: Why did you look there?

Not a clue what this is for, but now i am curious.




Creator of the free website:
PixelDatabase.Net
A Free Online Text Based Image Editor
https://forum.reallusion.com/uploads/images/6e6663e2-0ecf-447a-ab3d-d49d.png

Edited
3 Years Ago by Data Juggler
jlittle
jlittle
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (6.7K reputation)Distinguished Member (6.7K reputation)Distinguished Member (6.7K reputation)Distinguished Member (6.7K reputation)Distinguished Member (6.7K reputation)Distinguished Member (6.7K reputation)Distinguished Member (6.7K reputation)Distinguished Member (6.7K reputation)Distinguished Member (6.7K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 1.9K, Visits: 17.1K
I did a search online for "montreal forced aligner" and came up with this:

What is forced alignment?

Forced alignment is a technique to take an orthographic transcription of an audio file and generate a time-aligned version using a pronunciationdictionary to look up phones for words.

Might be part of acculips or something to do with phonemes?

Jeff




Get my Plugin Manager and TaskNotes plugins for iClone.
Check out EZColors and Other products for CTA/CA. EZColors: the easy way to change Render Styled (RS) colors!
See my CTA Tutorials on the YouTube channel CTAStepByStep

Edited
3 Years Ago by jlittle
mtakerkart
mtakerkart
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 3.1K, Visits: 28.2K
Thank you Jeff

I looked in this file to see if the update announced by Miranda had a link with the French dictionary that we are waiting for.
https://forum.reallusion.com/FindPost486813.aspx
 I was curious to know why RL called this file "Montreal" because I live in Montreal which is a French Canadian city.
Let's say I was hoping for something ...  Ermm
Edited
3 Years Ago by mtakerkart
animagic
animagic
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)

Group: Forum Members
Last Active: 12 hours ago
Posts: 15.7K, Visits: 30.5K
The aligner seems to be based on work done at McGill University, which is in Montreal. 

I don't know exactly what is holding things up because there are large online pronunciation dictionaries (I was looking for Dutch and found one), unless there are licensing issues for commercial use.


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

mtakerkart
mtakerkart
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 3.1K, Visits: 28.2K
hohoho! you guys are real investigators!

Indeed Yoshua Bengio (who is a professor at McGill) is one of the pioneers of deep learning, the approach that revolutionized artificial intelligence.

Animagic could you show the link where you found these online pronunciation dictionaries ?
animagic
animagic
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)

Group: Forum Members
Last Active: 12 hours ago
Posts: 15.7K, Visits: 30.5K
Here is the link for French: https://sourceforge.net/projects/cmusphinx/files/Acoustic%20and%20Language%20Models/French/.

The dictionary is the file fr.dict. It lists words followed by an encoding of the phonemes.

This is from the CMU Sphinx project. The idea is to take a list like that and then have a conversion routine that generates the visemes.



https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

Edited
3 Years Ago by animagic
mtakerkart
mtakerkart
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 3.1K, Visits: 28.2K
Oh my god Animagic! Thank you

It seams that the fr.dict have the same structure like the en.dict.
it would just be necessary to create a file fr.PhonemeVisemeMapping isn't it ?  Ermm
animagic
animagic
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)

Group: Forum Members
Last Active: 12 hours ago
Posts: 15.7K, Visits: 30.5K
I played a little bit with that using Dutch, but currently it seems that the system only accepts a dictionary called en.dict and the corresponding en.PhonemeVisemeMapping. As I don't make films in Dutch, I didn't go any further with it.

So your French files would need to be renamed as if they were English and you would have to figure out the mapping. What I don't know if the system also expects a specific naming of the phonemes or if the mapping file would take care of that.


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

mtakerkart
mtakerkart
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 3.1K, Visits: 28.2K
I have already tried to replace with the French file by renaming it en.dict but unfortunately Iclone uses the English file.
Moreover the blendshape phoneme are specific to the English language, it would be necessary to add some for the sound "in", "on", "an" which is specific to the French language.
 I remain convinced that it is child's play for Reallusion to add this french dictionary ...



Reading This Topic