|
Author
|
Message
|
|
patrick.charpenet
|
patrick.charpenet
Posted 4 Years Ago
|
|
Group: Forum Members
Last Active: Last Year
Posts: 1,
Visits: 33
|
Hey Guys, I might have a workaround. Not perfect by any means. Here are my 9convoluted steps) 1/Write your French text and record it in any recording software and export the audio file so it can be read by Iclone 2/Go to an online platform that will convert your written text to English phonetic text. I tried with toPhonetics, seems to work OK and to be free so far. 3/Load a character to IClone and launch the lip-sync interface (Animation Tab>Animation>Create Script) 4/Select AccuLips 8/In the top menu of the interface, click the" Open Audio File' Button and select your French audio clip 9/ In the 'input your text here" area, paste your phonetic English text10/Hit the "generate text" button. Ignore error message and adjust if needed, for me it did 90% of the job.11/Hit Apply Not perfect, but I think it does a slightly better job than letting AccuLips figure it out by itself, and you can refine it.Here is my quick and dirty test : https://drive.google.com/file/d/1e0HKO_9wOGXwAu3gaLXIrxxJ-Rn6IsyX/view?usp=sharingHope it helps
|
|
|
|
|
animagic
|
animagic
Posted 5 Years Ago
|
|
Group: Forum Members
Last Active: Last Month
Posts: 15.8K,
Visits: 31.4K
|
So what about this?
Here I'm feeding Dutch to AccuLips and using speech to text to generate the text.
I needed to do a little creative editing of the text, but we can make it look like English and then have AccuLips do its thing. AccuLIps actually tries to make English out of it and sometimes that is good enough. It's the mouth movements that count after all, not the transcription.
Dutch: "Ik will AccuLips in het Nederlands. Waarom is dat zo moeilijk? ["I want AccuLips in Dutch. Why is that so difficult?"]
AccuLips text: Ik will A-qu-Lips in a Neigh-der-lands. War-om mister soe moo-lick?
|
|
|
|
|
0oseven
|
0oseven
Posted 5 Years Ago
|
|
Group: Forum Members
Last Active: 4 Months Ago
Posts: 124,
Visits: 532
|
Unlikely that Iclone will provide foreign languages but REPLICA STUDIOS might [ in the future ] as they are specialising in synthetic voices. https://replicastudios.comLatest update to Iclone provides a link in the plugins tab to access the Replica library of voices and to integrate with Acculips. Paid service of course though there is a free starter. Also its for W10 so wondering if any one has tried installing Replica on W8.?[Cant upgrade PC yet as waiting on new gen processors Intel 12 and Windows 11 ]
|
|
|
|
|
charly Rama
|
charly Rama
Posted 5 Years Ago
|
|
Group: Forum Members
Last Active: 2 Years Ago
Posts: 1.9K,
Visits: 17.3K
|
I confirm. I use acculips for french and I have just to modify a few words. In anycase, for me, it's better than the simple lipsync.
|
|
|
|
|
animagic
|
animagic
Posted 5 Years Ago
|
|
Group: Forum Members
Last Active: Last Month
Posts: 15.8K,
Visits: 31.4K
|
Quite a number of English words are derived from French, so the spelling is the same, in which case AccuLips will recognize them. This is hardly the case with Spanish. If a word is not in the dictionary, AccuLips will fall back on the legacy system, which is a hit or a miss.
|
|
|
|
|
Pollux
|
Pollux
Posted 5 Years Ago
|
|
Group: Forum Members
Last Active: 2 Years Ago
Posts: 838,
Visits: 1.8K
|
Normally, I do my videos in English, however I wanted to try in French and Spanish (for high school). So my test: I imported the French mp3 sound directly into Acculips and that's it, without any alteration or alteration. I also tried with Spanish, very disappointing.
|
|
|
|
|
mtakerkart
|
mtakerkart
Posted 5 Years Ago
|
|
Group: Forum Members
Last Active: 2 Months Ago
Posts: 3.2K,
Visits: 29.2K
|
You may contact the people in Montreal
certainly I could do it but as I see that RL has no motivation for that I would not put energy for that. it is regrettable because google doc for example recognizes French very well therefore the powerful algorithms exist. The principle seems simple to associate each word detected with the French dictionary of Montreal and visemes ...
|
|
|
|
|
animagic
|
animagic
Posted 5 Years Ago
|
|
Group: Forum Members
Last Active: Last Month
Posts: 15.8K,
Visits: 31.4K
|
Neole F (7/12/2021) Veed.io provides speech to text with very high accuracy in most languages. I use it for subtitles for non-English languages and also translated subtitles to English. The problem is not getting the text from the speech for AccuLips. The problem is that AccuLips only understands English at the moment. I think it is relatively easy to add other languages, but RL tells us it is not and they are the boss...:P
|
|
|
|
|
Neole F
|
Neole F
Posted 5 Years Ago
|
|
Group: Forum Members
Last Active: 5 Years Ago
Posts: 89,
Visits: 337
|
Veed.io provides speech to text with very high accuracy in most languages. I use it for subtitles for non-English languages and also translated subtitles to English.
|
|
|
|
|
animagic
|
animagic
Posted 5 Years Ago
|
|
Group: Forum Members
Last Active: Last Month
Posts: 15.8K,
Visits: 31.4K
|
Well, that sounds nice as an excuse, but I wonder if that's true. You may contact the people in Montreal (as it is next door to you) to verify that. You would think they would at least have worked on French. I wonder if RL searched hard enough? See, for example, this: https://alphacephei.com/vosk/. Text-supported speech recognition as in AccuLips is actually easier and has been around for a long time. Generating the text from the incoming speech is of course a bit like a cat chasing its own tail but that should not prevent the implementation of additional languages as it is always possible to provide the written text.
|
|
|
|