Profile Picture

Acculips - speech to text engine needs a lot of improvement

Posted By Darren01 Last Year
You don't have permission to rate!
1
2

Acculips - speech to text engine needs a lot of improvement

Author
Message
4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 5.3K, Visits: 16.8K
I made another one with sustained vocal today and it also fell almost perfectly into the track (It's only 1m).
I only had to fix one obvious issue.
Not refined though.
Here is a complete workflow.







Darren01
Darren01
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)

Group: Forum Members
Last Active: 4 Months Ago
Posts: 654, Visits: 4.1K
4u2ges (9/8/2024)
I made another one with sustained vocal today and it also fell almost perfectly into the track (It's only 1m).
I only had to fix one obvious issue.
Not refined though.
Here is a complete workflow.






OK something really strange is going on with my Acculips then...
I just downloaded the same song, and separated the vocals. Vocals are just as clear as the one you posted.
I put it through Acculips and this is the garble I got... And that is the entire 4 minute song (it's missing heaps of text). Just like the other song I tried.
Any ideas what is going on ?








_________________________________________________________




4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 5.3K, Visits: 16.8K
Any ideas what is going on ?

Try shorted clip (30-40 sec.) and see if it breaks as well. If it does, check the dictionary file specified in Preferences. Otherwise I don't have other suggestions.
If it does not, then it might be related to the length, which then should be reported to RL.




Darren01
Darren01
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)

Group: Forum Members
Last Active: 4 Months Ago
Posts: 654, Visits: 4.1K
4u2ges (9/23/2024)
Any ideas what is going on ?

Try shorted clip (30-40 sec.) and see if it breaks as well. If it does, check the dictionary file specified in Preferences. Otherwise I don't have other suggestions.
If it does not, then it might be related to the length, which then should be reported to RL.


Thanks for your help.
I tried shortening the clip and even tried using another converter to separate the vocals.
Same result. I even rest the dictionary to default and reinstalled iClone just in case something was corrupted.

Would you mind uploading your vocal track only somewhere so I can try the same vocal track you are using to test mine please ?
If I use the very same same vocal file you have used and mine still ends up as garble, then there is definitely something wrong with my setup.
I can then maybe use that as some sort of benchmark test to submit to RL support.




_________________________________________________________




4u2ges
4u2ges
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)Distinguished Member (22.3K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 5.3K, Visits: 16.8K
Here: https://drive.google.com/file/d/1w9bktoRrYt2vrnbIt3BdJxoj_4lLkg8a/view?usp=sharing

But I would like to reiterate. I do NOT use "Generate Text" function (it's not working right).
I simply copy and paste the lyrics of a song and use "Align" function.




Darren01
Darren01
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)

Group: Forum Members
Last Active: 4 Months Ago
Posts: 654, Visits: 4.1K
4u2ges (9/24/2024)
Here: https://drive.google.com/file/d/1w9bktoRrYt2vrnbIt3BdJxoj_4lLkg8a/view?usp=sharing

But I would like to reiterate. I do NOT use "Generate Text" function (it's not working right).
I simply copy and paste the lyrics of a song and use "Align" function.


ah ok, sorry I missed the part where you mentioned that you didn't use the 'generate text' function.
That was the point of my post that it's a next to useless feature that needs upgrading.

But I will try just posting the lyrics and using the 'align' function. I didn't think it would time things properly, but according to your example it seems to.
I'll give it a shot.

But yeah, back to my original point is RL needs to upgrade their voice to text recognition software for Acculips. It's terrible.




_________________________________________________________




Darren01
Darren01
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)

Group: Forum Members
Last Active: 4 Months Ago
Posts: 654, Visits: 4.1K
4u2ges (9/24/2024)
Here: https://drive.google.com/file/d/1w9bktoRrYt2vrnbIt3BdJxoj_4lLkg8a/view?usp=sharing

But I would like to reiterate. I do NOT use "Generate Text" function (it's not working right).
I simply copy and paste the lyrics of a song and use "Align" function.


ah ok, sorry I missed the part where you mentioned that you didn't use the 'generate text' function.
That was the point of my post that it's a next to useless feature that needs upgrading.

But I will try just posting the lyrics and using the 'align' function. I didn't think it would time things properly, but according to your example it seems to.
I'll give it a shot.

But yeah, back to my original point is RL needs to upgrade their voice to text recognition software for Acculips. It's terrible.


EDIT: I just tried your method of uploading the vocals and then pasting the lyrics as text and then aligning.
It actually worked! I only thought the align feature would work with it's own voice to text conversion.
Acculips voice to text still needs fixing otherwise there is no point in having the feature, but this is a workaround solution
Thanks again for your help 




_________________________________________________________




animagic
animagic
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)Distinguished Member (33.4K reputation)

Group: Forum Members
Last Active: 3 days ago
Posts: 15.8K, Visits: 31.4K
Darren01 (9/25/2024)
EDIT: I just tried your method of uploading the vocals and then pasting the lyrics as text and then aligning.
It actually worked! I only thought the align feature would work with it's own voice to text conversion.
Acculips voice to text still needs fixing otherwise there is no point in having the feature, but this is a workaround solution.

Using a text file with AccuLips was actually the point (name it the same as the speech file with extension txt and it will load automatically) and part of a suggestion from years ago that had a long time coming being picked up.



https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

Darren01
Darren01
Posted Last Year
View Quick Profile
Distinguished Member

Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)Distinguished Member (6.5K reputation)

Group: Forum Members
Last Active: 4 Months Ago
Posts: 654, Visits: 4.1K

animagic (9/26/2024)
Darren01 (9/25/2024)
EDIT: I just tried your method of uploading the vocals and then pasting the lyrics as text and then aligning.
It actually worked! I only thought the align feature would work with it's own voice to text conversion.
Acculips voice to text still needs fixing otherwise there is no point in having the feature, but this is a workaround solution.

Using a text file with AccuLips was actually the point (name it the same as the speech file with extension txt and it will load automatically) and part of a suggestion from years ago that had a long time coming being picked up.


What I mean is there is no point having the voice file to text converter option in Acculips if it doesn't work




_________________________________________________________





1
2



Reading This Topic