Text to speech without speech?


https://forum.reallusion.com/Topic92730.aspx
Print Topic | Close Window

By djmulcahy - 14 Years Ago
I've been trying to figure out a way to use the text-to-speech option in iC4 without actually having any speech, if that makes any sense.

I simply want the character to lip-sync some dialog without the brutal synthesized voice that accompanies it. If I turn the volume off, no animation plays. If I turn it down to 1 or 2 %, the voice present can still be heard.

Am I missing something simple, or is this just not possible in iClone? I'd be happy to get CrazyTalk, but I have no way of knowing if that would have the fix for me. Anyone else know?

I'm open to suggestions, because my next project involves a lot of lips moving with no actual dialog, and the basic text to speech option seems the easiest way to accomplish this, if I could figure how to get that done.

Thanks!
By Cricky - 14 Years Ago
djmulcahy (9/3/2011)
I've been trying to figure out a way to use the text-to-speech option in iC4 without actually having any speech, if that makes any sense.

I simply want the character to lip-sync some dialog without the brutal synthesized voice that accompanies it. If I turn the volume off, no animation plays. If I turn it down to 1 or 2 %, the voice present can still be heard.

Am I missing something simple, or is this just not possible in iClone? I'd be happy to get CrazyTalk, but I have no way of knowing if that would have the fix for me. Anyone else know?

I'm open to suggestions, because my next project involves a lot of lips moving with no actual dialog, and the basic text to speech option seems the easiest way to accomplish this, if I could figure how to get that done.

Thanks!



Look down below the Viewing screen for your scene,

See the Musical Note?

To the left is a VOCAL Volume Control...this is an overall Volume control, but the lips will move without sound being rendered.

Lip Movement without speech is like hearing after a loud Rock Concert, the only thing everyone hears is HUH?
By Paumanok West - 14 Years Ago
Cricky (9/3/2011)
To the left is a VOCAL Volume Control...this is an overall Volume control, but the lips will move without sound being rendered.


Yes, but it is my impression that the audio still gets written into the AVI file and there is no kill switch for it. As far as I know, it has to be stripped out of the render in a video editor. We need a mute switch for output.
By Darren01 - 14 Years Ago
Crazy Talk definitely allows you to delete the vocals but keep the lip synch
I can't remember precisely how I did it, it wasn't exactly a straight forward procedure though. I think Peter actually suggested how to do it ?
By Rampa - 14 Years Ago
Paumanok West (9/4/2011)
Cricky (9/3/2011)
To the left is a VOCAL Volume Control...this is an overall Volume control, but the lips will move without sound being rendered.


Yes, but it is my impression that the audio still gets written into the AVI file and there is no kill switch for it. As far as I know, it has to be stripped out of the render in a video editor. We need a mute switch for output.


Can this be controlled within the CODEC?
By Paumanok West - 14 Years Ago
rampa (9/5/2011)
Paumanok West (9/4/2011)

Yes, but it is my impression that the audio still gets written into the AVI file and there is no kill switch for it. As far as I know, it has to be stripped out of the render in a video editor. We need a mute switch for output.


Can this be controlled within the CODEC?


No, the codecs for audio and video are separate in most video formats.
By animagic - 14 Years Ago
Darren01 (9/5/2011)
Crazy Talk definitely allows you to delete the vocals but keep the lip synch
I can't remember precisely how I did it, it wasn't exactly a straight forward procedure though. I think Peter actually suggested how to do it ?

In CrazyTalk you can change the sound file, but keep the animation. Replacing the speech file with a sound file with just silence would do it.

By animagic - 14 Years Ago
Paumanok West (9/4/2011)
Cricky (9/3/2011)
To the left is a VOCAL Volume Control...this is an overall Volume control, but the lips will move without sound being rendered.


Yes, but it is my impression that the audio still gets written into the AVI file and there is no kill switch for it. As far as I know, it has to be stripped out of the render in a video editor. We need a mute switch for output.

There is a Mute check mark at the bottom of the right-hand panel for the character, but that doesn't seem to suppress the vocals when unchecked.

By djmulcahy - 14 Years Ago
Okie dokie...

I'm super confused now. So with the vocal volume down, I can turn off the voice in the preview, but not actually in the finished product?

And I probably can in CrazyTalk, but the process isn't very intuitive, apparently.

This seems a little weird... I mean, text to speech is the easiest way to animate speaking, but I'll take a swing and say that no one likes the digitized voices. I'm really surprised there isn't a simple way to animate speech without the voice.

So basically, it's either animate the facial features one word at a time, or buy CrazyTalk and cross my fingers and hope I can figure out how to delete the voice track?
By djmulcahy - 14 Years Ago
Wait... lemme see if I've got this...

The vocal volume slider will mute the voice during the preview, but the mute checkbox will prevent the vocal sound track from being exported?

Is that it?

Or did I just confuse myself more? :D
By Paumanok West - 14 Years Ago
Darren01 (9/5/2011)
Crazy Talk definitely allows you to delete the vocals but keep the lip synch
I can't remember precisely how I did it, it wasn't exactly a straight forward procedure though. I think Peter actually suggested how to do it ?


In CrazyTalk, if I remember that far back, you can click on the audio data and select it for deletion. The lipsync has already been generated and it persists.

I think this is repeating what Darren said.

If this is possible in iClone it would be news to me...
By colour - 14 Years Ago
IMO, P. West has the easiest & quickest solution. Export your project to File DV-AVI or. Uncompressed (RAW) AVI (iclone's Default), in AVI CODEC options Pop-Up. Import that into your NLE Program, if you have one. If you haven't, use Windows Moviemaker, supplied with Windows OS.

Your NLE Program should separate the Audio from the Video Track into a separate Audio Track. Lock the Video Track & Delete the Audio Track & then Render to File DV-AVI again or your chosen Export Format, in your NLE Program..

I hope WMM separates the audio. Haven't used it for many years.

BTW - Goldwave (A free audio Editing Program) separates Audio from Video (I think). I have it & can't remember & haven't time to test it.

I could do a TTS Test in iC4, if & when I have time. I'll be doing TTSs for my current Pinhead project.

By animagic - 14 Years Ago
Just to settle this I did a little test tonight. Moving the Vocal slider all the way to the left does indeed suppress the speech of the character(s), also in the rendered video. The Mute setting I mentioned does not suppress the speech. You can use it to suppress any other sounds associated with the character, such as footsteps.
By AverageJoe - 14 Years Ago
Paumanok West (9/7/2011)
Darren01 (9/5/2011)
Crazy Talk definitely allows you to delete the vocals but keep the lip synch
I can't remember precisely how I did it, it wasn't exactly a straight forward procedure though. I think Peter actually suggested how to do it ?


In CrazyTalk, if I remember that far back, you can click on the audio data and select it for deletion. The lipsync has already been generated and it persists.

I think this is repeating what Darren said.

If this is possible in iClone it would be news to me...

I had just answered this today for a CTA user...  You can audio in the timeline (in Pro), but only after you ungroup it apart first.  Right click on it (in Voice Clip track), and choose Ungroup, this will create separate new tracks under voice and lips.  Delete the voice file, and the lip key frmaes remain, thus your moving mouth with no speech. I dont know about IC tho... Sorry to butt in...

By animagic - 14 Years Ago
It would be nice to have that same option in IC to delete the voice file. Maybe a feature request?