Profile Picture

Waveforms In The Track For Better Lip-synching

Posted By NaturalGlitch 2 Years Ago
You don't have permission to rate!
Author
Message
NaturalGlitch
NaturalGlitch
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 84, Visits: 1.0K
Unless this is a normal feature, of course, I just haven't found it yet.

Also, a way to is audibly and visually lip-sync your audio by matching typed words and phonetic sounds to the audio waveform, like the software called Papagayo did for Anime Studio (before it disappeared, I guess).
https://forum.reallusion.com/uploads/images/c1309598-d62d-4e75-9864-d5d1.png
Rampa
Rampa
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (31.8K reputation)Distinguished Member (31.8K reputation)Distinguished Member (31.8K reputation)Distinguished Member (31.8K reputation)Distinguished Member (31.8K reputation)Distinguished Member (31.8K reputation)Distinguished Member (31.8K reputation)Distinguished Member (31.8K reputation)Distinguished Member (31.8K reputation)

Group: Forum Members
Last Active: 39 minutes ago
Posts: 7.8K, Visits: 50.8K
Text, no. Phonemes, yes.


gordryd
gordryd
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (3.4K reputation)Distinguished Member (3.4K reputation)Distinguished Member (3.4K reputation)Distinguished Member (3.4K reputation)Distinguished Member (3.4K reputation)Distinguished Member (3.4K reputation)Distinguished Member (3.4K reputation)Distinguished Member (3.4K reputation)Distinguished Member (3.4K reputation)

Group: Forum Members
Last Active: Today @ 12:49 AM
Posts: 543, Visits: 6.1K
If you are willing to delve into using Python scripts (not too intimidating), KT provided a script to use Papagayo in iClone.  Link here:  https://forum.reallusion.com/427265/Improved-Papagayo-Script?Keywords=papagayo



Reallusion Certified Director / Reallusion Best Visual Award / Reallusion Certified Content Developer
See all the G-Tools Plug-Ins available for iClone here: G-Tools Plug-Ins
garylearntech
garylearntech
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 154, Visits: 2.2K
What I think you're after is available in CA4 (and was previously available in CTA3, so it's not a new feature).

Show the Face-related tracks and expand the Voice Clip within that, as shown here in one of the demo projects that comes with CA4 (demo #15).

https://forum.reallusion.com/uploads/images/4ab616b6-9a6a-4e3c-ac06-37e6.png


---
Cartoon Animator 4 Pipeline (always the current production version, unless otherwise stated)
macOS Big Sur (11.6.2)
Signature data last updated 2021-12-27

NaturalGlitch
NaturalGlitch
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)Distinguished Member (1.1K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 84, Visits: 1.0K
Ah~ I see. These are all great advice! iClone looks so impressive; I wish I had enough time to mess with that.

Even though I don't understand Python, I still downloaded his script. 

As for the waveforms...yeah, my bad. I animate some of my favorite YouTube videos, and I used Shotcut to turn the footage into a WAV file — so I import it into the Music tab in Cartoon Animator 4. I can't find the option to turn on Waveforms in the Music, and Sound FX tabs are what I meant in my original post; I should've clarified that. Sorry.
garylearntech
garylearntech
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 154, Visits: 2.2K
NaturalGlitch (1/3/2020)
<snip>
 I can't find the option to turn on Waveforms in the Music, and Sound FX tabs are what I meant in my original post; I should've clarified that. Sorry.

I'm fairly sure the bit I illustrated only works when the audio is imported into a character - and not as standalone audio as you describe.  But since you mentioned lip-synching, that should be okay, yeah?

---
Cartoon Animator 4 Pipeline (always the current production version, unless otherwise stated)
macOS Big Sur (11.6.2)
Signature data last updated 2021-12-27




Reading This Topic