Profile Picture

Audio scrubbing - especially useful when editing visemes

Posted By justaviking 10 Years Ago
You don't have permission to rate!

Audio scrubbing - especially useful when editing visemes

Author
Message
justaviking
justaviking
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)

Group: Forum Members
Last Active: 2 Weeks Ago
Posts: 8.2K, Visits: 26.5K
Yes, I've been obsessed with visemes lately.

When editing visemes, the waveforms are nice to have, but of limited usefulness.

It would really be nice if you could hear the speaking while sliding the timeline back and forth.

It would be okay (and it might even be best) if it ONLY played the audio of the CURRENTLY SELECTED AVATAR SPEECH AUDIO.

This should be something you could turn on and off.


I've done this on video editors.  It's not something you use all the time, but when you do need it, it is extremely useful.

For viseme editing, it would be extremely helpful to be able to slide the timeline back and forth and here where the "V" is when saying "Whatever."

Today you have to press "Play" (spacebar), but the timeline bar moves too fast.  It's hard to be accurate, and it results in a lot of trial and error.

By "SCRUBBING" I mean it plays the audio when you move the timeline, and it will play as fast or slow as you move the timeline marker.



iClone 7... Character Creator... Substance Designer/Painter... Blender... Audacity...
Desktop (homebuilt) - Windows 10, Ryzen 9 3900x CPU, GTX 1080 GPU (8GB), 32GB RAM, Asus X570 Pro motherboard, 2TB SSD, terabytes of disk space, dual  monitors.
Laptop - Windows 10, MSI GS63VR STEALTH-252, 16GB RAM, GTX 1060 (6GB), 256GB SSD and 1TB HDD

animagic
animagic
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)

Group: Forum Members
Last Active: 1 hour ago
Posts: 15.7K, Visits: 30.5K
I believe this has been requested before, but it is certainly an important feature to have.


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

JC Weatherby
JC Weatherby
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (6.3K reputation)Distinguished Member (6.3K reputation)Distinguished Member (6.3K reputation)Distinguished Member (6.3K reputation)Distinguished Member (6.3K reputation)Distinguished Member (6.3K reputation)Distinguished Member (6.3K reputation)Distinguished Member (6.3K reputation)Distinguished Member (6.3K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 477, Visits: 802
YES! Timeline scrubbing is a MUST HAVE for frame accurate lip sync. This is what separates hobbyists from pros, fellas!

Just found out this is not possible with 5 Pro, and this is the 2nd post I've seen on the topic.

vidi
vidi
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (31.5K reputation)Distinguished Member (31.5K reputation)Distinguished Member (31.5K reputation)Distinguished Member (31.5K reputation)Distinguished Member (31.5K reputation)Distinguished Member (31.5K reputation)Distinguished Member (31.5K reputation)Distinguished Member (31.5K reputation)Distinguished Member (31.5K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 10.8K, Visits: 40.2K
+1

Yes this is a very important features


-------------------------------------------------------------------
liebe Grüße vidi




rampart
rampart
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)

Group: Forum Members
Last Active: 6 Years Ago
Posts: 1.4K, Visits: 5.1K
I think until RL does some extensive programming of the timeline you are better off using a video/audio editor program. I use sony vegas and it is a breeze working with the audio and then applying to the RL timeline. I always finish all iclone projects with final video edits in Sony Vegas as well.

I save hours of time in the process, because a dedicated editor takes into account just about every aspect of working with your audio files efficiently. The audacity is free, and is not to be ignored as it is a quality audio editor.

The RL timeline is a very long way from being as efficient as a Sony Vegas or other video/audio editor. I suggest to only do what you "have to do" with the RL timeline.

IMO, of course...w00t







Edited
10 Years Ago by rampart
justaviking
justaviking
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)Distinguished Member (20.4K reputation)

Group: Forum Members
Last Active: 2 Weeks Ago
Posts: 8.2K, Visits: 26.5K
rampart (9/22/2014)
I think until RL does some extensive programming of the timeline you are better off using a video/audio editor program.

I suspect you misunderstood my post.  Maybe I wrote it poorly.

Using an NLE doesn't help my character form "B" and "M" and "Ooo" shapes with his lips at the right time.

I want the mouth motions to match the speech pattern.  I do not want to speed-up and slow-down the speech to match the mouth animation.

And if I need to insert a missing viseme (mouth shape), or remove excess ones, I cannot to that in my NLE.

The point of the audio scrubbing is to make it easier to match the mouth animation with the audio (the character's speech).

When I press "play" to watch my character talk in realtime, it's hard to stop at a frame-accurate position and fix the visemes without a ton of trial and error.



iClone 7... Character Creator... Substance Designer/Painter... Blender... Audacity...
Desktop (homebuilt) - Windows 10, Ryzen 9 3900x CPU, GTX 1080 GPU (8GB), 32GB RAM, Asus X570 Pro motherboard, 2TB SSD, terabytes of disk space, dual  monitors.
Laptop - Windows 10, MSI GS63VR STEALTH-252, 16GB RAM, GTX 1060 (6GB), 256GB SSD and 1TB HDD

animagic
animagic
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)

Group: Forum Members
Last Active: 1 hour ago
Posts: 15.7K, Visits: 30.5K
As Viking explained, this is to simplify editing visemes and would be a great help. w00t

This is actually one of the nice features in Source Filmmaker. If I remember correctly, Source Filmmaker lets you scrub audio without changing the pitch, which is very useful.

I see I didn't add my +1 yet, so +1!


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

Edited
10 Years Ago by animagic
Sifr
Sifr
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 644, Visits: 3.6K
+1. In addition to that, it would be great to have the viseme shapes attached to the corresponding alphabet keys. Using a Cntrl, Alt, Shift keystroke combination while typing out the words would compliment the scrub feature. IMO.CoolWinkBigGrinHehew00tw00t

----------------------------------------------------------------------------------------------
Reallusion iClone & CC Pipeline --- Plugins: Iray HeadShot SkinGen.  CrazyTalk Animator Pipeline, CrazyTalk, Maya LT, Daz, Substance Painter Indie, Substance Designer Indie, B2M Pro+ Substance Live, Sculptris, Wrap, Unity, UE4, Perception Neuron ReadySmileBigGrinTongueWinkCoolHeheSmoooothCrazySatisfiedWowPinchExclamationAlienDiscussKissArrowSadAngrySickExclamationBlushWhistlingw00tw00tw00t
SurfaceBook 2 Windows 11 Pro 64-bit Intel(R) Core(TM) i7-8650U CPU @ 1.90GHz -2.11 GHz 512GB Solid State Hard Drive 8GB RAM Nvidia GeForce 1050GTX
Dell  Alienware m18X R2 18.5" Custom Convertible Tablet Windows 8.1 Pro 64-bit Intel Core I7-3840QM 2.80GHz Quad Core 8 Thread 3.2GHz Turbo 512GB Solid State Hard Drive+1TB X2 RAID Disk Drive 32GB RAM Nvidia Geforce GTX 680m 2GB X2 SLI Custom Multi-touch. Dagi capacitive touch stylus
Microsoft Surface Pro 2 10.1" Tablet Windows 10 64-bit Intel Core I5-4200U 1.60GHz 2.3GHz Turbo 128GB Solid State Hard Drive 4GB RAM HD 4000 Graphics Multi-touch Wacom Digitizer screen Surface Pen+Axiotron Studio Pen
Asus Vivo Tab 8" Tablet Windows 10 32-bit Intel Atom Z-3740 1.33GHz Quad Core 32GB Solid State Hard Drive 2GB RAM HD 4000 Graphics Multi-touch Wacom Digitizer Wacom stylus.

animagic
animagic
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)

Group: Forum Members
Last Active: 1 hour ago
Posts: 15.7K, Visits: 30.5K
Just like in Congress, where all manner of things are being attached to a proposed bill, I would like to include my repeated request to allow the text of the dialog to aid in the assignment of visemes. As it is now it's kind of pathetic and it could be so much better without our need to do all this editing. It's not new: LipSynch Mimic for Poser had it around 2002. One could learn from that program.


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

Sifr
Sifr
Posted 10 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)Distinguished Member (3.2K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 644, Visits: 3.6K
Weee wwwaaannnttt aaannn aaauuudddiiiooo ssscccrrruuubbbbbbeeerrr tttoooooolll RRRLLL, pppllleeeaaassseee...w00tw00tw00t

----------------------------------------------------------------------------------------------
Reallusion iClone & CC Pipeline --- Plugins: Iray HeadShot SkinGen.  CrazyTalk Animator Pipeline, CrazyTalk, Maya LT, Daz, Substance Painter Indie, Substance Designer Indie, B2M Pro+ Substance Live, Sculptris, Wrap, Unity, UE4, Perception Neuron ReadySmileBigGrinTongueWinkCoolHeheSmoooothCrazySatisfiedWowPinchExclamationAlienDiscussKissArrowSadAngrySickExclamationBlushWhistlingw00tw00tw00t
SurfaceBook 2 Windows 11 Pro 64-bit Intel(R) Core(TM) i7-8650U CPU @ 1.90GHz -2.11 GHz 512GB Solid State Hard Drive 8GB RAM Nvidia GeForce 1050GTX
Dell  Alienware m18X R2 18.5" Custom Convertible Tablet Windows 8.1 Pro 64-bit Intel Core I7-3840QM 2.80GHz Quad Core 8 Thread 3.2GHz Turbo 512GB Solid State Hard Drive+1TB X2 RAID Disk Drive 32GB RAM Nvidia Geforce GTX 680m 2GB X2 SLI Custom Multi-touch. Dagi capacitive touch stylus
Microsoft Surface Pro 2 10.1" Tablet Windows 10 64-bit Intel Core I5-4200U 1.60GHz 2.3GHz Turbo 128GB Solid State Hard Drive 4GB RAM HD 4000 Graphics Multi-touch Wacom Digitizer screen Surface Pen+Axiotron Studio Pen
Asus Vivo Tab 8" Tablet Windows 10 32-bit Intel Atom Z-3740 1.33GHz Quad Core 32GB Solid State Hard Drive 2GB RAM HD 4000 Graphics Multi-touch Wacom Digitizer Wacom stylus.




Reading This Topic