Profile Picture

Synchronizing speech

Posted By TimV 11 Years Ago
You don't have permission to rate!
1
2
3
4
5
6
7

Author
Message
TimV
TimV
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)

Group: Forum Members
Last Active: 7 Years Ago
Posts: 126, Visits: 426
Hi Mark

Thank you for posting your music video.  I agree with the previous posting that it is amazing.  There's a great deal of creativity and artistry in it.  You have thrown a gauntlet for me so to speak since I seem to be in a bit of a medieval phase right now.  My imagination is way ahead of my abilities, though.

I made some decent progress with Audacity, but I am not happy with what I will have to do to stretch the words to match the mp3.  Blocking to the start of each line wasn't bad though.  I'm going to see what I can do on the text timing with syltEditor.  “synchronized lyrics or text”.  I did end up down the rabbit hole because sylt introduces the prospect of LRC which was supposed to make my life easier.  LRC digressed to support from Sony and the supporting software from Sony re-cataloged all the video, music and photos on my machine for most of the morning for absolutely no good reason.  It obviously wasn't and LRC editor :)

I've hit a fork in the rabbit hole which has led me to Subtitle Workshop for the timing implications (and also because I found no way to add an SYLT packet onto my MP3)  I've read that once I get my text working, I can run a fake video in Visual Sub Sync (ie my MP3 audio file) to line everything up.

So, well....  I will report back, especially with anything positive.

Thanks

Tim

There are surely times when it is good to be stubborn.  Knowing when is the gift of experience.

mark
mark
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 4.9K, Visits: 16.7K
Hee. Hee....Well you're kind but I really was trying to get the lip-sync right :P


PROMO-BACK2
Click here to go to my YouTube Channel filled with iClone Tutes and Silly Stuff

Visit ANIMATED PROJECTIONS Powered by iCLONE

Intel Core i7 3960X @ 3300MHz Overclocked to 4999.7 MHz Sandy Bridge 24.0GB DDR3 @ 833MHz Graphic Display HP ZR30w 
GeForce GTX 980Ti 6GB  Microsoft Windows 7 Professional 64-bit SP1 ASUSTeK COMPUTER INC. P9X79 WS (LGA2011)



prabhatM
prabhatM
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)

Group: Forum Members
Last Active: 6 Years Ago
Posts: 1.8K, Visits: 8.1K
mark (5/4/2015)
I'm sure folks are gettin' sick of my repeated example cause it ain't that good. I think I could do a better job now.  I recorded a  "talk-the-lyrics-in-time" audio file route. It worked OK but with a bit more tweaking the visemes it could have been even better I'm guessing...





Do you think anybody really cares about the LipSyncing in this movie?

The whole thing is so amazing !

mark
mark
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)Distinguished Member (12.8K reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 4.9K, Visits: 16.7K
I'm sure folks are gettin' sick of my repeated example cause it ain't that good. I think I could do a better job now.  I recorded a  "talk-the-lyrics-in-time" audio file route. It worked OK but with a bit more tweaking the visemes it could have been even better I'm guessing...





PROMO-BACK2
Click here to go to my YouTube Channel filled with iClone Tutes and Silly Stuff

Visit ANIMATED PROJECTIONS Powered by iCLONE

Intel Core i7 3960X @ 3300MHz Overclocked to 4999.7 MHz Sandy Bridge 24.0GB DDR3 @ 833MHz Graphic Display HP ZR30w 
GeForce GTX 980Ti 6GB  Microsoft Windows 7 Professional 64-bit SP1 ASUSTeK COMPUTER INC. P9X79 WS (LGA2011)



prabhatM
prabhatM
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)

Group: Forum Members
Last Active: 6 Years Ago
Posts: 1.8K, Visits: 8.1K
In India, we have a superstar who uses only FOUR expressions in all his movies and he openly says it.

He says given a dialogue, he decides which combination to use - 4+2+3+1 or 2+4+1+3.

This lipsync looks like that.


Is the quality spurious because it's a rush job or lack of possibilities in 3dX4 to import all the data?
TimV
TimV
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)Distinguished Member (1.3K reputation)

Group: Forum Members
Last Active: 7 Years Ago
Posts: 126, Visits: 426
Hi All:

I may be off down a rabbit hole, but I will let you know. Balabolka will not do what I need it to do. I did find an SYLT editor (called SYLT Editor) which is intended to synchronize lyrics or text to MP3s. According to the documentation, you can break up the text file down to individual syllables if you want to go that far. I have attached the manual as a reference. I think this is going to work.

regards,

Tim

There are surely times when it is good to be stubborn.  Knowing when is the gift of experience.

Attachments
sylteditor.pdf (4.0K views, 134.00 KB)
Rampa
Rampa
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 8.2K, Visits: 62.6K
Can you post an FBX of some random bit of a face speaking? I find plenty of BVH examples, but an already functioning face would be fun to experiment with.
Rampa
Rampa
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 8.2K, Visits: 62.6K
prabhatM (5/3/2015)
rampa (5/3/2015)
sw00000p (5/3/2015)
"Does iClone 6 import facial animation?"
...rampa, ...or does anybody else know? :ermm:

If so, Tim would just import the animation and Drop the Sound Track!:)
This is what I do using (3dxchange 4.0) :Wow:






Kind Regards,
sw00000p :cool:






You can do what you used to do in 3DX4, that is import bone based animation that happens to be facial bones, but not characterize it. It's the getting of the animation that may prove difficult. You could try "frankensteining" a mocap head onto an iClone body.

Do you have a way to record bone based facial animation, sw00000p?

So.... Sort of.


Sw00000p has been claiming too often bringing the facial animation to ICLONE through 3DX4. I and the newbies would love to see a sample of that.


Until you characterize it and define certain bones as "facial", your playing prop animation that happens to be in the shape of a human face. So yeah, it's not hard to do. The difficutly comes in making it an iClone avatar, and capturing it in the first place if you don't have the software.
prabhatM
prabhatM
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)Distinguished Member (6.6K reputation)

Group: Forum Members
Last Active: 6 Years Ago
Posts: 1.8K, Visits: 8.1K
rampa (5/3/2015)
sw00000p (5/3/2015)
"Does iClone 6 import facial animation?"
...rampa, ...or does anybody else know? :ermm:

If so, Tim would just import the animation and Drop the Sound Track!:)
This is what I do using (3dxchange 4.0) :Wow:






Kind Regards,
sw00000p :cool:






You can do what you used to do in 3DX4, that is import bone based animation that happens to be facial bones, but not characterize it. It's the getting of the animation that may prove difficult. You could try "frankensteining" a mocap head onto an iClone body.

Do you have a way to record bone based facial animation, sw00000p?

So.... Sort of.


Sw00000p has been claiming too often bringing the facial animation to ICLONE through 3DX4. I and the newbies would love to see a sample of that.
Rampa
Rampa
Posted 11 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)Distinguished Member (37.5K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 8.2K, Visits: 62.6K
sw00000p (5/3/2015)
"Does iClone 6 import facial animation?"
...rampa, ...or does anybody else know? :ermm:

If so, Tim would just import the animation and Drop the Sound Track!:)
This is what I do using (3dxchange 4.0) :Wow:






Kind Regards,
sw00000p :cool:






You can do what you used to do in 3DX4, that is import bone based animation that happens to be facial bones, but not characterize it. It's the getting of the animation that may prove difficult. You could try "frankensteining" a mocap head onto an iClone body.

Do you have a way to record bone based facial animation, sw00000p?

So.... Sort of.

1
2
3
4
5
6
7



Reading This Topic