|
Author
|
Message
|
|
josh_177552
|
josh_177552
Posted 3 Years Ago
|
|
Group: Forum Members
Last Active: 3 Years Ago
Posts: 6,
Visits: 56
|
I would like to use Python to access the AccuLips feature with a .wav and .txt source file. I am able to create lipsync that is equivalent to choosing "Audio File" as the lipsync source with the following code: import RLPy avatar_list = RLPy.RScene.GetAvatars() avatar = avatar_list[0] viseme_component = avatar.GetVisemeComponent() audio = RLPy.RAudio.CreateAudioObject()audio.Load("filename.wav") result = viseme_component.LoadVocal(audio, RLPy.RGlobal.GetTime(), "Clip Name")
However, I see no way to do this with the AccuLips feature. How can I accomplish this?
I have looked through the documentation and RLPy.py and I was not able to find anything at all.
|
|
|
|
|
wires
|
|
|
Group: Forum Members
Last Active: 3 days ago
Posts: 5.7K,
Visits: 26.4K
|
Why would you need to load the files in that way? AccuLips will import both an audio and a text file if both have the same name and sync them.
Gerry
System: Win 10 Pro (21H2), Asus X99-E WS, CPU i7-5930K -3,5 GHz, 32 GB DDR4 2666-16 RAM, NVidia GTX 1080 Ti GPU - 11 GB VRAM(Driver Studio-536.99), Samsung 850 Pro 512 GB SSD, 6 TB HD storage.
|
|
|
|
|
josh_177552
|
josh_177552
Posted 3 Years Ago
|
|
Group: Forum Members
Last Active: 3 Years Ago
Posts: 6,
Visits: 56
|
wires (7/20/2021)
Why would you need to load the files in that way? AccuLips will import both an audio and a text file if both have the same name and sync them.I have 4000 lines of dialogue to process and would prefer not to do it manually.
|
|
|
|
|
animagic
|
animagic
Posted 3 Years Ago
|
|
Group: Forum Members
Last Active: 8 hours ago
Posts: 15.7K,
Visits: 30.5K
|
I don't think that the Python API has been updated to include AccuLips. 4000 lines of dialog is an awful lot, so you would need to split that up anyway. That in itself would be more work than running AccuLips after that.
|
|
|
|
|
Rampa
|
|
|
Group: Forum Members
Last Active: 6 hours ago
Posts: 8.1K,
Visits: 60.5K
|
|
|
|
|
|
josh_177552
|
josh_177552
Posted 3 Years Ago
|
|
Group: Forum Members
Last Active: 3 Years Ago
Posts: 6,
Visits: 56
|
animagic (7/20/2021)
I don't think that the Python API has been updated to include AccuLips.
4000 lines of dialog is an awful lot, so you would need to split that up anyway. That in itself would be more work than running AccuLips after that.The lines are split up and I have .wav files and .txt files for each of them. Using the user interface, even if I spent 1 minute on each line it would take 2 weeks to get through them.
|
|
|
|
|
animagic
|
animagic
Posted 3 Years Ago
|
|
Group: Forum Members
Last Active: 8 hours ago
Posts: 15.7K,
Visits: 30.5K
|
@josh: So I assume your desired output is a MotionPlus file for each line? Currently, that would be the only way to record the facial animation, AFAIK. We used to have .iTalk files, but I think that's old hat. That said, there may be other options that I'm not aware of... 
Edited
3 Years Ago by
animagic
|
|
|
|
|
josh_177552
|
josh_177552
Posted 3 Years Ago
|
|
Group: Forum Members
Last Active: 3 Years Ago
Posts: 6,
Visits: 56
|
animagic (7/21/2021)
@josh: So I assume your desired output is a MotionPlus file for each line? Currently, that would be the only way to record the facial animation, AFAIK. We used to have .iTalk files, but I think that's old hat. That said, there may be other options that I'm not aware of... I am exporting a custom file format from the blend weight, bone transform, and phoneme values I am able to access on the viseme component. I have the whole automation process fully working using the older lipsync function that only uses the audio file for input. So the problem is not with the export, only with making the input be used in the desired way (AccuLips as opposed to the older, previously existing automatic lipsync function). The only thing I am missing is the AccuLips feature which produces noticeably better lipsync.
|
|
|
|
|
josh_177552
|
josh_177552
Posted 3 Years Ago
|
|
Group: Forum Members
Last Active: 3 Years Ago
Posts: 6,
Visits: 56
|
I found that iClone is using a free, open source software called Montreal Forced Aligner to generate the phonemes, which is the main data I wanted to generate.
So, I have instead built my pipeline around this same software and skipped iClone entirely. Maybe I will find a use for iClone in the future.
|
|
|
|
|
mtakerkart
|
mtakerkart
Posted 3 Years Ago
|
|
Group: Forum Members
Last Active: 9 hours ago
Posts: 3.1K,
Visits: 28.1K
|
I found that iClone is using a free, open source software called Montreal Forced Aligner to generate the phonemes, which is the main data I wanted to generate.
So, I have instead built my pipeline around this same software and skipped iClone entirely. Maybe I will find a use for iClone in the future
I started this thread last month about the montreal forced aligner :
https://forum.reallusion.com/Topic486876.aspx
Could you share/show what pipeline you use ? I would like to use french acculips.
Thank you
Edited
3 Years Ago by
mtakerkart
|
|
|
|