Profile Picture

How do I display the spoken word text over the Voice timeline?

Posted By ifarkas 3 Years Ago
You don't have permission to rate!

How do I display the spoken word text over the Voice timeline?

Author
Message
ifarkas
Question.png
ifarkas
Posted 3 Years Ago
View Quick Profile
Senior Member

Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)Senior Member (405 reputation)

Group: Forum Members
Last Active: 3 Years Ago
Posts: 18, Visits: 57
Hi Dev Support,How do I display the spoken word text over the Voice in the Viseme timeline, like in the image below (AccuLips)?I'd like to do the same in a Python plugin, please.Thx, Ivan
Johnny (RL)
This post has been flagged as an answer
Johnny (RL)
Posted 3 Years Ago
View Quick Profile
Junior Member

Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)

Group: Forum Members
Last Active: Last Year
Posts: 17, Visits: 646
ifarkas (9/6/2022)
Hi Dev Support,How do I display the spoken word text over the Voice in the Viseme timeline, like in the image below (AccuLips)?I'd like to do the same in a Python plugin, please.Thx, Ivan


The Python API is currently unable to add spoken word text over the viseme clip.
This feature is expected to be added in the next verseion.
Johnny (RL)
This post has been flagged as an answer
Johnny (RL)
Posted 3 Years Ago
View Quick Profile
Junior Member

Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)

Group: Forum Members
Last Active: Last Year
Posts: 17, Visits: 646
Unfortunately, iClone doesn't currently support the ability to add text tracks, so the Python API doesn't currently have either.
Johnny (RL)
This post has been flagged as an answer
Johnny (RL)
Posted 3 Years Ago
View Quick Profile
Junior Member

Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)Junior Member (180 reputation)

Group: Forum Members
Last Active: Last Year
Posts: 17, Visits: 646
Hi ifarkas,

This feature is added in iClone 8.1, You can add the spoken word while creating a viseme clip.
A new version will be released in the next few days, thanks.

        clip_time = RLPy.IndexedFrameTime(0, RLPy.RGlobal.GetFps()) # create clip at frame 0
        viseme_list = RLPy.RVisemeKeyVector()
        for i in range(len(MSVisemeOffset)):
            key = RLPy.RVisemeKey()
            key.SetID(ms_mapping_dict[MSVisemeID[i]])
            key.SetTime(RLPy.RTick.FromMilliSecond(int(MSVisemeOffset[i])))
            key.SetWeight(1.0)
            viseme_list.append(key)

        word_list = RLPy.RWordDataVector()
        word1 = RLPy.RWordData()
        word1.m_kStart = RLPy.RTick.FromMilliSecond(int(MSVisemeOffset[0]))
        word1.m_kEnd = RLPy.RTick.FromMilliSecond(int(MSVisemeOffset[10]))
        word1.m_strText = "Hi"
        word_list.append(word1)

        word2 = RLPy.RWordData()
        word2.m_kStart = RLPy.RTick.FromMilliSecond(int(MSVisemeOffset[10]))
        word2.m_kEnd = RLPy.RTick.FromMilliSecond(int(MSVisemeOffset[20]))
        word2.m_strText = "Maddie"
        word_list.append(word2)

        wav_path = dataset_path + "HiMaddie.wav"    
        audio_object = RLPy.RAudio.CreateAudioObject()
        audio_object.Load(wav_path)
        result = self.viseme_animator.AddVisemesClipWithData(clip_time, "VisemeClip", audio_object, viseme_list, word_list, "Hi! Maddie")



Reading This Topic