Profile Picture

Automated Lipsyncing / Realtime rendering

Posted By michiyo.wellingtonoguri 10 Months Ago
You don't have permission to rate!
Author
Message
michiyo.wellingtonoguri
michiyo.wellingtonoguri
Posted 10 Months Ago
View Quick Profile
New Member

New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)New Member (24 reputation)

Group: Forum Members
Last Active: 9 Months Ago
Posts: 1, Visits: 20
I like CrazyTalk's ability to create a face making realistic lip movements given text or an audio file.  It seems like it'd be a cool way to provide a face for a real-time chat-bot type program.  

I see two challenges:
* I would need to import the speech programmatically: is there any way to do this without manually using the UI?  Say, a command-line tool or an SDK?
* I would need to display the face outside the CrazyTalk UI without a lengthy rendering time (to keep the conversation flowing)

Do these functionalities exist?  I haven't been able to find any hints of them online or in the forums, but I thought I'd ask. 

Thanks!
Peter (RL)
Peter (RL)
Posted 9 Months Ago
View Quick Profile
Distinguished Member

Distinguished Member (56.3K reputation)Distinguished Member (56.3K reputation)Distinguished Member (56.3K reputation)Distinguished Member (56.3K reputation)Distinguished Member (56.3K reputation)Distinguished Member (56.3K reputation)Distinguished Member (56.3K reputation)Distinguished Member (56.3K reputation)Distinguished Member (56.3K reputation)

Group: Administrators
Last Active: 3 hours ago
Posts: 16.6K, Visits: 25.1K
Unfortunately, CrazyTalk 8 does not include an API or scripting features. All exports are purely video or image based.

These features were available previously with CrazyTalk 7 which had an Interactive Plug-in and Unity Plug-in, but due to compatibility issues with the webplayer it was discontinued.

I'm sorry I can't bring you better news.


                                                                

Peter
Forum Administrator

www.reallusion.com





Reading This Topic