Replica Studios - AI Voice Actor Plugin for Lip-sync Animation

Dear Users,

AI Voice Actor is a collaborative project between Reallusion and Replica Studios. The goal is to create a fully automated text to animation pipeline with minimal user intervention. This trailblazing solution enables fast talking animation production without the need to hire voice talent, or even animators. In addition, designers can still fine-tune the AI generated results with iClone's Talking Styles, Viseme Editing, Face Mocap, Face Puppet, or Facial Key Editor.

*While iClone AccuLips provides text-to-speech animation for the lips, it does not support facial animations. Using Replica’s AI Voice Actor plugin, one can easily and conveniently apply different facial expressions on top of the lip motions to give a mood to the performance, thereby, offering more emotional impact to the audience.

Visit the product page at https://www.reallusion.com/iclone/ai-voice-replica/.

Required Tools:

iClone 7.92 or above.
Replica Plugin (Marketplace > iClone > Plug-in).
Replica Studios desktop application.

Installation Guide:

Getting Started:

Step 1: Go to Replicastudios.com, create an account and download Replica Studios Desktop Application.

https://forum.reallusion.com/uploads/images/1d3006b2-7a16-436c-8a64-7eb8.jpg

Step 2: Go to the Reallusion Marketplace and download the Replica Plugin.

Step 3: Uncompress the ReplicaStudios zip folder

https://forum.reallusion.com/uploads/images/598228dc-ea14-4d44-8492-f97e.jpg

Move the unzipped ReplicaStudios folder to C:\Program Files\Reallusion\iClone 7\Bin64\OpenPlugin

https://forum.reallusion.com/uploads/images/bab2c0b5-ac70-4b62-819c-ca1d.png

Step 4: Go to iClone and create a character in the scene.

https://forum.reallusion.com/uploads/images/c03cb8cf-5418-45f6-8aea-8937.jpg

Step 5: Click on Plugins > Replica Studios > Replica Link.

https://forum.reallusion.com/uploads/images/8ae59b8b-116f-40bc-9616-833c.jpg

Step6: Sign in to Replica Studios desktop application and choose Sandbox.

https://forum.reallusion.com/uploads/images/d40e5042-d716-45d4-9639-b8de.jpg

Step7: Choose a speaker, enter the text for TTS conversion, and click on Save Take.

https://forum.reallusion.com/uploads/images/86215cde-b61a-4130-b154-e841.jpg

Step 8: Choose the character in the scene and click on Replica Link > Select Avatar and notice the status becomes Connected.

Note: The character is named RD4, so it becomes evident in the dropdown list.

https://forum.reallusion.com/uploads/images/e8d8b032-4108-46f4-9ed4-9a1d.jpg

Step 9: Export to iClone.

https://forum.reallusion.com/uploads/images/10b58770-132b-43a0-a0fa-e320.jpg

Step 10: Set the Style and adjust the Strength in the Select Animation window and click on Apply.

https://forum.reallusion.com/uploads/images/86903c38-6d91-43b8-8207-36b6.jpg

Author	Message
~~Charlene (RL)~~	~~Charlene (RL)~~ Posted 5 Years Ago
Veteran Member Group: Banned Members Last Active: 3 Years Ago Posts: 11, Visits: 341	Dear Users, AI Voice Actor is a collaborative project between Reallusion and Replica Studios. The goal is to create a fully automated text to animation pipeline with minimal user intervention. This trailblazing solution enables fast talking animation production without the need to hire voice talent, or even animators. In addition, designers can still fine-tune the AI generated results with iClone's Talking Styles, Viseme Editing, Face Mocap, Face Puppet, or Facial Key Editor. While iClone AccuLips provides text-to-speech animation for the lips, it does not support facial animations. Using Replica’s AI Voice Actor plugin, one can easily and conveniently apply different facial expressions on top of the lip motions to give a mood to the performance, thereby, offering more emotional impact to the audience. Visit the product page at https://www.reallusion.com/iclone/ai-voice-replica/. Required Tools:* iClone 7.92 or above. Replica Plugin (Marketplace > iClone > Plug-in). Replica Studios desktop application. Installation Guide: Getting Started: Step 1: Go to Replicastudios.com, create an account and download Replica Studios Desktop Application. Step 2: Go to the Reallusion Marketplace and download the Replica Plugin. Step 3: Uncompress the ReplicaStudios zip folder Move the unzipped ReplicaStudios folder to C:\Program Files\Reallusion\iClone 7\Bin64\OpenPlugin Step 4: Go to iClone and create a character in the scene. Step 5: Click on Plugins > Replica Studios > Replica Link. Step6: Sign in to Replica Studios desktop application and choose Sandbox. Step7: Choose a speaker, enter the text for TTS conversion, and click on Save Take. Step 8: Choose the character in the scene and click on Replica Link > Select Avatar and notice the status becomes Connected. Note: The character is named RD4, so it becomes evident in the dropdown list. Step 9: Export to iClone. Step 10: Set the Style and adjust the Strength in the Select Animation window and click on Apply.

Replica Studios - AI Voice Actor Plugin for Lip-sync Animation

Replica Studios - AI Voice Actor Plugin for Lip-sync Animation

Threaded View

Reading This Topic