Replica Studios - AI Voice Actor Plugin for Lip-sync Animation

Author	Message
~~Charlene (RL)~~	~~Charlene (RL)~~ Posted 3 Years Ago
Veteran Member Group: Banned Members Last Active: Last Year Posts: 11, Visits: 341	Dear Users, AI Voice Actor is a collaborative project between Reallusion and Replica Studios. The goal is to create a fully automated text to animation pipeline with minimal user intervention. This trailblazing solution enables fast talking animation production without the need to hire voice talent, or even animators. In addition, designers can still fine-tune the AI generated results with iClone's Talking Styles, Viseme Editing, Face Mocap, Face Puppet, or Facial Key Editor. While iClone AccuLips provides text-to-speech animation for the lips, it does not support facial animations. Using Replica’s AI Voice Actor plugin, one can easily and conveniently apply different facial expressions on top of the lip motions to give a mood to the performance, thereby, offering more emotional impact to the audience. Visit the product page at https://www.reallusion.com/iclone/ai-voice-replica/. Required Tools:* iClone 7.92 or above. Replica Plugin (Marketplace > iClone > Plug-in). Replica Studios desktop application. Installation Guide: Getting Started: Step 1: Go to Replicastudios.com, create an account and download Replica Studios Desktop Application. Step 2: Go to the Reallusion Marketplace and download the Replica Plugin. Step 3: Uncompress the ReplicaStudios zip folder Move the unzipped ReplicaStudios folder to C:\Program Files\Reallusion\iClone 7\Bin64\OpenPlugin Step 4: Go to iClone and create a character in the scene. Step 5: Click on Plugins > Replica Studios > Replica Link. Step6: Sign in to Replica Studios desktop application and choose Sandbox. Step7: Choose a speaker, enter the text for TTS conversion, and click on Save Take. Step 8: Choose the character in the scene and click on Replica Link > Select Avatar and notice the status becomes Connected. Note: The character is named RD4, so it becomes evident in the dropdown list. Step 9: Export to iClone. Step 10: Set the Style and adjust the Strength in the Select Animation window and click on Apply. Edited 3 Years Ago by Charlene (RL)
	Reply Quote
~~Charlene (RL)~~	~~Charlene (RL)~~ Posted 3 Years Ago
Veteran Member Group: Banned Members Last Active: Last Year Posts: 11, Visits: 341	Troubleshooting: Scenes with multiple characters Replica Link works on one character at a time. Use the drop-down box in the Replica Link window to select a target character for importing audio. Audio is longer than total frames of project This message appears when your audio is longer than the total frames for the project. Simply click on “Edit > Project Settings > change Total Frames > Export to iClone from the Replica Studios desktop application once more. No character in the scene This message appears when there is no character in the scene. Connection error This message appears when there are issues with the connection. Check your internet connection or try restarting the Replica Studios desktop application. Replica Studios desktop application is not open This message appears when either Replica Studios desktop application is closed or when a character has not been selected, in which case you should click on the Select Avatar button. Update iClone to 7.92 or above This message appears when you haven’t updated to iClone 7.92 or above, so auto-animation and auto-expressions are not available. More guidance on Replica If you need more guidance or help to use Replica Studios desktop application, click on Replica Link > Getting Started Guide to access Replica Studio’s Help Center. Or you can join Replica Studios’s Discord Changing expressions The new embedded Expression_Loop asset in iClone 7.92 lets you change expressions. Just go to Content > Animation > Template > Animation Template > Face > Expression Loop > All. Edited 3 Years Ago by Charlene (RL)
	Reply Quote
wires	wires Posted 3 Years Ago
Distinguished Member Group: Forum Members Last Active: Last Week Posts: 5.7K, Visits: 26.4K	Thank you all at Reallusion for this truly amazing addition for iClone, and one that many have been requesting for a long time. I sincerely hope that it doesn't get cancelled in the same way as the last TTS offer. Gerry System: Win 10 Pro (21H2), Asus X99-E WS, CPU i7-5930K -3,5 GHz, 32 GB DDR4 2666-16 RAM, NVidia GTX 1080 Ti GPU - 11 GB VRAM(Driver Studio-536.99), Samsung 850 Pro 512 GB SSD, 6 TB HD storage.
	Reply Quote
toystorylab	toystorylab Posted 3 Years Ago
Distinguished Member Group: Forum Members Last Active: 5 hours ago Posts: 4.4K, Visits: 28.8K	Cool... Works fine! Toystorylab on Vimeo : Crassitudes (my "Alter Ego") on Youtube:
	Reply Quote
argus1000	argus1000 Posted 3 Years Ago
Distinguished Member Group: Forum Members Last Active: Today @ 12:42 AM Posts: 585, Visits: 11.3K	Wow! This is fantastic! My latest movie THE GOLDEN MAN, and a few others: https://www.youtube.com/channel/UCIl1EqVCKitZzLqaNnLK0BA
	Reply Quote
rosuckmedia	rosuckmedia Posted 3 Years Ago
Distinguished Member Group: Forum Members Last Active: 13 hours ago Posts: 3.1K, Visits: 4.7K	Cool Many Thank 👍👍 you, I've already tried it, works very well. Greetings rosuckmedia
	Reply Quote
4u2ges	4u2ges Posted 3 Years Ago
Distinguished Member Group: Forum Members Last Active: Yesterday Posts: 5.0K, Visits: 15.9K	It would have been great if important announcements threads would also stay pinned at the very top for a few days in the "Latest" threads list. A lot of people (including myself) are using "Latest" exclusively.
	Reply Quote
michaelrbarton	michaelrbarton Posted 3 Years Ago
Distinguished Member Group: Forum Members Last Active: Last Month Posts: 952, Visits: 11.0K	I got it working now. Edited 3 Years Ago by michaelrbarton
	Reply Quote
Leowald	Leowald Posted 3 Years Ago
Veteran Member Group: Forum Members Last Active: 2 Weeks Ago Posts: 81, Visits: 2.8K	This plugin looks very intersting, but it looks like it's english only. But maybe I'm wrong?
	Reply Quote
toystorylab	toystorylab Posted 3 Years Ago
Distinguished Member Group: Forum Members Last Active: 5 hours ago Posts: 4.4K, Visits: 28.8K	You get 4 hours free as iClone User + regular free 30 min as starter. So plenty enough to test and see/hear whether this is something you want to add to pipeline. Regarding price, I would say 6,- $ per hour is not expensive. And if you are sure you want to use this for several projects, you even get package for 3,- $ per hour (100 hours for 300,- $) For comparison, prices Acapela Box (which I used quite a lot): https://acapela-box.com/AcaBox/acabox-prices.php So way cheaper than Acapela Box... Plus, your text automatically transforms into an AccuLips animation within seconds! You can also create your own TTS voice, I did the first steps 6 months ago, but did not complete as it takes several recordings. Might take that up again. So, I would say, give it a try as it is for free. Here is a quick test: Toystorylab on Vimeo : Crassitudes (my "Alter Ego") on Youtube:
	Reply Quote

Replica Studios - AI Voice Actor Plugin for Lip-sync Animation

Replica Studios - AI Voice Actor Plugin for Lip-sync Animation

Reading This Topic