Profile Picture

Music video with iClone + Stable Diffusion AI combined

Posted By thkro 2 Years Ago
Rated 5 stars based on 1 vote.
Author
Message
thkro
thkro
Posted 2 Years Ago
View Quick Profile
Senior Member

Senior Member (304 reputation)Senior Member (304 reputation)Senior Member (304 reputation)Senior Member (304 reputation)Senior Member (304 reputation)Senior Member (304 reputation)Senior Member (304 reputation)Senior Member (304 reputation)Senior Member (304 reputation)

Group: Forum Members
Last Active: Last Week
Posts: 17, Visits: 70
To try something new I made a lip-synced music video and morphed the original iClone character via Stable Diffusion 2.1 AI into something new (actually what you see are actually 8 famous singers morphed sequentially into one).

Of course a lot of the finer details of the lip-syncing were lost, but this is just a first test, I think this can be done better once I understand this AI stuff better.
Feedback (good or bad) very welcomed: https://www.youtube.com/watch?v=JRHaY_ei6uI
AutoDidact
AutoDidact
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)Distinguished Member (6.1K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 2.1K, Visits: 13.6K
I think you could have gotten a better AI lipsynch if you had uploaded a still image of your Character to  this site:
not perfect either but still a little more coherent than
Stable Diffusion atm.



RAG DOLL COLLISION ANIMATIONS FOR ICLONE 8 & 7
---------------------------------------------------------------------------------------------------------------------
Ghost Origins
My latest Feature length film created with Iclone.
https://forum.reallusion.com/uploads/images/adf9b210-df59-4cb6-aa1b-9de5.jpg
My Sci- Fi Graphic Novel on Amazon: https://a.co/d/9k3cwoY


razaverse
razaverse
Posted 2 Years Ago
View Quick Profile
Senior Member

Senior Member (444 reputation)Senior Member (444 reputation)Senior Member (444 reputation)Senior Member (444 reputation)Senior Member (444 reputation)Senior Member (444 reputation)Senior Member (444 reputation)Senior Member (444 reputation)Senior Member (444 reputation)

Group: Forum Members
Last Active: Last Year
Posts: 26, Visits: 137
Pretty cool but for the price they are asking, you cannot create long videos. Here I am assuming 15 mins in the pricing plan means that we can create video only 15 mins long on a PRO plan.
wendyluvscatz
wendyluvscatz
Posted 2 Years Ago
View Quick Profile
Senior Forum Member

Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)Senior Forum Member (12.2K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 2.5K, Visits: 19.4K
I have gotten very good results with Crazytalk 8
I do believe Cartoon Animator has a version of Crazytalk inbuit too, the old Cartoon animator 2 I have has
Cartoon Animator may be worth looking at to animate your AI art in general (sadly I never seem to have enough money too buy it but want to one day)
I won't link any of my Crazytalk videos because when I did my thread was removed because it was suggested I was promoting ai art generators
it is a bit of a controversial topic







Reading This Topic