AUTO-DRIVEN ANIMATION


https://forum.reallusion.com/Topic263136.aspx
Print Topic | Close Window

By JIX - 11 Years Ago
Animating the vertical size of a row of cubes to make them dance like an equalizer display effect, for instance, or even moving a character with the music.

Thanks pumeco for bringing up that topic (again) in another thread!
By pumeco - 11 Years Ago

Thanks for the link, JJJAM, and absolutely +1 here for this :)
Actually, make that +100 if itls allowed cause this feature is way overdue!

If I recall, I think it was either Job or PSD once said to me they requested a thread for this many years ago.  Can't find it though.  But yup, all they'd need is what's commonly called a 'Parametric DJ Filter' so that we can isolate any sound frequency of a playing sound file and have it drive a chosen axis, or size, or scale, or colour, or whatever else would be cool to drive by audio.  If you wanted a cube to get taller in time to a beat, for example, you'd just set the EQ to isolate (pick-up on) the bass frequencies, and assign it to the cube's height axis.

Fun stuff :w00t:


By JIX - 11 Years Ago
So there are two supporters of that idea. That should be enough to convince RL! ;)
By Rampa - 11 Years Ago
The CTS scripts are still going to tranferable to iClone, but that will be upper body only. I would think that things like typing, dancing, and any repetitive motion thing would be fun to control this way.
By Snarp Farkle - 11 Years Ago
I too would like to see this feature added.  There's something like it in a DAZ script someone put together but I haven't played with it yet.
By animagic - 11 Years Ago
To make this more versatile, I would like to add MIDI support as well.
By JIX - 11 Years Ago
@rampa
So we need lower body as well and don´t forget the props!

@Snarp
There is a DAZ script?! I overlooked that one, I guess. How is it called?

@animagic
Yes! MIDI support would be great!
By pumeco - 11 Years Ago

@Job

Out of curiosity, what do you envisage being able to do by MIDIfying it?



By JIX - 11 Years Ago
pumeco (12/8/2015)

@Job

Out of curiosity, what do you envisage being able to do by MIDIfying it?


Using MIDI files directly as input for the auto-animation, or animate via MIDI controllers. That´s what I was thinking, but maybe there are even more options ...

By AverageJoe - 11 Years Ago
pumeco (12/8/2015)

@Job

Out of curiosity, what do you envisage being able to do by MIDIfying it?


http://www.animusic.com/

All animated and controlled via MIDI...  Each 3D instrument is a working copy, so when the note B is played, a specific animation is played.  So take a guitar for example.  The fingering for a G chord is animated with fingers on a guitar fret, then when played via a MIDI controller, the fingers do the animation action, i.e. finger the G chord.  All of the music and animations in these DVDs are wired together this way.  It's pretty freaking amazing to watch when you consider that each fingering, each drum hit is an animation sequence triggered by a specific note within a specific MIDI track.

There's one clip with balls striking drums that is phenomenal.

By JIX - 11 Years Ago
Gosh ... sorry, but this is super ultra gay! :w00t:


By animagic - 11 Years Ago
Yep, that's the idea...:cool:
By pumeco - 11 Years Ago

@Wizaerd
Cool stuff :cool:


@JJJAM
So you're the guy who goes around YouTube telling everyone their video is gay? :D



@Job
Yup, would be cool to have MIDI, though I don't think they'd add it in with the Audio thing due to it being two completely different types of data.
MIDI input would be very cool for puppeteering stuff live as well, like steering a car using a bitch-bend or a knob :cool:



By AverageJoe - 11 Years Ago
JJJAM (12/8/2015)
Gosh ... sorry, but this is super ultra gay! :w00t:




I don't know nor understand why anyone would say that...  Personally, I think it's amazing.  All the Animusic clips are amazing, especially when you start to consider the technology driving it.  Granted, some are better than others, but overall, MIDI driven animations before anyone else did it?  And the synchronization is perfect.  As I said, I think it's pretty amazing.

By AverageJoe - 11 Years Ago
pumeco (12/9/2015)

@Job
Yup, would be cool to have MIDI, though I don't think they'd add it in with the Audio thing due to it being two completely different types of data.
MIDI input would be very cool for puppeteering stuff live as well, like steering a car using a bitch-bend or a knob :cool:


Personally, I don't see them adding in the audio features to IC either.  And realistically, there are oodles and oodles of other things that are either still broken, work wonky, or it just doesn't do that should be considered first, before something as superfluous as this to it, IMO.
By JIX - 11 Years Ago

@JJJAM
So you're the guy who goes around YouTube telling everyone their video is gay? :D


No, I´m not the one and usually I´m not using this expression, because (as a non native English speaker) I´m not sure if it is politically correct allover the place (in NYC it is, I was told), but in this case I was really amazed, because this video is really sick & salted! Better to put it that way?! ;)
By AverageJoe - 11 Years Ago
JJJAM (12/9/2015)

@JJJAM
So you're the guy who goes around YouTube telling everyone their video is gay? :D


No, I´m not the one and usually I´m not using this expression, because (as a non native English speaker) I´m not sure if it is politically correct allover the place (in NYC it is, I was told), but in this case I was really amazed, because this video is really sick & salted! Better to put it that way?! ;)


What does "sick & salted" mean?
By JIX - 11 Years Ago
wizaerd (12/9/2015)
JJJAM (12/9/2015)

@JJJAM
So you're the guy who goes around YouTube telling everyone their video is gay? :D


No, I´m not the one and usually I´m not using this expression, because (as a non native English speaker) I´m not sure if it is politically correct allover the place (in NYC it is, I was told), but in this case I was really amazed, because this video is really sick & salted! Better to put it that way?! ;)


What does "sick & salted" mean?


It means kinda "super amazing".

Are you from the US? Just asking, because it´s not the first time, that I´m explaining native speakers the meaning of expressions. It seems, they are very locally ...



By AverageJoe - 11 Years Ago
JJJAM (12/9/2015)
wizaerd (12/9/2015)
JJJAM (12/9/2015)

@JJJAM
So you're the guy who goes around YouTube telling everyone their video is gay? :D


No, I´m not the one and usually I´m not using this expression, because (as a non native English speaker) I´m not sure if it is politically correct allover the place (in NYC it is, I was told), but in this case I was really amazed, because this video is really sick & salted! Better to put it that way?! ;)


What does "sick & salted" mean?


It means kinda "super amazing".

Are you from the US? Just asking, because it´s not the first time, that I´m explaining native speakers the meaning of expressions. It seems, they are very locally ...





I am... What constitutes a Native Speaker to you?  It's not an expression I'm familiar with, so it must not be native to the USA... However, with that said, there's a slew of regional slang that may be native to only parts of the US, but regardless, this is not an expression I'm familiar with.  "Sick" I'm familiar with as something pretty cool, but "Salty" (or salted)  means jaded or angry.  So "sick & salted" seems a contradiction to me, based on native slang.
By JIX - 11 Years Ago
wizaerd (12/9/2015)
JJJAM (12/9/2015)
wizaerd (12/9/2015)
JJJAM (12/9/2015)

@JJJAM
So you're the guy who goes around YouTube telling everyone their video is gay? :D


No, I´m not the one and usually I´m not using this expression, because (as a non native English speaker) I´m not sure if it is politically correct allover the place (in NYC it is, I was told), but in this case I was really amazed, because this video is really sick & salted! Better to put it that way?! ;)


What does "sick & salted" mean?


It means kinda "super amazing".

Are you from the US? Just asking, because it´s not the first time, that I´m explaining native speakers the meaning of expressions. It seems, they are very locally ...





I am... What constitutes a Native Speaker to you?  It's not an expression I'm familiar with, so it must not be native to the USA... However, with that said, there's a slew of regional slang that may be native to only parts of the US, but regardless, this is not an expression I'm familiar with.  "Sick" I'm familiar with as something pretty cool, but "Salty" (or salted)  means jaded or angry.  So "sick & salted" seems a contradiction to me, based on native slang.


Native speakers are people who raised with that language, I guess. It´s firmly and deeply established in the brain.

But you are right, language is something very complex. You can say it´s even alive so it´s quite obvious nobody can be familiar with it in all its facets and in such a huge country there must be a lot of them ...

So let´s talk about something quite simple like MIDI! ;)

By AverageJoe - 11 Years Ago
JJJAM (12/9/2015)
Native speakers are people who raised with that language, I guess. It´s firmly and deeply established in the brain.

You misunderstand... I did not mean the definition of native speaker, because that is pretty self evident.  I meant where are you from, and what would a "native speaker" speak where you're from.
By JIX - 11 Years Ago
wizaerd (12/9/2015)
JJJAM (12/9/2015)
Native speakers are people who raised with that language, I guess. It´s firmly and deeply established in the brain.

You misunderstand... I did not mean the definition of native speaker, because that is pretty self evident.  I meant where are you from, and what would a "native speaker" speak where you're from.


Uh-oh ... I´m sorry! Hopefully I don´t misunderstand everything in this forum. ;)

Actually I can´t tell you where I´m from, because I don´t know myself. Still trying to figure that out though, but I´m born and live in Germany.

A native German speaker would probably say nothing at all, but I have to say, thanks for bringing up that Animusic thingy!
I saw that before, but didn´t realize that it was animated and controlled via MIDI.

By animagic - 11 Years Ago
The reason that MIDI is not as far-fetched as it may seem is that it can be viewed as a control language. I first came across it for that purpose with 3D Studio Max 2.5 (in 2000 or so).

If a scripting API were available for iClone, it would be relatively easy to add a MIDI front-end. A LUA API was mentioned once, but has not been heard from since.

As to "gay": it's unfortunate that ordinary words get kind of usurped and then make people uncomfortable or giddy or the original meaning is no longer understood... I heard this song the other day with the line: "But I feel so gay, in melancholy way, that it might as well be spring." Or something like that...

As such, I had no problem at all in understanding JJJAM's remark, although I found it a bit unusual.
By RobertoColombo - 11 Years Ago
animagic (12/11/2015)
If a scripting API were available for iClone, it would be relatively easy to add a MIDI front-end. A LUA API was mentioned once, but has not been heard from since.


In fact I remeber RL mentioned during a webinar, but from that time, no more news.
I suspect (I might be wrong, but...) that RL holds this feature because of:

1. the effort to develop a library of API, which shall be maintained and still working across different iClone versions
2. the market strategy, probably thinking that RL shall be the only one appointed to develop and sell new features / add-ons

That's really a pity because it would open infinite new possibilities with iClone.

Cheers (...no, crying :crying: )

  Roberto


By pumeco - 11 Years Ago

@Job
Yup, would be very neat to be able to MIDI-Control stuff in iClone, and that video with the balls bouncing and triggering sounds is another aspect that would be good to have.
Something where we could set sound-triggers.


@JJJAM
I had no idea they still used that term in Germany, but handy to know.  In the UK, the modern meaning is that you have an attraction to the same sex.  The older original meaning, was basically 'Happiness'.  So way back, if you'd said you were gay you were basically saying you were happy.  I assume that's where the meaning in your comment came from.  Just a friendly bit of advice though, if you visit England, best not to use that term in place of happy ...

Fictional scenario for you:
- JJJAM visits England and decides to keep-up the tradition of visiting a good old-fashioned Fish&Chip shop.
- The shop assistant loves JJJAM's German accent, and decides to give him extra chips!
- JJJAM is overcome with happiness and responds with "Wow, thanks, I'm so gay!!!"
- A man standing directly behind JJJAM hears this comment, and decides to get closer.
- The man whispers into JJJAM's ear "So how'd ya like to share those chips at my place, stud?"
- JJJAM innocently accepts his invitation.
- JJJAM later leaves the man's house with a funny walk, and a 'hard' lesson learned about the new meaning.

:Wow: :D



By JIX - 11 Years Ago
:D

Oh my ... I shouldn´t have been using that term. In this case it only was another word for "cool". As I mentioned before, I picked that up from people in NYC ...

Your scenario is pretty funny, but it is definitley fictional, because I´m such a man and would never say something like that!
By animagic - 11 Years Ago
JJJAM (12/11/2015)
: As I mentioned before, I picked that up from people in NYC ...


That explains it, I believe...:P
By pumeco - 11 Years Ago

:laugh:



By JIX - 11 Years Ago
animagic (12/11/2015)
JJJAM (12/11/2015)
: As I mentioned before, I picked that up from people in NYC ...


That explains it, I believe...:P


Whatever that means! :)
By Snarp Farkle - 11 Years Ago
JJJAM (12/8/2015)
@Snarp
There is a DAZ script?! I overlooked that one, I guess. How is it called?

It's called "mcjAudioMation"; here's the YouTube video of it. mcjAudioMation
and here's the website mcasualsdazscripts2
This guy has tons of scripts for poser and daz, I've used the look at camera one for some time now, others I've tinkered with now and then.
By Rampa - 11 Years Ago
You can set this up in 3DXchange. Whatever your animating needs to have a biped skeleton so it can be characterized. Then you can have 15 variations (the visemes) that will play along with any audio file you load.

Cricky made a few avatars that worked that way, a while back.
http://city.reallusion.com/ContentPreview.aspx?i=JIC227b930d582699aa1
By pumeco - 11 Years Ago
Snarp Farkle (12/12/2015)
JJJAM (12/8/2015)
@Snarp
There is a DAZ script?! I overlooked that one, I guess. How is it called?

It's called "mcjAudioMation"; here's the YouTube video of it. mcjAudioMation
and here's the website mcasualsdazscripts2
This guy has tons of scripts for poser and daz, I've used the look at camera one for some time now, others I've tinkered with now and then.


Wow, nice find, Snarp, that's exactly the sort of thing I mean, what I would love to see built into iClone! :w00t:
Choose a file, choose a target, choose an amount, done!

It's a shame Poser is so buggy and they didn't update the Animation tools this time around (nope, nothing).  They say they have a new policy on delivering updates, so I'll be watching the response of users with an eagle-eye, just to see if the thing actually becomes stable and relatively bug-free with the new update policy they have.  If they sort their act out, make it proper stable, and get the animation tools sorted for a Poser 12 release, my love for Poser might be retriggered and our affair can resume.  To be fair, they did make Poser 10 a lot more stable and killed a lot of bugs, but due to the total disregard for Animation upgrades, they aren't selling me a copy of Poser 11.




By JIX - 11 Years Ago
Snarp Farkle (12/12/2015)
JJJAM (12/8/2015)
@Snarp
There is a DAZ script?! I overlooked that one, I guess. How is it called?

It's called "mcjAudioMation"; here's the YouTube video of it. mcjAudioMation
and here's the website mcasualsdazscripts2
This guy has tons of scripts for poser and daz, I've used the look at camera one for some time now, others I've tinkered with now and then.


Thanks for all the info, Snarp. I´m going to look into that ...

By JIX - 11 Years Ago
rampa (12/12/2015)
You can set this up in 3DXchange. Whatever your animating needs to have a biped skeleton so it can be characterized. Then you can have 15 variations (the visemes) that will play along with any audio file you load.

Cricky made a few avatars that worked that way, a while back.
http://city.reallusion.com/ContentPreview.aspx?i=JIC227b930d582699aa1


Yes, I remember those! Cricky is the man for all the tricky questions. Well, that´s a nice workaround ...

Nevertheless RL should give us some specialist tools for this, right?

By Cricky - 11 Years Ago
Here are a few "Auto-Driven" type samples of Text used for the holidays.  Done in pretty much the same way as the Piano, Trumpet, Speakers, and other items done before.

All animated by the music heard.. 



https://www.youtube.com/watch?v=PNZFZftlul8
By JIX - 11 Years Ago
Kewl! Happy holidays!
By pumeco - 11 Years Ago

Please would someone post a URL for Cricky's video, I can't see what he posted :(



By Zeronimo - 11 Years Ago
hi Pumeco,
here it is : https://www.youtube.com/watch?v=PNZFZftlul8
By JIX - 11 Years Ago
The embedded video isn´t invented yet in the UK, pumeco?! ;)
By Odie_Schnitzel - 11 Years Ago
I would also like to see the Auto-Driven(Audio Driven) Animation in Iclone6, I think the viseme workaround is nice, but there could be so much more done, when it would be build right into the programm. You could change Colors, visibility, light emittion, morphs, drive movements or particles or even change the whole material? Or imagine the physics world in iClone, which works than together with Audio Driven moves, change the force depending on the music input. We would get really close to animusic....with IClone! :-D

I know Blender can do some of these, and also some programms, which are more expensive than iClone is.

Would be really cool, to have it in iClone, one step closer to a dream tool....
By pumeco - 11 Years Ago

@JJJAM
Sorry for the late reply, I don't think I got a notification this time, but yeah, they're way behind the times in the UK I'm afraid.
Really though, it's the forum that's broken, doesn't work properly for Firefox users who don't have Flash installed.

It worked before, but right now it's broken so I can't see any embedded videos :(


@Odie_Schnitzel
Yup, would be very cool to have all this, and I'm hoping the new audio-based stuff they're using is an indication it could finally arrive!



By pumeco - 10 Years Ago

Oops, sorry Zeronimo, thanks for posting the link :)


By JIX - 10 Years Ago
pumeco (12/27/2015)

@JJJAM
Sorry for the late reply, I don't think I got a notification this time, but yeah, they're way behind the times in the UK I'm afraid.
Really though, it's the forum that's broken, doesn't work properly for Firefox users who don't have Flash installed.

It worked before, but right now it's broken so I can't see any embedded videos :(


Don´t worry, be happy! Happy 2016!

By pumeco - 10 Years Ago

lol, and to you JJJAM!


By JIX - 10 Years Ago
pumeco (1/2/2016)

lol, and to you JJJAM!




Cheers! :)
By Snarp Farkle - 10 Years Ago
I want to keep this prop auto-animation thread alive so here's another script setup for DAZ I think you'll enjoy!  This would be so cool to have in iClone!

Animated props using MIDI text files from free scripts called mcjMidiKit and MIDIload. 

First a demonstration of the script.


The following videos show how one guy animated a drum set, piano, horns and keyboard in DAZ3D, a little plastic looking but still pretty cool!  Just imagine how good these could look in iClone!








I hope this post isn't inappropriate but I would really love to see how iClone could make things like this shine! :)

By JIX - 10 Years Ago
Why should it be inappropriate?! This is exactly the right place to talk about this subject matter, if you are asking me.

I think we will get this functionality some day, the only question is when. If there were 3rd-party-scripts, it possibly would be available already ...
By pumeco - 10 Years Ago

Have to admit I was wondering the other day if Audio-Driven animation was one of the things they were keeping secret, cause from what I've read in this thread and others, it's been asked for many many times even way back.  Reallusion are currently playing with audio due to the new stuff they added to CrazyTalk, so who knows, Audio-Driven animation might be just around the corner.

Have to say I'm starting to like the idea of MIDI-Driven animation too even though I wasn't that much bothered about it at first.  It's definitely something I'd make use of now that I've seen it in action.  One thing I will say though, is to bear in mind that MIDI-Driven animation is a completely different beast to Audio-Driven animation due to the way it reacts and what you can and can't extract from it in order to drive the animation.  The videos posted are excellent examples of MIDI-Driven animation, but here's an example of Audio-Driven, the difference being that as the music evolves, the spectrum is reacting accordingly.  In iClone, each one of those bars could be a cube, sphere, colour, a frame of an animated texture, the colour of a light, all sorts of stuff :


https://www.youtube.com/watch?v=jw5dhrXCcyQ


By JIX - 10 Years Ago
Another point for the necessity of that upcoming Feedback Tracker. Features don´t have to be asked over and over again. The community will be able to track the actual state of affairs, whether it´s the Audio-Driven, or the MIDI-Driven animation. ;)

By JIX - 10 Years Ago
Did I forget to mention that marble-driven option?! :P


By RobertoColombo - 10 Years Ago
Hi,

I wish to come back to this old thread and propose my solution done in Blender.
The tutorial is embedded in this post: https://forum.reallusion.com/276724/Tutorial-Soundcontrolled-animation

Cheers

  Roberto
By pumeco - 10 Years Ago

Fantastic, replied at link :w00t:


By JIX - 10 Years Ago
Great! Anyways, we need this functionality in iClone ...
By pumeco - 10 Years Ago

We sure do, that's a good script and tutorial he made though, and it reacts how I expected it to.  It's not as powerful when brought into iClone cause you have to stick to one of the available destinations, but inside of Blender it could drive pretty-much anything you want really, very neat!