Profile Picture

Mechnical Piano

Posted By 4u2ges 2 Years Ago
Rated 5 stars based on 5 votes.
Author
Message
4u2ges
4u2ges
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 5.0K, Visits: 15.9K
And of course I made a typo in the Subject (why can't we edit the subject??)

This is a WIP of the project I am currently working on.
It is a mechanical piano with physics enabled keys which can be used for a "true" piano playing animations.
There are 2 aspects of piano playing simulations. Animating keys and animating fingers.
I had a choice to make a full 88 keys MIDI piano and then animate finger to follow the keys, or to make a piano with physics enabled keys and have keys to follow animated fingers.
Each method has advantages and disadvantages. I have chosen the latter.

The piano is practically ready. It has a keyboard comprised from 266 props including dummies and springs.
Piano keys are activated by tiny rigid spheres attached to each 3rd bone of player's finger. Here is a schematic including dummies.

https://forum.reallusion.com/uploads/images/c5a26a52-761f-4077-aac0-84c9.gif

Now, animating fingers is a different story. I tried playing in neuron suite gloves just to find out that it is difficult to say the least.
Taking wide voicing chords clean is virtually impossible. And then I can imagine what the animation clean up and syncing with keyboard task would take.
So I decided to animate manually. I recorded the piano playing and currently animating fingers/hands much like lip syncing.
Reach effectors for hands do the job  for independently animating body parts without disrupting fingers animation but what makes it hard to achieve fluid hand/fingers animation, is lack of fingers pinning.
Hopefully iClone 8 would have a better pinning system in place.

So far just a render as I only animated a few measures. I will share the piano (for someone crazy enough like me Smile) and an animated clip when it's ready.
And hopefully I'd have some tips to facilitate process of animation.

https://forum.reallusion.com/uploads/images/de2345a5-6fe0-4ccf-9d21-4047.jpg

Any tips/comments are welcome.





Edited
2 Years Ago by 4u2ges
Amper Sand
Amper Sand
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (5.0K reputation)Distinguished Member (5.0K reputation)Distinguished Member (5.0K reputation)Distinguished Member (5.0K reputation)Distinguished Member (5.0K reputation)Distinguished Member (5.0K reputation)Distinguished Member (5.0K reputation)Distinguished Member (5.0K reputation)Distinguished Member (5.0K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 731, Visits: 5.2K
Jesus! w00t

______________________________________________________________________________
Software developer. iClone hobbyist since January 11, 2020. Best work so far: Robots among us: The Lab and The sad end of a legend
In progress: Black Mamba
AMD Ryzen 3950X 16C/32T 4.2 GHz, 64GB RAM, RTX2080 11GB, 2TB Samsung 970 Pro SSD, 8TB Seagate BarraCuda HDD, Win11 64-bit, iClone 8.12

wires
wires
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (15.0K reputation)Distinguished Member (15.0K reputation)Distinguished Member (15.0K reputation)Distinguished Member (15.0K reputation)Distinguished Member (15.0K reputation)Distinguished Member (15.0K reputation)Distinguished Member (15.0K reputation)Distinguished Member (15.0K reputation)Distinguished Member (15.0K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 5.7K, Visits: 26.4K
A work of art Beethoven. CoolSmoooothw00t

Gerry



System: Win 10 Pro (21H2), Asus X99-E WS, CPU i7-5930K -3,5 GHz, 32 GB DDR4 2666-16 RAM, NVidia GTX 1080 Ti GPU - 11 GB VRAM(Driver Studio-536.99), Samsung 850 Pro 512 GB SSD, 6 TB HD storage.


Zeronimo
Zeronimo
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 478, Visits: 19.1K
Excellent,



I had thought for a moment to reproduce a video like this one with iclone, but in front of the difficulty I quickly gave up. But maybe with your plugin it will become possible.
mark
mark
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (12.2K reputation)Distinguished Member (12.2K reputation)Distinguished Member (12.2K reputation)Distinguished Member (12.2K reputation)Distinguished Member (12.2K reputation)Distinguished Member (12.2K reputation)Distinguished Member (12.2K reputation)Distinguished Member (12.2K reputation)Distinguished Member (12.2K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 4.8K, Visits: 16.4K
I'm all in Zero' if you can animate Chico!!! TongueTongueTongue  Amazing work 4u2'!!!!BigGrinBigGrin


PROMO-BACK2
Click here to go to my YouTube Channel filled with iClone Tutes and Silly Stuff

Visit ANIMATED PROJECTIONS Powered by iCLONE

Intel Core i7 3960X @ 3300MHz Overclocked to 4999.7 MHz Sandy Bridge 24.0GB DDR3 @ 833MHz Graphic Display HP ZR30w 
GeForce GTX 980Ti 6GB  Microsoft Windows 7 Professional 64-bit SP1 ASUSTeK COMPUTER INC. P9X79 WS (LGA2011)



toystorylab
toystorylab
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)Distinguished Member (15.7K reputation)

Group: Forum Members
Last Active: 2 hours ago
Posts: 4.4K, Visits: 28.8K
Wow...
I think the decision to go for a piano with physics enabled keys and have keys to follow animated fingers,
instead of a full 88 keys MIDI piano and then animate finger to follow the keys is a good one.
The midi version would probably have accurate piano keys according to music but animate fingers to follow keys is tricky.
Sure, to make this look real with the audio will be tricky too but is less important to me than the overall animation effect.
So I'm looking forward to try this out!

Toystorylab on Vimeo : https://forum.reallusion.com/uploads/images/ce44ea78-6984-47d8-9bf4-b783.png    Crassitudes (my "Alter Ego") on Youtube: https://forum.reallusion.com/uploads/images/fcc4df30-b3a8-40a5-a427-0735.png

JIX
JIX
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (7.2K reputation)Distinguished Member (7.2K reputation)Distinguished Member (7.2K reputation)Distinguished Member (7.2K reputation)Distinguished Member (7.2K reputation)Distinguished Member (7.2K reputation)Distinguished Member (7.2K reputation)Distinguished Member (7.2K reputation)Distinguished Member (7.2K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 1.1K, Visits: 1.3K
This is awesome!

I´m very interested, because I was thinking about a video clip featuring a piano player lately. Besides my GF is a pro pianist.
Rampa
Rampa
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (35.8K reputation)Distinguished Member (35.8K reputation)Distinguished Member (35.8K reputation)Distinguished Member (35.8K reputation)Distinguished Member (35.8K reputation)Distinguished Member (35.8K reputation)Distinguished Member (35.8K reputation)Distinguished Member (35.8K reputation)Distinguished Member (35.8K reputation)

Group: Forum Members
Last Active: 9 minutes ago
Posts: 8.1K, Visits: 60.5K
Looks like this does a pretty good job. Says they will have 3D export and import in a later version.
https://www.concertcreator.ai
Zeronimo
Zeronimo
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 478, Visits: 19.1K
Rampa (1/30/2022)
Looks like this does a pretty good job. Says they will have 3D export and import in a later version.
https://www.concertcreator.ai


yes, but with a subscription $179.99 per year ... it becomes much less attractive.
4u2ges
4u2ges
Posted 2 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 5.0K, Visits: 15.9K
Thanks folks!

@Toystory – precisely what I though initially.

@Rampa Interesting collaboration between RL and those folks. $15 bucks month is not bad for serious projects, that is when they’d have an export version (with original CC characters I suppose). Otherwise…

I guess there are enough people willing to try it out. Thus, I will share a beta version of the piano project.
At least I am not going to be alone in my success (or failure) WinkTongue. https://drive.google.com/file/d/17IqVFiuSkvFgKs7P2dbLifV-u9fk-v7k/view?usp=sharing

(renders are Iray as you might guess)
https://forum.reallusion.com/uploads/images/9ded2a33-20d4-4411-819a-9031.jpg

https://forum.reallusion.com/uploads/images/5808db6b-3ac5-4cb8-a97d-2860.jpg

I downloaded original piano from 3D Warehouse. It was stripped/reworked in Blender to make it fully operational.
Aside from keyboard, I made most other parts functional like lids, fallboard, etc (still need to morph pedals).
Keyboard and keys measuring correspond approximately to the real mid-sized grand piano.
When morphing your piano player, make sure they have thin and long fingers for easy animation.
All keys have been properly named - just in case someone come up with some amazing script to automate animation (though I doubt it’s possible with current implementation of Python). AI is another story as it was pointed already.
I have included dummy spheres for player fingers inside the project.

To begin, animate your character for the corresponding pose, realign spheres with tip of the fingers as shown in screenshot and LINK each sphere to the corresponding 3rd finger bone. Then check dummy box for each.

https://forum.reallusion.com/uploads/images/3d6e05ba-7260-4f52-aa33-d267.jpg

https://forum.reallusion.com/uploads/images/cd0311d5-1790-481b-943d-65aa.jpg

Regarding animation I’ll share my experience. You may come up with your own ideas – do share.

Hands, feet and torso have reach effectors enabled (original limbs pinning is not reliable and cause slipping).
The only inconvenience is, that I have to switch back and force between Motion Layer Editor and Edit transform for reach effectors (it would be nice to have those under a single panel in IC8).

Most of the time I animate hand reach effectors for a music measure first and then animate fingers only.
Whenever I animate finger or two, a hallow key is created, I always solidify it by double clicking on a key to prevent blending issues down the road.
So, while animating fingers you have to literally align and stick them inside the keys.
At runtime the keys would obey physics and go down and up as you release the fingers from keys.
Try not to place fingers at the very edge of the keys, it might cause keys to fall out of place.

Rigid body tends to bake animation on the fly, so I always record the animation in By Frame mode (otherwise keys might slip out of place sometimes).
Each consecutive run would override the previous animation. If you need to clear animation from ALL keys, then run animation without character touching the keyboard.
And to test the real speed I disable Rigid Body in Project and run animation in Realtime (after running in By Frame mode first).

Although there is a 4 degrees spring limit, the keys might go down further.
So got to try not to stick fingers into the keys too deep (I am sill tweaking it).
Unfortunately, there is no way to tweak springs physics simultaneously (like for Rigid Body) by selecting all springs at once.
3 values could generally be tweaked for springs: Spring (strengths I suppose), Damping, and Range Rotation by X.

After a few measures I can now animate body parts: spine, head, elbows, legs and because of reach effectors, that will not disrupt previously animated fingers and hands position.

Good Luck!



Edited
2 Years Ago by 4u2ges



Reading This Topic