I've always thought it would be cool to have gesture animation that is being controlled by speech, in addition to lip-synching.

Nvidia has been working on just that and introduced Audio2Gesture: https://www.nvidia.com/en-us/on-demand/session/omniverse2020-om1573/.

---

Is this like digital soul, but for the body? Nvidia outdid themselves on this one. Hats off!
Having a similar feature in iClone would be a game-changer

______________________________________________________________________________________________________________
System: Win 11_Home, CPU i9-10850k (3.60GHz), 32GB RAM, RTX3080 GPU (10GB VRAM), 2TB SSD, 2TB HDD. It's definitely time for an upgrade!

They've posted a Part 2 to the video demo:

https://www.youtube.com/watch?v=oa5Dgwf-5kc