Profile Picture

Webcam Facial Mocap for live Multiplayer facial expressions -Unity3D Games

Posted By Ascensi 5 Years Ago
You don't have permission to rate!

Webcam Facial Mocap for live Multiplayer facial expressions -Unity3D...

Author
Message
Ascensi
Ascensi
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 75, Visits: 551
I think it would be pretty amazing if Reallusion made a webcam based facial recognition plugin for Unity specifically for game mode facial expressions.

- Users that don't use Unity could still benefit from recording facial animation in iClone
- 3Dxchange pipeline allows the ability to export captured animation for Unity or Maya etc...
- Multi-players in game play see each other's facial expressions ( I know this is development specifically for a completely different system but as a major break through, immersive and potentially widely sought after concept, however it may cover a few years of advertising costs alone due to interest)

- smile or frown as a cartoon, Zombie, soldier, monster etc as you meet or defeat one another!
- potential lip sync to drive your character's mouth movements from sounds or voice over ip etc.
- Perhaps advertised as the new Meet or Defeat Social plugin for games everywhere. (Games and websites Unity Webplayer and WebGL etc)

| i7 -4790K 4.0GHz | 32 GB | GeForce RTX 2080 Ti 11GB | GTX 970 x4 | Window10 | Zbrush 2018 & Keyshot | Maya 2014 | Adobe CS6 | Sonar Producer X3 | iClone Pro & 3D Exchange Pipeline 7 | DTS Master Audio Suite | Perception Neuron 32 Alum Edition | Akeytsu
https://forum.reallusion.com/uploads/images/2181b17f-1a5f-4475-a14b-4dbe.gif
Everything here was modeled in Zbrush, Rigged in Akeytsu, animated in iClone 7 and Rendered in Indigo Render 3X   - Fully Noobed, no years of experience, must have vision and drive -completely oblivious to time.
Scene was almost 3 Million polygons. Since it wasn't covered in any tutorials or the manual I learned the hard way..  Set iClone to use quick shader and set any displacement to 0 when exporting to Indigo Project files. Enable any displacement levels in Indigo.   

Peter (RL)
Peter (RL)
Posted 5 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (52.9K reputation)Distinguished Member (52.9K reputation)Distinguished Member (52.9K reputation)Distinguished Member (52.9K reputation)Distinguished Member (52.9K reputation)Distinguished Member (52.9K reputation)Distinguished Member (52.9K reputation)Distinguished Member (52.9K reputation)Distinguished Member (52.9K reputation)

Group: Administrators
Last Active: Yesterday
Posts: 16.1K, Visits: 24.3K
Thanks for the feedback. This has been passed to the iClone team to review. Smile

                                                                

Peter
Forum Administrator

www.reallusion.com


svenyonson
svenyonson
Posted 4 Years Ago
View Quick Profile
New Member

New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)New Member (1 reputation)

Group: Forum Members
Last Active: 4 Years Ago
Posts: 1, Visits: 2
Has this feature request gotten any traction? I also have this exact need. I would like to have realtime transmission of the players facial expression transferred to his game avatar.



Reading This Topic