Profile Picture

[NEWS!] SIGGRAPH 2017 - FACEWARE UPDATE

Posted By Joe (RL) 7 Years Ago
You don't have permission to rate!
Author
Message
TonyDPrime
TonyDPrime
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 3.4K, Visits: 12.4K
@Stuckon3d
-Is there any known minimum resolution a video camera stream / file must be at for the plugin to read it properly?  I know you mentioned higher FPS is better, and that resolution was not as critical, so I was wondering is it known yet what the specs were on the resolution.
-Can the recorded motions be exported/saved as a single iMotion, or what is it saved as?  I know the '60 facial' motions thing was discussed as being applicable to CC Character, imported Genesis character, or standard iAvatar, so with a motion like you made at the conference, could you have saved that, and then retried it on different iAvatar types (CC created, from-Daz imported, default) interchangeably?

THX!!!!  
but0fc0ursee
but0fc0ursee
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)Distinguished Member (1.6K reputation)

Group: Banned Members
Last Active: 7 Years Ago
Posts: 595, Visits: 1.7K
Faceware mocap plugin for iClone doesn't accept video.... image sequences.
Edited
7 Years Ago by but0fc0ursee
TonyDPrime
TonyDPrime
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 3.4K, Visits: 12.4K
but0fc0ursee (8/8/2017)
Faceware mocap plugin for iClone doesn't accept video.... image sequences.


Peter(RL) / Stuckon3D,
My question is in fact addressing a "video stream" (which Stuckon3D was using), or "a file", which can in fact of course be an "image file" (jpg, png, tga, bitmap, etc...) as part of an image sequence, and not necessarily a "video" (mp4, mov, wmv, etc...).  
Now, let's say the image file is 256x256, is this okay?  or does it need to be 1280x720, or minimum resolution, or aspect ratio for that matter?
Is there any specific minimum spec that has been identified yet.

As but0fc0ursee semantically interpreted "file" to mean "video", perhaps in fact there may be other semantic interpretation or misinterpretation.  So what exactly does the following mean, as it relates to the plugin reading live video, elements of pre-recorded files....THX!
"Features-based Capture and Imported Image Sequence"

Edited
7 Years Ago by TonyDPrime
animagic
animagic
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)

Group: Forum Members
Last Active: 10 hours ago
Posts: 15.7K, Visits: 30.5K
I would think that the resolution in part determines how fine a distinction the capture software is able to make. So for very subtle facial changes you would want a higher resolution. Another question is the relationship between resolution and tracking capability.


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

Kelleytoons
Kelleytoons
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)

Group: Forum Members
Last Active: 2 hours ago
Posts: 9.2K, Visits: 21.8K
Actually, I asked RL themselves about the FW plugin and they said it DID accept video files as well as sequences.  Either they were mistaken or someone here is, but in any case I wouldn't worry about it until we get more official news.



Alienware Aurora R16, Win 11, i9-149000KF, 3.20GHz CPU, 64GB RAM, RTX 4090 (24GB), Samsung 870 Pro 8TB, Gen3 MVNe M-2 SSD, 4TBx2, 39" Alienware Widescreen Monitor
Mike "ex-genius" Kelley
duchess110
duchess110
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (6.2K reputation)Distinguished Member (6.2K reputation)Distinguished Member (6.2K reputation)Distinguished Member (6.2K reputation)Distinguished Member (6.2K reputation)Distinguished Member (6.2K reputation)Distinguished Member (6.2K reputation)Distinguished Member (6.2K reputation)Distinguished Member (6.2K reputation)

Group: Forum Members
Last Active: 4 Years Ago
Posts: 2.0K, Visits: 15.5K
I have just been watching a gopro faceware video on Youtube and the guy used 1280x720 settings
edit - and 60fps
this is the video that I got the info from
https://www.youtube.com/watch?v=xNK9ORbc9Hs&list=PLPa47iSnj6x4zE9zlXIaxVupSyQfX-pzt&index=6


Duchess Designs Store 


Edited
7 Years Ago by duchess110
stuckon3d
stuckon3d
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (7.0K reputation)Distinguished Member (7.0K reputation)Distinguished Member (7.0K reputation)Distinguished Member (7.0K reputation)Distinguished Member (7.0K reputation)Distinguished Member (7.0K reputation)Distinguished Member (7.0K reputation)Distinguished Member (7.0K reputation)Distinguished Member (7.0K reputation)

Group: Forum Members
Last Active: Yesterday
Posts: 1.8K, Visits: 7.7K
TonyDPrime (8/8/2017)
but0fc0ursee (8/8/2017)
Faceware mocap plugin for iClone doesn't accept video.... image sequences.


Peter(RL) / Stuckon3D,
My question is in fact addressing a "video stream" (which Stuckon3D was using), or "a file", which can in fact of course be an "image file" (jpg, png, tga, bitmap, etc...) as part of an image sequence, and not necessarily a "video" (mp4, mov, wmv, etc...).  
Now, let's say the image file is 256x256, is this okay?  or does it need to be 1280x720, or minimum resolution, or aspect ratio for that matter?
Is there any specific minimum spec that has been identified yet.

As but0fc0ursee semantically interpreted "file" to mean "video", perhaps in fact there may be other semantic interpretation or misinterpretation.  So what exactly does the following mean, as it relates to the plugin reading live video, elements of pre-recorded files....THX!
"Features-based Capture and Imported Image Sequence"



640 x 400 worked ok, specially if your face is close to the camera, however if you are farther away , higher res will work better.  From the testing I've done so far, 720p is a good sweet spot to be in. You get pretty good res for shape details and fps. 

Cheers,

Stuckon3d. 



Product Specialist

My iClone 7 gallery

My IMDB

TonyDPrime
TonyDPrime
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)Distinguished Member (12.7K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 3.4K, Visits: 12.4K
Kelleytoons (8/8/2017)
Actually, I asked RL themselves about the FW plugin and they said it DID accept video files as well as sequences.  Either they were mistaken or someone here is, but in any case I wouldn't worry about it until we get more official news.


Agreed, it is not entirely clear. 
And as such, we need to know and learn as much as we can about how this works now, lest confusion reign!
Plus, I want to know NOW!
All the stuff....
Saved face motion options within iClone (I know the FBX export thing), how is it saved within the iClone prog?  Is it transferrable? 
And the whole image vs video thing...just what is the deal...What is the Deal!?
Edited
7 Years Ago by TonyDPrime
Kelleytoons
Kelleytoons
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)Distinguished Member (35.7K reputation)

Group: Forum Members
Last Active: 2 hours ago
Posts: 9.2K, Visits: 21.8K
TonyDPrime (8/8/2017)
Kelleytoons (8/8/2017)
Actually, I asked RL themselves about the FW plugin and they said it DID accept video files as well as sequences.  Either they were mistaken or someone here is, but in any case I wouldn't worry about it until we get more official news.


Agreed, it is not entirely clear. 
And as such, we need to know and learn as much as we can about how this works now, lest confusion reign!
Plus, I want to know NOW!


And we want the software... NOW!!

Two years ago I started this thread on the forum:  https://forum.reallusion.com/261937/Real-Illusion-REALLY-needs-to-get-Facial-Mocap-NOW?Keywords=facial%20mocap

That's how important facial mocap is to me.  It was all I really wanted out of iClone, all I have been waiting for all these years.  So, yes, I want to know everything about it, I want to know the actual cost to me, and (most importantly) I just WANT IT NOW!!!!  <bg>.

For an old man, two years is about 50% of my lifetime (that which is left).  So they had better release this soon.





Alienware Aurora R16, Win 11, i9-149000KF, 3.20GHz CPU, 64GB RAM, RTX 4090 (24GB), Samsung 870 Pro 8TB, Gen3 MVNe M-2 SSD, 4TBx2, 39" Alienware Widescreen Monitor
Mike "ex-genius" Kelley
Peter (RL)
Peter (RL)
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (116.1K reputation)Distinguished Member (116.1K reputation)Distinguished Member (116.1K reputation)Distinguished Member (116.1K reputation)Distinguished Member (116.1K reputation)Distinguished Member (116.1K reputation)Distinguished Member (116.1K reputation)Distinguished Member (116.1K reputation)Distinguished Member (116.1K reputation)

Group: Administrators
Last Active: Yesterday
Posts: 22.7K, Visits: 35.7K
Kelleytoons (8/8/2017)
Actually, I asked RL themselves about the FW plugin and they said it DID accept video files as well as sequences.  Either they were mistaken or someone here is, but in any case I wouldn't worry about it until we get more official news.


The Faceware RTiC plugin supports camera or image sequence input only. You will need to convert video to image sequence first.


                                                                

Peter
Forum Administrator

www.reallusion.com





Reading This Topic