Profile Picture

Bellus3D "Connector" To CC3+

Posted By GOETZIWOOD STUDIOS 3 Years Ago
You don't have permission to rate!
Author
Message
GOETZIWOOD STUDIOS
GOETZIWOOD STUDIOS
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)

Group: Forum Members
Last Active: 3 Years Ago
Posts: 1.2K, Visits: 7.2K
Hi, 

Bellus3D, an iPhone application and now a Windows desktop application (with SDK), has been around since several years, and works much better and much faster than any version of Headshot, which requires a quite important amount of manual work, even just to get the right contour of a head.

Bellus3D results can be qualified as nearly 'perfect', it is like the Polaroïd of face scanning. If only there was a simple way to integrate/port the Bellus3D head as a CC3+ head, that would be awesome.

Why should we use painfull tools when it exists 'perfect' tools ? We are paying either way..

--
guy rabiller | GOETZIWOOD STUDIOS
"N.O.E." (Nations Of Earth) Sci-Fi TV Show, Showrunner.

animagic
animagic
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)Distinguished Member (32.5K reputation)

Group: Forum Members
Last Active: 10 hours ago
Posts: 15.7K, Visits: 30.5K
GOETZIWOOD STUDIOS (4/11/2021)
Hi, 

Bellus3D, an iPhone application and now a Windows desktop application (with SDK), has been around since several years, and works much better and much faster than any version of Headshot, which requires a quite important amount of manual work, even just to get the right contour of a head.

Bellus3D results can be qualified as nearly 'perfect', it is like the Polaroïd of face scanning. If only there was a simple way to integrate/port the Bellus3D head as a CC3+ head, that would be awesome.

Why should we use painfull tools when it exists 'perfect' tools ? We are paying either way..

I have to disagree with you about "painful". I quite like Head Shot. Besides "perfect" whatever that means, there is artistry.

Also, where would you find faces to scan? I can go to places like Thispersondoesnotexist.com and find plenty to use to create unique characters in CC.

I find it typical that every time RL comes out with a new feature that instead of embracing it and doing something with it, people find fault. I think that is a waste of time and energy.


https://forum.reallusion.com/uploads/images/436b0ffd-1242-44d6-a876-d631.jpg

Edited
3 Years Ago by animagic
GOETZIWOOD STUDIOS
GOETZIWOOD STUDIOS
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)

Group: Forum Members
Last Active: 3 Years Ago
Posts: 1.2K, Visits: 7.2K
@animagic
Well, clearly along the years Reallusion shifted their efforts from machinima to game tools and games professionals. I have nothing against artistry, obviously, but I like efficiency too for specific tasks. Headshot is nice but it fails for that specific task of quickly creating digital double. When we need a character identical to an existing actor. For this, it simply does not work compared to Facegen - even the Crazytalk pipeline worked better - or now Bellus3D which of course use the real face instead of images, which is not an issue in case of digital doubles. It does not work without a lot of manual work that is, other than that I'm not complaining, the all CC features are very nice of course.

So, like for Motion Capture, perhaps there could be a system that accept a all eco-system of 'devices' that could be used with Headshot to creates faces, either from photos, scans, depth, ...

Because the issue here is not to create realistic faces or to capture faces from real actors, there are several tools and ways in order to do that, the issue here is to 'integrate' those as CC3+ heads (without spending zillions of hours manually using morphs for that).

--
guy rabiller | GOETZIWOOD STUDIOS
"N.O.E." (Nations Of Earth) Sci-Fi TV Show, Showrunner.

Edited
3 Years Ago by GOETZIWOOD STUDIOS
Peter (RL)
Peter (RL)
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (115.8K reputation)Distinguished Member (115.8K reputation)Distinguished Member (115.8K reputation)Distinguished Member (115.8K reputation)Distinguished Member (115.8K reputation)Distinguished Member (115.8K reputation)Distinguished Member (115.8K reputation)Distinguished Member (115.8K reputation)Distinguished Member (115.8K reputation)

Group: Administrators
Last Active: Yesterday
Posts: 22.7K, Visits: 35.7K
GOETZIWOOD STUDIOS (4/11/2021)
it simply does not work compared to Facegen - even the Crazytalk pipeline worked better


Hi Guy

I feel your argument fell apart with this statement.

Honestly I can only think maybe you haven't mastered Headshot yet because neither Facegen or CrazyTalk can come close to Headshot in terms of the results you can get.

Personally I have used Facegen for many years and back in the day the faces it created were great, but sadly it has not been updated so the results are now far inferior to what you can do with Headshot. CrazyTalk 8 on the other hand paved the way for Headshot, but again it is now a legacy product that hasn't been updated for a long time. I have lost count of the heads I have created in CrazyTalk but I have never been able to create a 3D Head that could match what can be done with Headshot.

As Animagic suggested why not invest some time with Headshot. I think once mastered you will find the results you can get are fantastic even creating digital doubles.


                                                                

Peter
Forum Administrator

www.reallusion.com


Edited
3 Years Ago by Peter (RL)
planetstardragon
planetstardragon
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (23.2K reputation)Distinguished Member (23.2K reputation)Distinguished Member (23.2K reputation)Distinguished Member (23.2K reputation)Distinguished Member (23.2K reputation)Distinguished Member (23.2K reputation)Distinguished Member (23.2K reputation)Distinguished Member (23.2K reputation)Distinguished Member (23.2K reputation)

Group: Forum Members
Last Active: Last Week
Posts: 11.5K, Visits: 45.9K
Im a fan of headshot myself,  but then I do a lot of photo-editing - touching up for customized work. 

I wouldn't have it any other way though  because that allows me to add "me" to my work and i do get some very realistic looks from my process,  headshot just makes it quick and painless for me. 

I had my relatives ready to attend a funeral when I told them this guy died w00t

RIP Jimmy Crying
https://forum.reallusion.com/uploads/images/4762c7b7-d5af-4e14-972e-cc35.png



Edited
3 Years Ago by planetstardragon
kungphu
kungphu
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)Distinguished Member (3.8K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 997, Visits: 7.1K
Peter (RL) (4/12/2021)
GOETZIWOOD STUDIOS (4/11/2021)
it simply does not work compared to Facegen - even the Crazytalk pipeline worked better


Hi Guy

I feel your argument fell apart with this statement.

Honestly I can only think maybe you haven't mastered Headshot yet because neither Facegen or CrazyTalk can come close to Headshot in terms of the results you can get.

Personally I have used Facegen for many years and back in the day the faces it created were great, but sadly it has not been updated so the results are now far inferior to what you can do with Headshot. CrazyTalk 8 on the other hand paved the way for Headshot, but again it is now a legacy product that hasn't been updated for a long time. I have lost count of the heads I have created in CrazyTalk but I have never been able to create a 3D Head that could match what can be done with Headshot.

As Animagic suggested why not invest some time with Headshot. I think once mastered you will find the results you can get are fantastic even creating digital doubles.


I gotta agree, I loved Facegen back in the day. However it really shows it's age these days. Calling that closer to perfect software is more than a stretch. Headshot works just fine and there is a little work involved, but there is a HUGE EZ button if you don't want to spend much time at all getting something very good from it. The EZ button gets you 80/20. If you just spend a little bit of time even less than an hour, you can achieve very good results. We've seen them posted a plenty on the forum and in our won work so we know it's "doable."



My "NEWEST" LatestSmile  Movie Made With Amaaaazing iClone


—> High Noon”ish” in Narrow Valley<—



PIO C
PIO C
Posted 3 Years Ago
View Quick Profile
Junior Member

Junior Member (181 reputation)Junior Member (181 reputation)Junior Member (181 reputation)Junior Member (181 reputation)Junior Member (181 reputation)Junior Member (181 reputation)Junior Member (181 reputation)Junior Member (181 reputation)Junior Member (181 reputation)

Group: Forum Members
Last Active: Last Month
Posts: 18, Visits: 667
I know this will not be popular here, but I can live with that.

It really pains me to read how many people want more and more click button tools. No one wants to learn a craft anymore and use the tools available in new creative ways.

One of the problems brewing in the future for 3d Animation is the one click does everything. All work will end up looking the same and tge art will be de valued.

Just because you can buy mocap suit. Would it hurt to learn to key frame ? Instead of using iphone mocap, why not act and record face and keyframe expressions? 


Asolo
Asolo
Posted 3 Years Ago
View Quick Profile
Veteran Member

Veteran Member (590 reputation)Veteran Member (590 reputation)Veteran Member (590 reputation)Veteran Member (590 reputation)Veteran Member (590 reputation)Veteran Member (590 reputation)Veteran Member (590 reputation)Veteran Member (590 reputation)Veteran Member (590 reputation)

Group: Forum Members
Last Active: 2 Years Ago
Posts: 58, Visits: 105
i created from headshot just go photoshop setting pixel to 3200...i think maybe got great texture in headshot
https://forum.reallusion.com/uploads/images/0530b841-b752-4c82-a6d0-90fb.jpg

https://forum.reallusion.com/uploads/images/3d70a372-38e0-4dd7-89ea-2c94.jpg
4u2ges
4u2ges
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)Distinguished Member (20.6K reputation)

Group: Forum Members
Last Active: 2 days ago
Posts: 5.0K, Visits: 15.9K
First off I appreciate the link Guy. They are off to a good start, but yet have a long way to go to perfect it.
Yes, sure, it is only applicable for a "Live Shot" with people who'd agree to get the scan taken.
Same with profile photos. Though I'd say Headshot plugin must have profile option.
For me personally, using dozens and dozens of sliders to get the profile (and front for that matter) right is a painful process.
Maybe I do not have an "eye" for that.
I tried morphing myself in the past in head-shot and miserably failed.

Long story short. Downloaded the app (there are 2, I used Face Maker), scanned my face, paid a buck to get hi-poly OBJ to iCloud.
Now, how the heck to bring that head to CC??
Here is a very brief workflow (still yet to be perfected):

1. Used Bellus3D unwrapped texture of my face in Headshot (I could have used regular photo, but the outcome is pretty much the same).
This is what Headshot "thinks" of me, without any texture/photo/morphs tweaks... Oh boy...Hehe

https://forum.reallusion.com/uploads/images/97df2912-59ee-41e9-acfb-e262.jpg


2. Exported Nude OBJ Body out of CC and imported to Blender. Imported Bellus3D OBJ to Blender as well.
Using Blender Mask modifier I left only those parts visible on CC imported character. Associated visible vertices with special vertex Group

https://forum.reallusion.com/uploads/images/118c0e4e-572e-4bcf-9e9e-ef56.jpg

Symmetrized original Bellus3D scan. This is how it looks:

https://forum.reallusion.com/uploads/images/35c93f81-ff64-4e08-834a-0717.jpg


3. Tweaked original CC mask. The goal was to match the openings of eyes, ear parts, lips and nostril. I did not care about the rest.
The reason for that was to prevent deformation of hidden inner parts of the CC head (tongue, mouth, eye sockets, etc) in the next step:

https://forum.reallusion.com/uploads/images/6823723c-8ca3-4292-ae1f-5390.jpg



4. Applied a Shrinkwrap modifier to the CC mask over the original scan OBJ. A little sculpting to fix slightly deformed inner parts contour and the Morphed body is ready for export:

https://forum.reallusion.com/uploads/images/89ee517d-e97b-42de-b719-f0a6.jpg

5. Imported as a morphs slider, fixed the texture a little (I should use a better photo next time). Spent some time with eyes.
No matter what, this is a hardest part to get right. A slight inconsistency in eyes contour and character looks totally different.
I'd say this character has about 90% accuracy match with the host. Maybe a little younger Smile

Two things made me happy. The face profile, which I did not have to do anything about. Again I'd never be able to match the profile with such an accuracy (maybe someone can - I cannot).
And this new Prime Hairstyle hair, which is pretty much close (guess I cannot fool anyone with my avatar anymore Smile)

https://forum.reallusion.com/uploads/images/cbfe6f1e-7b13-4ee9-a9f8-4351.jpg


One thing I noticed, is that I was looking down a little during scan and it shows at the outcome. Next time should look straight. Whistling

One more note: Using this method you can bring practically any nude 3-rd party character into CC - morph only - not the texture I suppose. I have already experimented with body, which was a lot easier.
Now I know what to do with the head.





Edited
3 Years Ago by 4u2ges
GOETZIWOOD STUDIOS
GOETZIWOOD STUDIOS
Posted 3 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)Distinguished Member (8.8K reputation)

Group: Forum Members
Last Active: 3 Years Ago
Posts: 1.2K, Visits: 7.2K
Peter (RL) (4/12/2021)
GOETZIWOOD STUDIOS (4/11/2021)
it simply does not work compared to Facegen - even the Crazytalk pipeline worked better

Hi Guy
I feel your argument fell apart with this statement.
Honestly I can only think maybe you haven't mastered Headshot yet because neither Facegen or CrazyTalk can come close to Headshot in terms of the results you can get.
Personally I have used Facegen for many years and back in the day the faces it created were great, but sadly it has not been updated so the results are now far inferior to what you can do with Headshot. CrazyTalk 8 on the other hand paved the way for Headshot, but again it is now a legacy product that hasn't been updated for a long time. I have lost count of the heads I have created in CrazyTalk but I have never been able to create a 3D Head that could match what can be done with Headshot.
As Animagic suggested why not invest some time with Headshot. I think once mastered you will find the results you can get are fantastic even creating digital doubles.

Hi Peter,

As usual, my point and arguments tend to come out of frustration and a bit wrongly. It does not make me wrong though, and I stand by my point.

Lets reformulate the all thing though, forget about FaceGen and the Crazytalk pipeline and lets focus about current facts and tools.

I didn't meant you can't get fantastic results with CC and Headshot because indeed you can, even if that needs some artistry and elbow grease.

The point is that you need more manual work than expected (and probably needed) when you need to get 'simple' but 'exact' digital doubles, especially when you have personally access to the actor so you can 'scan' him.

If you never tried Bellus3D I encourage you to try it at least once in order to see how it works and how efficient and fast it is. Within a few seconds you get a 'perfect' replica of an actor head, sufficient for many uses except that you still have to do a lot of manual work to clean it up, etc.. and of course it can be tricky to get the all thing into CC3+ without messing up the original scan.

Now imagine that, as for motion capture, Headshot would handle several 'devices' like fixed images, profil images Wink, animated images, depth sensors, lidar datas, etc..

The depth sensor of the iPhone is already used by LiveFace for facial motion capture, there is already some expertise here, at Reallusion, which could be ported for retrieving the face directly from the depth sensor.

I mean, how hard would this be ? We already see our face in 3D and in Realtime when we do facial mocap through LiveFace !!


--
guy rabiller | GOETZIWOOD STUDIOS
"N.O.E." (Nations Of Earth) Sci-Fi TV Show, Showrunner.

Edited
3 Years Ago by GOETZIWOOD STUDIOS



Reading This Topic