Profile Picture

A very creepy clown! Augmented Reality Face Tracking on Facebook

Posted By mrmdesign 7 Years Ago
Rated 2 stars based on 4 votes.

A very creepy clown! Augmented Reality Face Tracking on Facebook

Author
Message
mrmdesign
mrmdesign
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 142, Visits: 2.4K
Hi Guys,
Apologies for being absent for a while.
I have been really busy trying to build my Augmented Reality business.
The good news is that it seems to be going from strength to strength. I have worked on some interesting projects with some great clients and have many more in the pipeline. ARKit seems to have kicked of an AR revolution and demand seems to be rising rapidly.

I was lucky enough to be accepted into the Facebook Camera Effects platform a few months ago and have just released my first effect.
I had to do quite a bit of modelling and texturing for various parts and found iClone really useful in the process when mocking up various effects. I went with a Creepy Clown for my first effect because I am a big fan of American Horror Story (and clowns are so hot right now) but am also working on a fish faced effect based on Gil (if anyone remembers him..)

The speed of the real time face tracking is really impressive although there is no way to export it from the platform and I don't think there are any plans to commercialism this aspect externally in the future.

I have quite a few other client Facebook AR Studio projects in the pipeline and will update you on their progress. I will get around to creating some content for the marketplace at some point in the future. you may even be able to try it on yourself first!

Please try my effect if you get a chance. It would be good to see some of you as creepy clowns.
Try my Creepy Clown Camera Effect

p.s. You need to visit the link on your mobile and you need a Facebook account to check it out.



----
Designer, Illustrator, Artist, Developer, Modeller - Augmented Reality : Instagram and Facebook Camera Effects
www.realityaugmented.co.uk
Edited
7 Years Ago by mrmdesign
freerange
freerange
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)

Group: Forum Members
Last Active: 7 Years Ago
Posts: 165, Visits: 437
Great work! The tracking is and overlay compositing is excellent. Definitely creepy clowntastic. 

You said you used Facebook's dev kit for this, but sounds like you are moving into ARKit? Are you also looking at ARCore from Google now they they are doing SLAM like Apple vs needing a Tango?

I was curious if Apple lets 3rd party developers tap into the depth face tracking which they are using for the Animoji, which I am pretty sure comes from their purchase of Faceshift from Hao Li. 

Great work and excited to see more of your stuff.

Free Range
My IMDB
mrmdesign
mrmdesign
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 142, Visits: 2.4K
Thank you very much for your kind feedback.
I am really humbled considering the projects you have worked on in your imdb projects. It's like a list of my favourite films. :-)

I am not sure if Apple are opening up the face tracking in ios11 but it was one of the first things on my mind when they showed the animoji feature. I have only worked with ARKit so far as one of my clients wants to use it exclusively for their upcoming projects. I bought an iPad pro especially for this but have also been really impressed with the pencil.  I will definitely look into it when I get the hardware to support it.

Unfortunately my android device is a Galaxy S7 Edge and ARcore doesn't support it so I have not tried it yet. I would love to compare the two but will wait until my next upgrade is due in January / February. I am thinking of getting a Note 8 and an iPhone X so that I can cover all platforms.

I am really impressed with Facebook AR Studio as the tracking works so well across every device I have tested it on (even oldies) and without the need of a depth sensing camera.
There are loads of improvements coming too.




----
Designer, Illustrator, Artist, Developer, Modeller - Augmented Reality : Instagram and Facebook Camera Effects
www.realityaugmented.co.uk
mrmdesign
mrmdesign
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 142, Visits: 2.4K
.


----
Designer, Illustrator, Artist, Developer, Modeller - Augmented Reality : Instagram and Facebook Camera Effects
www.realityaugmented.co.uk
Edited
7 Years Ago by mrmdesign
mrmdesign
mrmdesign
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 142, Visits: 2.4K
nzuqefmq is a very strange individual who has decided to target me with death threats and profanity because I use Facebook (like millions of other people). Apologies to anyone affected.


----
Designer, Illustrator, Artist, Developer, Modeller - Augmented Reality : Instagram and Facebook Camera Effects
www.realityaugmented.co.uk
mrmdesign
mrmdesign
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 142, Visits: 2.4K
Well maybe you should have tried wording your first contact with me a bit better....  

I don't normally click on links accompanied by swear words either.


----
Designer, Illustrator, Artist, Developer, Modeller - Augmented Reality : Instagram and Facebook Camera Effects
www.realityaugmented.co.uk
Edited
7 Years Ago by mrmdesign
mr_vidius
mr_vidius
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.9K reputation)Distinguished Member (1.9K reputation)Distinguished Member (1.9K reputation)Distinguished Member (1.9K reputation)Distinguished Member (1.9K reputation)Distinguished Member (1.9K reputation)Distinguished Member (1.9K reputation)Distinguished Member (1.9K reputation)Distinguished Member (1.9K reputation)

Group: Forum Members
Last Active: 10 hours ago
Posts: 431, Visits: 6.1K
mrmdesign (9/25/2017)
Well maybe you should have tried wording your first contact with me a bit better....  

I don't normally click on links accompanied by swear words either.



I DO!! But only if it's from some hat babe.. 99% of the time.. it will link to her nude photo page Smile LOL

vidius 

mrmdesign
mrmdesign
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 142, Visits: 2.4K
Hey Neil! You came back! :-)

iclonia / raggedybird / raggedydragon



----
Designer, Illustrator, Artist, Developer, Modeller - Augmented Reality : Instagram and Facebook Camera Effects
www.realityaugmented.co.uk
Edited
7 Years Ago by mrmdesign
freerange
freerange
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)

Group: Forum Members
Last Active: 7 Years Ago
Posts: 165, Visits: 437
Awesome, have not even looked at the Facebook stuff too much yet but from your work it does look really solid. We develop for China too so Facebook would be a problem. I have not tried ARCore yet either, but so far I have been impressed with ARKit. We are mostly doing VR and other immersive experiences, might hit you up though if we get any AR work coming out way if you are free for contracting.

Thanks, yeah I have been lucky to work on so many fun films. My favorite is still Blade Runner 20th Anniversary edition since I am in the film and got a special thanks credit along with Harrison Ford's son who played opposite me. Was a dream come true. 

They should have contracted you for the IT release to do a Pennywise version.

mrmdesign (9/25/2017)
Thank you very much for your kind feedback.
I am really humbled considering the projects you have worked on in your imdb projects. It's like a list of my favourite films. :-)

I am not sure if Apple are opening up the face tracking in ios11 but it was one of the first things on my mind when they showed the animoji feature. I have only worked with ARKit so far as one of my clients wants to use it exclusively for their upcoming projects. I bought an iPad pro especially for this but have also been really impressed with the pencil.  I will definitely look into it when I get the hardware to support it.

Unfortunately my android device is a Galaxy S7 Edge and ARcore doesn't support it so I have not tried it yet. I would love to compare the two but will wait until my next upgrade is due in January / February. I am thinking of getting a Note 8 and an iPhone X so that I can cover all platforms.

I am really impressed with Facebook AR Studio as the tracking works so well across every device I have tested it on (even oldies) and without the need of a depth sensing camera.
There are loads of improvements coming too.





Free Range
My IMDB
mrmdesign
mrmdesign
Posted 7 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)Distinguished Member (1.8K reputation)

Group: Forum Members
Last Active: 2 Months Ago
Posts: 142, Visits: 2.4K
That sounds like a dream come true. Perks of the job eh? I will have to look out for you and Harrison's son.

I am always open to contracting opportunities. :-)
Feel free to get in touch with me via pm or email if something AR related comes along.





----
Designer, Illustrator, Artist, Developer, Modeller - Augmented Reality : Instagram and Facebook Camera Effects
www.realityaugmented.co.uk



Reading This Topic