How to render 3D, 360 VR in iClone 7?


https://forum.reallusion.com/Topic349785.aspx
Print Topic | Close Window

By yoyomaster - 7 Years Ago
Hello everyone, got a question here.

iClone can render stereo images, it can also render 360 VR images, but is there a way to render stereo, 360 images in it, or is there a way to compose the two types of images in a final, stereo + 360 VR final image?

Thanks in advance for any replies.
Gilles
By mtakerkart - 7 Years Ago
I too will do 3D 360 video but I've no time for now. I made some search for youtube content and find some info of what is required.
Iclone can render media for stereoscopic vue but it demands some works to achieve the youtube format needeed.

https://developers.google.com/vr/jump/rendering-ods-content.pdf
By yoyomaster - 7 Years Ago
mtakerkart (12/7/2017)
I too will do 3D 360 video but I've no time for now. I made some search for youtube content and find some info of what is required.
Iclone can render media for stereoscopic vue but it demands some works to achieve the youtube format needeed.

https://developers.google.com/vr/jump/rendering-ods-content.pdf

Thanks for your reply!

iClone can easily make stereo(3d) videos, and VR(360 degrees panoramic) videos, what i am not sure of, is how to produce 360 panoramic videos, that are also stereo, you can do one type at a time, if you render 360 VR videos, the stereo option is grayed out, if you render stereo images, the VR 360 option is grayed out!!
By mtakerkart - 7 Years Ago
If you see the pdf it's not just render 2x360 video (right eye/left eye) . because the parallax works only in one direction , if
the viewer turn his head back side , the "stereo" rig of the camera will be inverted. So that's much complicated to achieve this.
it would require a rewriting of the script of Iclone stereo export.
If you need 360 stereo today , the best way is to export your Iclone project in UDK 4....

https://www.unrealengine.com/en-US/blog/capturing-stereoscopic-360-screenshots-videos-movies-unreal-engine-4


By yoyomaster - 7 Years Ago
mtakerkart (12/7/2017)
If you see the pdf it's not just render 2x360 video (right eye/left eye) . because the parallax works only in one direction , if
the viewer turn his head back side , the "stereo" rig of the camera will be inverted. So that's much complicated to achieve this.
it would require a rewriting of the script of Iclone stereo export.
If you need 360 stereo today , the best way is to export your Iclone project in UDK 4....

https://www.unrealengine.com/en-US/blog/capturing-stereoscopic-360-screenshots-videos-movies-unreal-engine-4



Again, thanks for your reply, I just read the paper, makes sense, also looked at your Unreal link, this could be it for the time being, as I doubt that RL will rewrite the stereo export, or maybe I will only go 360 for the time being, thanks again mate!
By yoyomaster - 7 Years Ago
Found a way...

I created 3 cameras, one at the center, then a left and a right camera that I placed at equal distance from the center camera, I linked the left and right camera to the one in the center, I then exported to FBX.

Then I created a new scene
Imported the Raptoid animationÀ
Imported the tree cameras from the FBX file (I had to relink them)
I then placed the center camera so the whole animation was captured
Then I rendered both left and right camera in 360 independently
I then imported both image sequences into Photoshop
I scaled both down to 3840X1080 (from 3840X2160)
created a new PS document at 3840X2160
I pasted both clips in the new document
I put the right one on top, the left one at the bottom
I exported to mp4 full quality
Then I opened the newly mp4 it in GoPro VR player
It played perfectly on my 3D monitor!
Here is a frame scaled down to 720p.

Here is a framehttps://forum.reallusion.com/uploads/images/10ec291c-0443-4737-82e3-db74.jpg
By mtakerkart - 7 Years Ago
Cool! But I think the killer test is to have props around 360 not only in front vue. (props on the front , right, left, rear)
then watch if when you turn around, the  behind vue is not  reverse (front object are behind and vice versa).
By yoyomaster - 7 Years Ago
mtakerkart (12/8/2017)
Cool! But I think the killer test is to have props around 360 not only in front vue. (props on the front , right, left, rear)
then watch if when you turn around, the  behind vue is not  reverse (front object are behind and vice versa).

Get the go pro player and test it for yourself, I will make more tests with a more complex scene as soon as I have free time!
GoPro VR Player

First time I actually used the mini viewport, was very useful to place my camera rig.
By Jfrog - 7 Years Ago
VR360 in Iclone is monoscopic. From the manual, the stereo 3D cannot be use at the same time as 360 VR feature. It is a feature to create 3D content, not 360 content.   
By yoyomaster - 7 Years Ago
Jfrog (12/8/2017)
VR360 in Iclone is monoscopic. From the manual, the stereo 3D cannot be use at the same time as 360 VR feature. It is a feature to create 3D content, not 360 content.   

You can have both 3d stereo and 360 video, my little test proves it, at least with a single object, will try a more complex scene tomorrow, been a long day! Smile
By Jfrog - 7 Years Ago
Great!  Let me know how it handle a complex scene.     Wink

The thing is Iclone is not set up for that so I have no idea how the resolution will be split for each eye to make sure it will be 100% compatible with stereoscopic HDM. 
By yoyomaster - 7 Years Ago
Jfrog (12/8/2017)
Great!  Let me know how it handle a complex scene.     Wink

The thing is Iclone is not set up for that so I have no idea how the resolution will be split for each eye to make sure it will be 100% compatible with stereoscopic HDM. 

Well, in my little rig I set the distance manually, so its trial and error, on that first test the eyes were a bit too far apart, I have shorten the distance and will try another test with a more complex scene!
By mtakerkart - 7 Years Ago
Normally the camera in between distance would be the same as our eyes : around 2.5 inch . I would like to make 3D 360 for youtube that people can see
with their phone with an utopia 360 for exemple :

https://www.bestbuy.com/site/retrak-utopia-360-virtual-reality-headset-with-bluetooth-controller/5449600.p?skuId=5449600
By yoyomaster - 7 Years Ago
Okay, finaly made another test with a more complex scene, looks perfect on my 3D monitor with GoPro player, here is the 4K image (4.19 MB).
loft_3D_360VR.jpg
By yoyomaster - 7 Years Ago
Here is a 4K anaglyph for those who dont have 3D gears, does not look as good as on a 3D screen, but it gives an idea!
Anaglyph_4K.jpg
By Jfrog - 7 Years Ago
Thanks for the image Yoyomaster but it seems like I can only read 360 monoscopic photos with my occulus app (360 photos). I will try to see your marvelous image when I have time to download a new app.  Smile
By yoyomaster - 7 Years Ago
Jfrog (12/8/2017)
Thanks for the image Yoyomaster but it seems like I can only read 360 monoscopic photos with my occulus app (360 photos). I will try to see your marvelous image when I have time to download a new app.  Smile

Sure thing, let us know how it turned out!
By richard666 - 6 Years Ago
Whilst the improvements to iClone have been fantastic and enabled accelereted speed towards producing quality finished film products the lack of 360 Stereoscopic render is like hit a brick wall at 100mph!!!!

There is only one way to get ahead or stay in touch with competition and thats 360 Stereoscopic.

i have waited for its introduction and hope it will come soon.  in the meantime we are exploring and trying out other software. 

Is anyone aware of Reallusions intentions regards 360 Stereoscopic..............is VRay something to do with it............


By lutz0815 - 6 Years Ago
Hi Veteran Member,
I think your camera is too far apart. I have seen it in a VR glasses. Here is my little demo.
1.) 3DPic
2.) VR 3D Panorana Pic
Have fun watching.
https://forum.reallusion.com/uploads/images/1f809ea8-1bb6-4494-8751-e59a.jpg
https://forum.reallusion.com/uploads/images/8f69bfa6-3d26-4197-9065-ac4f.jpg
By tbseo - 6 Years Ago
This sounds like a good idea. When you export the camera as fbx is that just so you have it ready for future use? I think I have the cameras set up but when I try to export in fbx it gives me options to save it for 3dmax or Maya etc and I wasn't sure what to do. I'm going to give it a try without exporting Andy then load it into Sony vegas. Vegas has a way to export as side by side. I hope I can remember how to do it. There's also a plugin that allows you to adjust the differential so you can tweak it and make it a little better.
By txon - 6 Years Ago


ICLONE does not perform VR 360 in 3d