Profile Picture

Iray - with AI Denoising .....

Posted By sonic7 8 Years Ago
You don't have permission to rate!
Author
Message
sonic7
sonic7
Posted 8 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)

Group: Forum Members
Last Active: 3 Years Ago
Posts: 1.7K, Visits: 19.4K


Here's an interesting article on iRay with AI - by Phil Miller - from May, 2017 (I looked into this after Dennis (JAV) made mention of 'AI denoising' on another thread)

https://forum.reallusion.com/uploads/images/e54427d8-a3fe-49e7-baff-bff9.png

How Iray Interactive Denoising Works

Existing algorithms for high-quality denoising consume seconds to minutes per frame, which makes them impractical for interactive applications.

By predicting final images from only partly finished results, Iray AI produces accurate, photorealistic models without having to wait for the final image to be rendered.

Designers can iterate on and complete final images 4x faster, for a far quicker understanding of a final scene or model. The cumulative time savings can significantly accelerate a business’s go-to-market plans.

To achieve this, NVIDIA researchers and engineers turned to a class of neural networks called an autoencoder. Autoencoders are used for increasing image resolution, compressing video and many other image processing algorithms.

Using the NVIDIA DGX-1 AI supercomputer, the team trained a neural network to translate a noisy image into a clean reference image. In less than 24  hours, the neural network was trained using 15,000 image pairs with varying amounts of noise from 3,000 different scenes. Once trained, the network takes a fraction of a second to clean up noise in almost any image — even those not represented in the original training set.

With Iray, there’s no need to worry about how the deep learning functionality works. We’ve already trained the network and use GPU-accelerated inference on Iray output. Creatives just click a button and enjoy interactivity with the improved image quality with any Pascal or better GPU.

Iray deep learning functionality will be included with the Iray SDK we supply to software companies, and exposed in Iray plugin products we produce later this year. We also plan to add an AI mode to NVIDIA Mental Ray. We expect renderers of many kinds to adopt this technology. The basis of this technique will be published at the ACM SIGGRAPH 2017 computer graphics conference in July.

Source: https://blogs.nvidia.com/blog/2017/05/10/ai-for-ray-tracing/



--------------------------------------------------------------------------------------------------------------------------------------------------------
Please be patient with me ..... I don't always 'get it' the first time 'round - not even the 2nd time! :(  - yikes! ... 
MSI GT72VR Laptop, i7 7700HQ 4-Core 3.8 GHz 16GB RAM; Nvidia 1070, 8GB Vram iClone-7.93  3DXChange Pipeline 7.81  CC-3 Pipeline 3.44  Live Face  HeadShot  Brekel Pro-Body  Popcorn FX  iRAY  Kinect V2  DaVinci Resolve17  Mixcraft 8.1

sonic7
sonic7
Posted 8 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)

Group: Forum Members
Last Active: 3 Years Ago
Posts: 1.7K, Visits: 19.4K

I've added your video here akuei2  - thanks for posting - it's most interesting ....




I've played around with 'Neat Video' a lot in the past (with Video Production), and it produces amazing results ....
I'd be interested to know how much 'render time' could be saved - if this could be used sucessfully on 'half baked' Iray renders.
Also, I wonder how many iterations will prove to be *enough* ..... 50?  100?  more?

I'd be happy enough with 1 frame per minute or so.
A 5 minute video with 1 iRay rendered frame each minute (@ 24fps) = 5 days
A 5 minute video with 1 iRay rendered frame every 2 miutes (@ 24fps) = 10 days

--------------------------------------------------------------------------------------------------------------------------------------------------------
Please be patient with me ..... I don't always 'get it' the first time 'round - not even the 2nd time! :(  - yikes! ... 
MSI GT72VR Laptop, i7 7700HQ 4-Core 3.8 GHz 16GB RAM; Nvidia 1070, 8GB Vram iClone-7.93  3DXChange Pipeline 7.81  CC-3 Pipeline 3.44  Live Face  HeadShot  Brekel Pro-Body  Popcorn FX  iRAY  Kinect V2  DaVinci Resolve17  Mixcraft 8.1

akuei2
akuei2
Posted 8 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)

Group: Forum Members
Last Active: 3 Years Ago
Posts: 110, Visits: 2.4K
sonic7 (9/20/2018)

I've added your video here akuei2  - thanks for posting - it's most interesting ....




I've played around with 'Neat Video' a lot in the past (with Video Production), and it produces amazing results ....
I'd be interested to know how much 'render time' could be saved - if this could be used sucessfully on 'half baked' Iray renders.
Also, I wonder how many iterations will prove to be *enough* ..... 50?  100?  more?

I'd be happy enough with 1 frame per minute or so.
A 5 minute video with 1 iRay rendered frame each minute (@ 24fps) = 5 days
A 5 minute video with 1 iRay rendered frame every 2 miutes (@ 24fps) = 10 days


OMG x3, 5 min video cost 5 days rendering with Ai denoise on.
You really need supercomputer to save your shot life :)
What I believe, Blender will be a next game's changer in future, because their Eevee are awesome.
Besidely, I focus on another real-time render rengine call U-render ( beta now ).


The demo video show, single pieces GTX 980ti obtain a incredible result.
Maybe, real-time render + AI denoise will be a win win state. CHEER!




sonic7
sonic7
Posted 8 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)Distinguished Member (14.2K reputation)

Group: Forum Members
Last Active: 3 Years Ago
Posts: 1.7K, Visits: 19.4K

lol .... yes well an extra 5 to 10 days rendering isn't a big issue on a project that takes 12-18 months to create lol ....
But this U-render - I just googled it - apparently it's not a ray tracer, but rather a 'real-time' renderer, like in a game engine.
And it integrates into Cinema 4D and was previously known as 'Tachyon-render" .... 
Here's another impressive video, (posted over a year ago) that demonstrates 'Tachyon' using only a GTX1060.... incredible ...



BUT: Cinema 4D is beyond the possible for many - making U-render out of reach.
Besides, most of us see the iClone environment as 'home' where we 'create' animations - complete with settings (for those making *films*).
To be contemplating migrating sets, props and actors to a completely different environment is almost unthinkable if wanting to maintain a simplified workflow.
And as one true iClone loyalist recently stated:
.... Best advice for TODAY is...  concentrate on good lighting and good textures to make your movies look good, put work into good animation, and concentrate on a good story so people want to watch your movie ... JAV
I must look no further!

--------------------------------------------------------------------------------------------------------------------------------------------------------
Please be patient with me ..... I don't always 'get it' the first time 'round - not even the 2nd time! :(  - yikes! ... 
MSI GT72VR Laptop, i7 7700HQ 4-Core 3.8 GHz 16GB RAM; Nvidia 1070, 8GB Vram iClone-7.93  3DXChange Pipeline 7.81  CC-3 Pipeline 3.44  Live Face  HeadShot  Brekel Pro-Body  Popcorn FX  iRAY  Kinect V2  DaVinci Resolve17  Mixcraft 8.1

brand468
brand468
Posted 8 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)Distinguished Member (1.7K reputation)

Group: Forum Members
Last Active: Last Year
Posts: 231, Visits: 7.8K
Absolutely believe that AI Denoising is the future. I run DAZ Studio 4.11 (64-bit) Public Build + Beta that has Nivida Iray denoising and works great. Waiting for Octane V4 plugin for Daz.:)

My computer: Intel i7-7700K 4.2Hhz 64Gb, Windows 10, GeForce GTX 1080 + GeForce GTX 1070, Phillips monitor 40" 4K  3840x2160 + 2x28" 




Reading This Topic