Denoising Deep Monte Carlo Renderings
Abstract
We present a novel algorithm to denoise deep Monte Carlo renderings, in which pixels contain multiple colour values, each for a different range of depths. Deep images are a more expressive representation of the scene than conventional flat images. However, since each depth bin receives only a fraction of the flat pixel's samples, denoising the bins is harder due to the less accurate mean and variance estimates. Furthermore, deep images lack a regular structure in depth—the number of depth bins and their depth ranges vary across pixels. This prevents a straightforward application of patch-based distance metrics frequently used to improve the robustness of existing denoising filters. We address these constraints by combining a flat image-space non-local means filter operating on pixel colours with a deep cross-bilateral filter operating on auxiliary features (albedo, normal, etc.). Our approach significantly reduces noise in deep images while preserving their structure. To our best knowledge, our algorithm is the first to enable efficient deep-compositing workflows with denoised Monte Carlo renderings. We demonstrate the performance of our filter on a range of scenes highlighting the challenges and advantages of denoising deep images.
Video
Text citation
Delio Vicini, David Adler, Jan Novák, Fabrice Rousselle, and Brent Burley. 2019. Denoising Deep Monte Carlo Renderings. In Computer Graphics Forum 38(1). 316-327.
BibTeX
@article{Vicini2018Denoising, author = {Delio Vicini and David Adler and Jan Novák and Fabrice Rousselle and Brent Burley}, title = {Denoising Deep Monte Carlo Renderings}, journal = {Computer Graphics Forum}, volume = {38}, number = {1}, pages = {316-327}, year = {2019}, month = feb, doi = {10.1111/cgf.13533} }