Multiple-Scattering Microfacet BSDFs with the Smith Model
Skills:
Reading ML Papers70%
Key Takeaways
Discusses the concept of multiple-scattering microfacet BSDFs with the Smith Model for rendering rough surfaces
Full Transcript
in this paper we address an important open problem in material modeling what happens when light scatters multiple times on rough material surfaces in image synthesis accurately describing light matter interactions is important for materials to obtain a realistic look however the multiple light matter interactions that we can see in this figure are absent from many surface appearance models here's an example of this problem rendering white glass should be simple but we can see that the raw for the glass is the darker its appearance becomes even though it should be simple modeling the appearance of glass that is at the same time rough and white is almost impossible with the current material models many material models such as those rough dialectric plates are called microfacet materials because the underlying mathematical model assumes that their interfaces are made of microscopic imperfections that we call facets those facets are too small to be visible but the way they are statistically oriented change the way light interacts with the material causing its rough appearance many rendering systems model only the contribution of the first bounce of light the contribution of multiple bounces is unknown and it is simply set to zero as if it were neglectable however on very rough micros surfaces the amount of light that scatters multiple times is significant and should not be neglected to avoid energy loss and the noticeable darkening of the material appearance in summary modeling rough materials correctly with with multiple scattering is a challenging problem our multiple scattering model presented in this paper opens up the possibility of modeling rough materials correctly in a practical manner Beyond fixing the darkening problem our goal is to derive a physically based model that is able to make accurate predictions compared to reference data more specifically we derived the multiple scattering component of a specific kind of microsurface the Smith microsurface model because it is based on simple assumptions and makes accurate predictions for single scattering it has received widespread industrial adoption and is considered the academic state-of-the-art in computer graphics for modeling many materials but can we extend this model for multiple scattering and could it be practically incorporated into a classic bsdf plugin these are the questions we are interested in our main Insight is to transform this surface scattering problem into a volume scattering problem which is easier to solve to achieve that we show that the Smith microsurface model can be derived as a special case of the microflame theory for volumes we reformulate the Smith microsurface as a volume with additional constraints to enforce the presence of a Sharp interface this volumetric analogy is very convenient because we know how to compute the light scattering in volumes it depends on two functions that we derve for this new kind of volume the first one is the free path distribution which tells us how long a rate can travel in a medium before finding an intersection on the micros surface the equivalent question is what is the height of the next intersection once an intersection is found we need to know in which direction the light is scattering again this is given by a volumetric phase function which depends on both the base material of the surface and the distribution of the micr faets we derived the phase function for three different surface materials diffuse conductive and dialectric and common microf faet distributions such as Beckman and ggx now that we know the free path and the phas function of this volumetric model we know exactly how the light scatters in the medium from the light propagated in this medium emerges a distribution that has all the expected properties of a classic surface bsdf it is energy conserving and reciprocal furthermore it is exactly the classic single scattering bsdf based on the Smith microsurface model but with the addition of higher order scattering now that we know that the model is mathematically correct we are interested in its predictive power how accurate is this new model to answer this question we need some reference data to compare the predictions of the model two a common way to validate models is to compare their predictions to simulated data obtained by R tracing triangulated surfaces contrary to real world acquisition the surface used in the simulation has known material and statistics and the collected data are free of noise there is thus no decrease of Freedom left to match the parameters of the model to the simulation this is why this validation procedure is widely used in the field of optical physics and therefore we chose this to validate our model we generated random surfaces with known bman statistics and did a r tracing simulation on them by comparing the predictions of our multiple scattering model to the results of the rate racing simulation we found our bsdf model to accurately predict both the albo and angular distribution of the excitant energy among the scattering orders and this for a large variety of materials roughnesses and isotropy and inclinations in our supplemental material we provide an exhaustive set of such validation results to make the model practical we Implement two procedures evaluation and import sampling since the bsdf is the expectation of all the paths that can be traced on the microsurface important sampling can be done straightforwardly by generating One path we construct an unbiased tastic estimate by tracing One path and evaluating the phase functions at each intersection with next event estimation as in classical path tracing with important sampling and this stochastic evaluation we have everything requir re ired to implement a classic bsdf plug-in furthermore our implementation is analytic and does not use per bsdf precomputed data which makes RB sdfs usable with textured albos roughness and an isotropy in the supplemental materials we provide a document describing a tutorial implementation for various materials and ready to use plugins for the mitsuba physically based renderer now let's have a look at some results this image shows a collection of bottles with microfacet materials the energy loss is significant if multiple scattering is neglected especially on dial electrics without multiple scattering rough transmittance appears unnatural which is hard to compensate for by tuning parameters with our multiple scattering model we simulate the expected appearance of rough glass and metals without tuning any parameters our model is robust and behaves as expected even with high roughness values we can see that the model avoids the darkening effects and even produces interesting emerging effects like color saturation this can be observed on this rough diffus material since the absorption spectrum of the material is repeatedly multiplied after each bounce on the microsurface the reflected color appears more saturated after multiple bounces this emerging effect can also be seen on this gold conductor material the unsaturated single scattering gold conductor appears strangely dull thanks to our model the introduction of multiple scattering restores the shiny appearance expected from gold note that since our model is parametric and does not depend on any precomputed data we fully support textured input which is important for creating visually Rich images as an example this is a dialectric with textured roughness and anisotropy thanks for watching
Original Description
The paper "Multiple-Scattering Microfacet BSDFs with the Smith Model" is available here:
https://eheitzresearch.wordpress.com/240-2/
Update: it is being added to Blender's Cycles! - https://developer.blender.org/D2002
Modeling multiple scattering in microfacet theory is considered an important open problem because a non-negligible portion of the energy leaving rough surfaces is due to paths that bounce multiple times. In this paper we derive the missing multiple-scattering components of the popular family of BSDFs based on the Smith microsurface model. Our derivations are based solely on the original assumptions of the Smith model. We validate our BSDFs using raytracing simulations of explicit random Beckmann surfaces.
______________________________
Subscribe if you would like to see more of these! - http://www.youtube.com/subscription_center?add_user=keeroyz
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu
Károly Zsolnai-Fehér's links:
Patreon → https://www.patreon.com/TwoMinutePapers
Facebook → https://www.facebook.com/TwoMinutePapers/
Twitter → https://twitter.com/karoly_zsolnai
Web → https://cg.tuwien.ac.at/~zsolnai/
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Two Minute Papers · Two Minute Papers · 30 of 60
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
▶
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Fluid Simulations with Blender and Wavelet Turbulence | Two Minute Papers #1
Two Minute Papers
Capturing Waves of Light With Femto-photography | Two Minute Papers #2
Two Minute Papers
Artificial Neural Networks and Deep Learning | Two Minute Papers #3
Two Minute Papers
Blender Rendering - Top 7 LuxRender Features
Two Minute Papers
Simulating Breaking Glass | Two Minute Papers #4
Two Minute Papers
Time Lapse Videos From Community Photos | Two Minute Papers #5
Two Minute Papers
AI Learns Van Gogh's Art
Two Minute Papers
Hydrographic Printing | Two Minute Papers #7
Two Minute Papers
Announcing LuxRender 1.5
Two Minute Papers
Digital Creatures Learn To Walk | Two Minute Papers #8
Two Minute Papers
Manipulating Photorealistic Renderings | Two Minute Papers #9
Two Minute Papers
Adaptive Fluid Simulations | Two Minute Papers #10
Two Minute Papers
Building Bridges With Flying Machines | Two Minute Papers #11
Two Minute Papers
Reconstructing Sound From Vibrations | Two Minute Papers #12
Two Minute Papers
Creating Photographs Using Deep Learning | Two Minute Papers #13
Two Minute Papers
Adaptive Cloth Simulations | Two Minute Papers #14
Two Minute Papers
Synthesizing Sound From Collisions | Two Minute Papers #15
Two Minute Papers
Metropolis Light Transport | Two Minute Papers #16
Two Minute Papers
3D Printing a Glockenspiel | Two Minute Papers #17
Two Minute Papers
Modeling Colliding and Merging Fluids | Two Minute Papers #18
Two Minute Papers
Recurrent Neural Network Writes Music and Shakespeare Novels | Two Minute Papers #19
Two Minute Papers
Gradients, Poisson's Equation and Light Transport | Two Minute Papers #20
Two Minute Papers
Real-Time Facial Expression Transfer | Two Minute Papers #21
Two Minute Papers
Automatic Lecture Notes From Videos | Two Minute Papers #22
Two Minute Papers
Be a Part of Two Minute Papers on Patreon!
Two Minute Papers
Recurrent Neural Network Writes Sentences About Images | Two Minute Papers #23
Two Minute Papers
How Does Deep Learning Work? | Two Minute Papers #24
Two Minute Papers
Cryptography, Perfect Secrecy and One Time Pads | Two Minute Papers #25
Two Minute Papers
Terrain Traversal with Reinforcement Learning | Two Minute Papers #26
Two Minute Papers
Multiple-Scattering Microfacet BSDFs with the Smith Model
Two Minute Papers
Google DeepMind's Deep Q-Learning & Superhuman Atari Gameplays | Two Minute Papers #27
Two Minute Papers
Are We Living In a Computer Simulation? | Two Minute Papers #28
Two Minute Papers
Artificial Superintelligence [Audio only] | Two Minute Papers #29
Two Minute Papers
Automatic Parameter Control for Metropolis Light Transport | Two Minute Papers #30
Two Minute Papers
Randomness and Bell's Inequality [Audio only] | Two Minute Papers #31
Two Minute Papers
OpenAI - Non-profit AI company by Elon Musk and Sam Altman
Two Minute Papers
How Do Genetic Algorithms Work? | Two Minute Papers #32
Two Minute Papers
Painting with Fluid Simulations | Two Minute Papers #33
Two Minute Papers
Peer Review #1 [Audio only] | Two Minute Papers
Two Minute Papers
Neural Programmer-Interpreters Learn To Write Programs | Two Minute Papers #34
Two Minute Papers
9 Cool Deep Learning Applications | Two Minute Papers #35
Two Minute Papers
Designing Cities and Furnitures With Machine Learning | Two Minute Papers #36
Two Minute Papers
Designing 3D Printable Robotic Creatures | Two Minute Papers #37
Two Minute Papers
3D Printing Objects With Caustics | Two Minute Papers #38
Two Minute Papers
Interactive Editing of Subsurface Scattering | Two Minute Papers #39
Two Minute Papers
Simulating Viscosity and Melting Fluids | Two Minute Papers #40
Two Minute Papers
What Do Virtual Objects Sound Like? | Two Minute Papers #41
Two Minute Papers
How DeepMind Conquered Go With Deep Learning (AlphaGo) | Two Minute Papers #42
Two Minute Papers
Breaking Deep Learning Systems With Adversarial Examples | Two Minute Papers #43
Two Minute Papers
Extrapolations and Crowdfunded Research (Experiment) | Two Minute Papers #44
Two Minute Papers
Biophysical Skin Aging Simulations | Two Minute Papers #45
Two Minute Papers
What is Impostor Syndrome? | Two Minute Papers #46
Two Minute Papers
Should You Take the Stairs at Work? (For Weight Loss) | Two Minute Papers #47
Two Minute Papers
Artistic Manipulation of Caustics | Two Minute Papers #48
Two Minute Papers
Deep Learning Program Learns to Paint | Two Minute Papers #49
Two Minute Papers
Interactive Photo Recoloring | Two Minute Papers #50
Two Minute Papers
How To Get Started With Machine Learning? | Two Minute Papers #51
Two Minute Papers
Awesome Research For Everyone! - Two Minute Papers Channel Trailer
Two Minute Papers
10 More Cool Deep Learning Applications | Two Minute Papers #52
Two Minute Papers
How DeepMind's AlphaGo Defeated Lee Sedol | Two Minute Papers #53
Two Minute Papers
More on: Reading ML Papers
View skill →Related Reads
📰
📰
📰
📰
A lightweight workflow for keeping up with AI conference papers
Dev.to · Daniel
Why CitedEvidence Believes Great Researchers Read Less Than You Think
Medium · AI
How to Write a Literature Review That Actually Argues Something
Medium · Machine Learning
I Built a Personal Paper Engine to Stop Losing Research Papers
Dev.to · Ethan
🎓
Tutor Explanation
DeepCamp AI