SSN: Soft Shadow Network for Image Composition

Animation

Abstract

We introduce an interactive Soft Shadow Network (SSN) to generates controllable soft shadows for image compositing. SSN takes a 2D object mask as input and thus is agnostic to image types such as painting and vector art. An environment light map is used to control the shadow's characteristics, such as angle and softness. SSN employs an Ambient Occlusion Prediction module to predict an intermediate ambient occlusion map, which can be further refined by the user to provides geometric cues to modulate the shadow generation. To train our model, we design an efficient pipeline to produce diverse soft shadow training data using 3D object models. In addition, we propose an inverse shadow map representation to improve model training. We demonstrate that our model produces realistic soft shadows in real-time. Our user study shows that the generated shadows are often indistinguishable from shadows calculated by a physics-based renderer.


overview

More Results

overview

Technical Video

BibTeX

Acknowledgements

We appreciate constructive comments from reviewers. Thank Lu Ling for help in data analysis. This research was funded in part by National Science Foundation grant #10001387, Functional Proceduralization of 3D Geometric Models. This work was supported partly by the Adobe Gift Funding.

The website template was borrowed from Michaël Gharbi.