Portrait Relighting for Digital Compositing

By Jay Shenoy

Goal

The goal of this system is to relight an input portrait to match a target portrait with proper illumination and shading effects. For a detailed treatment of the technique, please see the project report linked above.

Results

The input images are given in the leftmost column, and the target images are contained in the first row. The relit input images are in the second row. The relighting algorithm works equally well for target photographs and target paintings, as shown below. Note how the technique properly creates illumination and shadows on corresponding facial regions, which would be impossible under traditional histogram matching. Video results can be found in the project video linked above.