Face Morphing

CS 194-26: Image Manipulation and Computational Photography

Casey Takahashi

Defining Correspondences

I found corresponding pairs of points by hand between the two images for important feature points. I found the set of midway points that are halfway between each of the pairs of points. I then imported a triangulation method to find the Delaunay triangluation on the midway points.


Computing the Midway Face

To find the midway face, I found the affine transformation for each triangles in the midway triangulation to the triangulation of each image. I then morphed each image to the midway shape, and cross dissolved the images so both images were weighted equally.


The Morph Sequence

The morph sequence for one way is 45 images (90 total because the gif goes both from me to Emma and back). To create the morph sequence, I found the set of points a certain fraction away from one image, and warped both images to that shape (rather than always to the midway shape). I also cross dissolved using 1 minus the warp fraction to create the image in the sequence.


The Mean Face of a Population

To get the mean face of a population, I found the average of all the correspondence points, and found the triangulation to get the midway shape. I warped all the images to the midway shape, and then took the average of all the pixel values after each image.

Examples of some of the faces morphed into the average shape:


Average face of population


(1) Me to average geometry, (2) average face to my geometry.


Caricatures: Extrapolating from the Mean

To create the caricatures, I took the difference between the correspondence points of the mean face and my face, multiplied the difference by some scalar,and added it back onto my face. These images create some weird creases in my face, which is probably because the correspondance points were not completely matched with the images in the Danes set.


Bells and Whistles

Inside Out Morph Music Video

I chose to make a music video of a morph sequence between some of the emotions and characters in Inside Out! You will find some aliasing in the morphs because the morphs are for full body, and because the body shapes are so drastically different, some of the triangles get inverted (i.e. for big noses or different arm positions).