CS 194 Project 4: Face Morphing - Evan Sheng

Introduction

The goal of this project was to morph one image to another, specifically between two faces. In order to do this, I had to define correspondance points on each face in each of the images. Then, I took the average coordinates of each point to create the average shape, and created a Delaunay triangulation on each of them. I used this triangulation for each image, and for each corresponding triangle, computed the inverse affine transformation matrix from the each image triangulation to the average triangulation. Once both images were morphed into the average shape, I cross dissolved the colors by using the same weighted average used to calculate the average shape but this time for the pixel values of the warped images.

The results are shown below

Mid-Way Face

Here are the two original images, and the Midway point for weighted average value 0.5

My Face My Roomate's Face Mid-way Face

The Morph Sequence

Here are the Morph sequences calculated by using 45 different "average" weights, and then combining each frame to form gifs.

Evan to Kimo George Clooney to Brad Pitt

Mean Face

For this section I used the Danish computer science dataset images and correspondance points to compute the mean image of the provided population. The Mean Face is displayed below

Mean Face

I also computed the images of some of the Danish computer scientists morphed to the average shape, as well as my face to the average shaped and vice versa

Male in set Male morphed to average Female in set Female morphed to average
Male to mean morph Female to mean morph
My face morphed to mean shape Mean morphed to my face shape

Caricatures

For this part, to create a caricature, I extrapolated from the mean image by taking the difference between the mean image's correspondance points and my own. Then, multiplied the difference by varying scalars and adding them back to the mean's shape to get the final shape to morph my face. Results shown below.

Scalar of 1.4 Scalar of 1.8 Scalar of 2.2

Bells and Whistles

For this section, I chose to use this project to change my ethnicity. I found an average spanish male picture online and used it to generate a more spanish version of my face.

My Face Average Spanish
Spanish Me More Spanish Me