Face Morphing

Project Members: Naren Krishna (cs194-26-abv)

Project Overview

The goal of this project was to produce a morph animation of my face into someone else's face (i.e. Russell Crowe). First, I definined correspondence points between two images in an effort to control the warp. I did this by defining a Delauney Triangulation on the aforementioned points and computing the triangulation at the midway shape (average of two point sets). Then I computed the inverse affine transformation for each triangle in the source image to each corresponding triangle in the target image. Once I applied that inverse warp and interpolated, I was able to create a midway face between source and target image. I then played around with the warp fraction and dissolve fraction (scalar hyperparameters to control shape warping and cross-dissolve respectively) to then used to produce 45 images at varying stages between source and target image. These 45 frames were then morphed into an animated gif. The entire process is shown below morphing my face into Russell Crowe's and vice-versa.

For the second part of the project, I computed a "mean" of a population from the Danes dataset. Once I had that mean, I used techniques explored in the previous parts to warp faces into the "mean". I then produced a caricature from the population mean moving alphs from 0 to -1 enhancing the unique characteristics of my face.

Results

Defining Correspondences

Input Image (Naren a.k.a. Me)

Input Image Correspondences

Target Image (Russell Crowe)

Target Image Correspondences

Computing the "Mid-way Face"

The Mid-Way Face

For Funsies: Naren Image Warped into Mid-Way Face

For Funsies: Russell Image Warped into Mid-Way Face

The Morph Sequence

GIF Animation of Face Morphing from me to Russell Crowe (Please Refresh Page to see GIF animation again as it is static on Russell Crowe)

GIF Animation of Face Morphing from Russell Crowe to me (Please Refresh Page to see GIF animation again as it is static on my face)

The "Mean Face" of a Population

Mean Face

Naren Face Warped to Mean Face

Mean Face Warped to Naren Face

Sample Population Face

Sample Population Face warped to Mean Population Face

Mean Population Face warped to Sample Population Face

Caricatures: Extrapolating from the mean

My Face Caricature

Bells and Whistles: Changing Gender and Ethnicity

Morph Video: Asian Female to My Face (Please Refresh Page to see GIF animation again)

Morph Video: My Face to Asian Female (Please Refresh Page to see GIF animation again)