In this project we want to create a morphing between two faces,
compute the “mean” face of a population, and also do extrapolation to
get caricature results.

1. Alignment

The first step to morphing two images it to align them so they are on
the same coordinate plane. Then we can pick points of correspondences
that makes sense

2. Compute the Middle Object

Using the points of correspondences, we can the shape vector of the
middle image. And use that to calculate a common delaunay
triangulation that can be applied to both images.

Then, we compute the average colors of the images by averaging
values.

Mathematically, it would be
alpha * image1 + (1-alpha) * image2

Aligned Picture of Me

Aligned Picture of I.U.

Triangulation of Me

Triangulation of I.U.

3. Morphing Sequence

To make this into a video, we just need to calculate the middle
objects of each frame. All we need to do is to variate alpha.
Then I can create a gif :)

4. Computing the “mean” face of a population

To find the average face of a population, we apply the same logic. We
find the average shape by interpolating all shape vectors. Warp all
the individual images to the average shape. And combine the weighted
pixel values.

Average of Danes

Triangulation of Average

Here are some examples of warping input to "mean danes"

Input

Warped

Input

Warped

Input

Warped

Caricature

We can make our faces look more cartoon-like by extrapolating our
unique qualities. First, find the difference between my face’s shape
vector and the population mean’s shape vector. Then emphasize the
difference (i.e. my unique qualities) by adding it to the original
image of myself.

Using a simple population of I.U., me and another student, I created some caricatures of myself. I used a variable alpha to adjust the caricature degree.

original me

alpha = 0.8

alpha = 3 - "I am a fish"

Bells and Whistles

Together with Roma Desai
Vanessa Lin,
Jason Wang,
Jenny Song,
Ankit Agarwal,
Won Ryu,
Briana Zhang,
Tushar Sharma,
Michael Wang,
Ja (Thanakul) Wattanawong,
William Loo, and
Gary Yang, we have created a video of our
faces morphing to one another!