CS 194-26, Fall 2020

Face Morphing

Yash Agarwal, CS194-26-adb



Overview

For this project, we explore the idea of face morphining and creating animations by a simultaneuous warp of the image shape and a cross-dissolve of the image colors.

Defining Correspondences

For this part, we manually select corressponding points in each of the two images (Clooney's and my image) and use Delaunay Triangulation to find the most optimal triangles.

Me
Corresponding Points
Delaunay Triangulation
Clooney Sir
Corresponding Points
Delaunay Triangulation

Computing the "Midway" Face

To compute the midway face, we set the warping fraction = 0.5 and the cross dissolve fraction = 0.5. So this takes the avg shape of the two faces and the average color in the two corressponding sets of triangles.

Me

Morph Sequence

To generate a full transition we simply just use tweak the warping fraction and the cross dissolve fraction. I generated 45 frames. Both the warp fraction and the cross dissolve fraction are set = 1 in the frst frame, so we only see my picture and then are gradually increased to reach 0 in the last frame, to show Clooney's original picture.

Full Morph

The Mean Face of a Population

I used the Danes computer scientists dataset to calculate the mean face of a ppopulation. The mean face of a population is helpful to understand the biases in the population. As we see below, the avg danish computer scientist is a white male.

Mean Face of Danes


Image 5
Image 10
Image 16
Image 25
Image 5 Warped
Image 10 Warped
Image 16 Warped
Image 25 Warped

I also warped my own face into the average Danish face shape and morphed the average Danish face into my face shape.

Me
Morphed into Dane's Shape
Average Face
Morphed into my Face Shape

Caricatures

Here we extrapolate using the points using this formula: pts1 + alpha*(pts1-pts2) and get the following caricatures.

alpha = -1
alpha = 0.5
alpha = 0.9
alpha = 2

Bells and Whistles

The first B&W I tried was changing my ethinicity. I got the image of the average Han Chinese Male from the Internet and tried to morph that into my face. Here are the results.

Average Han Chinese Male
Me
Average Chinese Yash
Just average shape
Just average appearance

The next Bells and Whistles I implemented was participating in this class video which can be seen below. Here is a link to the video.

The next Bells and Whistle I implemented was making a video of me growing up. Here's a cute gif

Time flies by!

Credit for the webstie template goes to Charlie Huang.