CS 194-26 Image Manipulation and Computational Photography

Project 3: Face Morphing!

Yin Tang, cs194-26-acd



Overview

For this project, we use warping, interpolation and cross-dissolving to produce a "morphing" animation between two face images and also calculate image properties like mean face and implement features transfer.

Part 1 Defining Correspondences

Finding corresponding feature points is crutial in image morphing. The corresponding points are manually selected in the same perticular order. In addition, Delaunay triangulation is used to subdivide the points used for interpolation.

Jackey
Jackey_points
Jackey_tri
George
George_points
George_tri

Part 2 Computing the "Mid-way Face"

For the source face and target face, we calculate the midway face using coordinates mean and an affine transformation to do the inverse-warping on pixels.

Jackey
midway face
George

Part 3 The Morph Sequence

Finally, we are able to generate a series of frame images using interpolation on coordinates and cross-dissolving on pixel values, and simulate image morphing

Jackey_George

Part 4 The "Mean face" of a population

Using the Danes libaray, we can apply the same technique use for image morphing.

danes1_tri
danes10_tri
danes20_tri
danes30_tri
danes40_tri

Then we can calculate the mean face of the dataset.

danes mean face
danes female mean face
danes male mean face

Using the mean face, we can warp some faces in the dataset to match the average shape.

face_1_morphed
face_10_morphed
face_20_morphed
face_30_morphed
face_40_morphed

We can also warp images of ourselves to match the average shape of the dataset, or use the mean face of the dataset to match out face.

Jackey
me_avg
danes_avg
avg_me

Part 5 caricatures: Extrapolating from the mean

Starting from the male mean face, we can extrapolate the difference to produce caricature-like images.

i_0.0
i_0.5
i_0.25
i_0.75
i_1.0
i_1.5.
i_1.25
i_1.75
i_2.0
i_2.25

Bells and Whistles

Using the image data from the Danes dataset, we can tranform images of ourselves to differnt gender or ethnicity.

Jackey
Danes male mean face
dan_ma_shape
dan_ma_color
dan_ma_me
Jackey
Danes female mean face
dan_fema_shape
dan_fema_color
dan_fema_me