Christine Zhou, cs194-26-act
In this project, we want to take many different faces and morph them together in different ways.
First, we must define how the two faces correspond to each other since each face has its own features. We did this by choosing a set of points (the four corners of the image, eyes, nostrils, lips, cheekbones, etc.), and then recording the coordinates of each of those points in each of the images. The points on both George Clooney and Taylor Swift are shown below:
After recording the coordinates of each image, the coordinates are then averaged. These averaged coordinates then triangulated, which will be used in the next part when creating the mid-way face.
Using the triangulated mid-way coordinates, we then warp both faces into that shape and average the colors together. We do this by implementing an affine wrap for each triangle in the triangulation from the original image into the new shape. The "mid-way" face for Taylor Swift and George Clooney is shown below:
Now we generate the morph sequence, which is done by creating 45 different images with different weights on each of the image's pixel values. The morph of George Clooney into Taylor Swift is shown below:
Using similar techniques to how we produced the "mid-way" face, we generate the "mean face" of a population. I used the [FEI database of faces][https://fei.edu.br/~cet/facedatabase.html], which provides images along with the corresponding points of each image. The mean face is shown below:
The individual faces are shown morphed into the average face shape.
I also morphed George Clooney's face into the average face shape, and morphed the average face into George Clooney's face shape:
We then computed a caricature of the image. If we had source image S and average face T, then our new correspondence coordinates would be T + alpha * (S - T). The (S - T) term allows us to find the features of the source that are different from the average. These are then weighted by an alpha value and added back to the original correspondence coordinates. An example of a caricature is shown below with alpha value 1.5:
For bells and whistles, I morphed George Clooney on the average Han Chinese male face shape. The result is shown below: