The first step to create a face morphing sequence is to define pairs of correspondences between the images. These correspondences should pinpoint the most significant features that morphing bases on. Here, I selected 45 pairs of correspondences, denoted by green dots, for the photos of George and me.
|
|
|
|
To create any intermediary face I along the morphing sequence from the starting image S to the destination image D, the following steps are performed:
|
|
|
|
In this part, I created the mean face of Brazillian researchers from the pre-labeled dataset: https://fei.edu.br/~cet/facedatabase.html. It contains 200 faces with 46 labeled points, among which 100 faces are emotionless and 100 are smiling. I chose only the smiling set of faces, and manually added points to the four corners of each image. To create the mean face, I first compute the target correspondences by averaging all points of the 100 images, and then repeat the process from the previous part to average the shape and color of each face.
Here are some sample faces from thee dataset (left), and the resulting images of them warped to the average correspondences (right):
|
|
|
|
Here is the mean face of all 100 smiling Brazilian researchers, which is just a nice smiley face with no prominent features (strong personal features are averaged out!):
|
Here are two experiments of morphing the "mean population" face to the geometry of my face and morphing my face to the geometry of the "mean population" face. The shapes are well-kept, but results are hilarious. Guess I just don't look like a Brazilian:)
|
|
Subtracting the mean face features from our face features capture the prominent features of our faces. Caricatures can be made in this way. Hence, different from previous parts, the targeting correspondences are calculated using the formula: target_pts = mean_pts + alpha * (my_pts - mean_pts), alpha being a value smaller than 0 or larger than 1. Then the same morphing technique is applied to triangles, mapping the shape and color to the target images (caricatures). I created two caricatures using alpha = -1 and alpha = 1.5:
|
|
|
In this part, I morphed Michael Fassbender's stern face to my smiling face. Michael smiled when only morphing the shape, and he got makeup and a more feminine look when morphing both the shape and color!
|
|
|
|
I participated in the music video with some other classmates and here is the link to the whole video: https://youtu.be/O3vouduLS3w
Also, here is my part from it:
|