I selected the four corners of the picture on the wall to align with a corners of a hard-coded rectangle I passed in as points to create the homography matrix to.
The first is the original image, second is the rectified one.
Here is a second image I rectified. I selected the four corners of the fence section closest to us to rectify.
First is original image, second is rectified.