CS194 Project 5: Lightfield Camera

Overview

In this project, we use lightfield photos from the Stanford Light Field Archive to do depth refocusing and aperture adjustment on photos that have already been taken. These pictures come from a 17x17 grid and are of the same object but from a slightly different angle.

Depth Refocusing

To do depth refocusing, I took an average over all the photos in the lightfield shifted towards the center image. The shift was done by taking the difference between the location of the center image and the image's (u, v) and multiplying it by a factor C. I combined the results from the range C=0 to C=3 (with step size=0.25).

Here are some results of C=0, C=1, C=2, C=3.

Aperture Adjustment

To do aperture adjustment, I shifted the images in the same way as before but with a fixed C=1. I also only took the average over a certain amount of the center image's neighboring images based on aperture size, eg if aperture=0, the average would only include the center image, and if aperture=1, the average would include the images one neighbor away from the center image. I did this from the range aperture=0 to aperture=8.

Here are some results of aperture=0, 2, 4, 8.

Summary

I learned that light fields are very powerful for performing image effects, and it'd be cool if taking lightfield photos was mainstream.