Project 1: Seam Blending

For this project, I attempted to look at seam carving based on the paper Image Quilting for Texture Synthesis and Transfer by Freeman and our lovely Professor Efros.

The first approach involves getting a random patch of a particular size. We mash them all together and we have a kinda okay looking thing.

bricks random texture

First is the original texture of bricks, and next is the random textured image mashing those random patches together.

Next is a bit more complicated. Taking a patch as usual, we try and find a patch that borders such that the SSD of the overlapping regions of the patches is minimised. This will make the transition between patches smooth, at least in theory!

ssd matching

So one thing I really want to talk about here. Look at the diagram above. Yeah, it's nice that the overlap will be minimised in terms of SSD, which just means that colour values will be decently similar to one another at the same pixels. This is a sounds good, but doesn't work.

Notice how there's a lot of the same stuff going on. That's what we want, but not really like that. If there's a weird part of a patch, that pattern will be continued in a section, but may lead to really awkward continuity.