Photo2ClipArt: Image Abstraction and Vectorization Using Layered Linear Gradients

We present a method to create vector cliparts from photographs. Our approach aims at reproducing two key properties of cliparts: they should be easily editable, and they should represent image content in a clean, simplified way. We observe that vector artists satisfy both of these properties by modeling cliparts with linear color gradients, which have a small number of parameters and approximate well smooth color variations. In addition, skilled artists produce intricate yet editable artworks by stacking multiple gradients using opaque and semi-transparent layers. Motivated by these observations, our goal is to decompose a bitmap photograph into a stack of layers, each layer containing a vector path filled with a linear color gradient. We cast this problem as an optimization that jointly assigns each pixel to one or more layer and finds the gradient parameters of each layer that best reproduce the input. Since a trivial solution would consist in assigning each pixel to a different, opaque layer, we complement our objective with a simplicity term that favors decompositions made of few, semi-transparent layers. However, this formulation results in a complex combinatorial problem combining discrete unknowns (the pixel assignments) and continuous unknowns (the layer parameters). We propose a Monte Carlo Tree Search algorithm that efficiently explores this solution space by leveraging layering cues at image junctions. We demonstrate the effectiveness of our method by reverse-engineering existing cliparts and by creating original cliparts from studio photographs.

@Article{FLB17,
  author       = "Favreau, Jean-Dominique and Lafarge, Florent and Bousseau, Adrien",
  title        = "Photo2ClipArt: Image Abstraction and Vectorization Using Layered Linear Gradients",
  journal      = "ACM Transactions on Graphics (SIGGRAPH Asia Conference Proceedings)",
  number       = "6",
  volume       = "36",
  month        = "November",
  year         = "2017",
  url          = "http://www-sop.inria.fr/reves/Basilic/2017/FLB17"
}