Superpixels optimized by color and shape

Abstract

Image over-segmentation is formalized as the approximation problem when a large image is segmented into a small number of connected superpixels with best fitting colors. The approximation quality is measured by the energy whose main term is the sum of squared color deviations over all pixels and a regularizer encourages round shapes. The first novelty is the coarse initialization of a non-uniform superpixel mesh based on selecting most persistent edge segments. The second novelty is the scale-invariant regularizer based on the isoperimetric quotient. The third novelty is the improved coarse-to-fine optimization where local moves are organized according to their energy improvements. The algorithm beats the state-of-the-art on the objective reconstruction error and performs similarly to other superpixels on the benchmarks of BSD500.