Colorization is the process of adding plausible color information to monochrome photographs or videos. Colorization is a highly undetermined problem, requiring mapping a real-valued luminance image to a three-dimensional color-valued one, that has not a unique solution.
Recently, with the revolutionary neural style transferring methods, creditable paintings can be synthesized automatically from content images and style images.
We embrace the underlying uncertainty of the problem by posing it as a classification task and use class-rebalancing at training time to increase the diversity of colors in the result.
Ranked #46 on Self-Supervised Image Classification on ImageNet
The system directly maps a grayscale image, along with sparse, local user "hints" to an output colorization with a Convolutional Neural Network (CNN).
We review some of the most recent approaches to colorize gray-scale images using deep learning methods.
We demonstrate these properties for the tasks of MNIST digit generation and image colorization.
This intermediate output can be used to automatically generate a color image, or further manipulated prior to image formation.