The Sketchy Database: Learning to Retrieve Badly Drawn Bunnies

Contributions •

A sketch database (Sketchy) of (non-professional) sketches of 12500 objects, and the data collection technique used

•

First deep-learning approach to sketch-based image retrieval, using a common feature space for sketches and images alike

Creating the dataset •

imprecision of human artists

•

photo-based

•

memory-based

Training the network •

test with GoogLeNet and 
 AlexNet architecture

•

pre-train sketches and 
 photos separately using 
 classification loss

•

embed sketches and photos into a shared feature space with Triplet and Siamese loss

•

best results: GoogLeNet with classification and Triplet loss