Unitail: Detecting, Reading, and Matching in Retail Scene

To make full use of computer vision technology in stores, it is required to consider the actual needs that fit the characteristics of the retail scene. Pursuing this goal, we introduce the United Retail Datasets (Unitail), a large-scale benchmark of basic visual tasks on products that challenges algorithms for detecting, reading, and matching. With 1.8M quadrilateral-shaped instances annotated, the Unitail offers a detection dataset to align product appearance better. Furthermore, it provides a gallery-style OCR dataset containing 1454 product categories, 30k text regions, and 21k transcriptions to enable robust reading on products and motivate enhanced product matching. Besides benchmarking the datasets using various state-of-the-arts, we customize a new detector for product detection and provide a simple OCR-based matching solution that verifies its effectiveness.

PDF Abstract

Datasets


Introduced in the Paper:

Unitail

Used in the Paper:

MS COCO SKU110K SKU110K-R

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Dense Object Detection SKU-110K RetailDet AP 59.0 # 1
One-stage Anchor-free Oriented Object Detection SKU110K-R RetailDet AP 57.5 # 2
AP@75 65.5 # 1

Methods