ePillID Dataset: A Low-Shot Fine-Grained Benchmark for Pill Identification

28 May 2020  ·  Naoto Usuyama, Natalia Larios Delgado, Amanda K. Hall, Jessica Lundin ·

Identifying prescription medications is a frequent task for patients and medical professionals; however, this is an error-prone task as many pills have similar appearances (e.g. white round pills), which increases the risk of medication errors. In this paper, we introduce ePillID, the largest public benchmark on pill image recognition, composed of 13k images representing 9804 appearance classes (two sides for 4902 pill types). For most of the appearance classes, there exists only one reference image, making it a challenging low-shot recognition setting. We present our experimental setup and evaluation results of various baseline models on the benchmark. The best baseline using a multi-head metric-learning approach with bilinear features performed remarkably well; however, our error analysis suggests that they still fail to distinguish particularly confusing classes. The code and data are available at https://github.com/usuyama/ePillID-benchmark.

PDF Abstract

Datasets


Introduced in the Paper:

ePillID

Results from the Paper


 Ranked #1 on Pill Classification (Both Sides) on ePillID (using extra training data)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Pill Classification (Both Sides) ePillID ResNet152 CBP mAP 95.76 # 1
Pill Classification (Both Sides) ePillID DenseNet161 B-CNN mAP 93.11 # 6
Pill Classification (Both Sides) ePillID DenseNet161 mAP 93.41 # 5
Pill Classification (Both Sides) ePillID DenseNet161 CBP mAP 94.03 # 4
Pill Classification (Both Sides) ePillID ResNet152 B-CNN mAP 95.01 # 3
Pill Classification (Both Sides) ePillID ResNet152 GAP mAP 95.71 # 2

Methods


No methods listed for this paper. Add relevant methods here