SHREC 2022: pothole and crack detection in the road pavement using images and RGB-D data

This paper describes the methods submitted for evaluation to the SHREC 2022 track on pothole and crack detection in the road pavement. A total of 7 different runs for the semantic segmentation of the road surface are compared, 6 from the participants plus a baseline method. All methods exploit Deep Learning techniques and their performance is tested using the same environment (i.e.: a single Jupyter notebook). A training set, composed of 3836 semantic segmentation image/mask pairs and 797 RGB-D video clips collected with the latest depth cameras was made available to the participants. The methods are then evaluated on the 496 image/mask pairs in the validation set, on the 504 pairs in the test set and finally on 8 video clips. The analysis of the results is based on quantitative metrics for image segmentation and qualitative analysis of the video clips. The participation and the results show that the scenario is of great interest and that the use of RGB-D data is still challenging in this context.

PDF Abstract

Datasets


Introduced in the Paper:

Pothole Mix

Used in the Paper:

ImageNet CRACK500

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Semantic Segmentation Pothole Mix HCMUS-CPS-DLU-Net Validation mIoU 0 .647 # 1
Test mIoU 0 .677 # 1
Validation Dice Multiclass 0 .763 # 1
Test Dice Multiclass 0 .789 # 1
Semantic Segmentation Pothole Mix HCMUS-DeepLabv3+ Validation mIoU 0 .695 # 1
Test mIoU 0 .719 # 1
Validation Dice Multiclass 0 .802 # 1
Test Dice Multiclass 0 .823 # 1
Semantic Segmentation Pothole Mix HCMUS-SegFormer Validation mIoU 0 .523 # 1
Test mIoU 0 .628 # 1
Validation Dice Multiclass 0 .637 # 1
Test Dice Multiclass 0 .747 # 1
Semantic Segmentation Pothole Mix PUCP-Unet++ Validation mIoU 0 .694 # 1
Test mIoU 0 .731 # 1
Validation Dice Multiclass 0 .800 # 1
Test Dice Multiclass 0 .832 # 1
Semantic Segmentation Pothole Mix PUCP-Unet Validation mIoU 0 .698 # 1
Test mIoU 0 .720 # 1
Validation Dice Multiclass 0 .804 # 1
Test Dice Multiclass 0 .824 # 1
Semantic Segmentation Pothole Mix PUCP-MAnet Validation mIoU 0 .705 # 1
Test mIoU 0 .725 # 1
Validation Dice Multiclass 0 .810 # 1
Test Dice Multiclass 0 .827 # 1
Semantic Segmentation Pothole Mix Baseline - DeepLabv3+ Validation mIoU 0 .711 # 1
Test mIoU 0 .676 # 1
Validation Dice Multiclass 0 .814 # 1
Test Dice Multiclass 0 .789 # 1

Methods


No methods listed for this paper. Add relevant methods here