TwinLiteNet: An Efficient and Lightweight Model for Driveable Area and Lane Segmentation in Self-Driving Cars

20 Jul 2023  ·  Quang Huy Che, Dinh Phuc Nguyen, Minh Quan Pham, Duc Khai Lam ·

Semantic segmentation is a common task in autonomous driving to understand the surrounding environment. Driveable Area Segmentation and Lane Detection are particularly important for safe and efficient navigation on the road. However, original semantic segmentation models are computationally expensive and require high-end hardware, which is not feasible for embedded systems in autonomous vehicles. This paper proposes a lightweight model for the driveable area and lane line segmentation. TwinLiteNet is designed cheaply but achieves accurate and efficient segmentation results. We evaluate TwinLiteNet on the BDD100K dataset and compare it with modern models. Experimental results show that our TwinLiteNet performs similarly to existing approaches, requiring significantly fewer computational resources. Specifically, TwinLiteNet achieves a mIoU score of 91.3% for the Drivable Area task and 31.08% IoU for the Lane Detection task with only 0.4 million parameters and achieves 415 FPS on GPU RTX A5000. Furthermore, TwinLiteNet can run in real-time on embedded devices with limited computing power, especially since it achieves 60FPS on Jetson Xavier NX, making it an ideal solution for self-driving vehicles. Code is available: url{https://github.com/chequanghuy/TwinLiteNet}.

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Drivable Area Detection BDD100K val TwinLiteNetPlus-Large mIoU 92.9 # 2
Params (M) 1.94 # 4
Drivable Area Detection BDD100K val TwinLiteNetPlus-Nano mIoU 87.3 # 7
Params (M) 0.03 # 6
Lane Detection BDD100K val TwinLiteNet Params (M) 0.43 # 5
IoU (%) 31.08 # 3
Drivable Area Detection BDD100K val TwinLiteNet mIoU 91.3 # 4
Params (M) 0.43 # 5

Methods


No methods listed for this paper. Add relevant methods here