DVFO: Learning-Based DVFS for Energy-Efficient Edge-Cloud Collaborative Inference

no code implementations • 2 Jun 2023 • Ziyang Zhang, Yang Zhao, Huan Li, Changyao Lin, Jie Liu

Due to limited resources on edge and different characteristics of deep neural network (DNN) models, it is a big challenge to optimize DNN inference performance in terms of energy consumption and end-to-end latency on edge devices.

Collaborative Inference

BCEdge: SLO-Aware DNN Inference Services with Adaptive Batching on Edge Platforms

no code implementations • 1 May 2023 • Ziyang Zhang, Huan Li, Yang Zhao, Changyao Lin, Jie Liu

As deep neural networks (DNNs) are being applied to a wide range of edge intelligent applications, it is critical for edge inference platforms to have both high-throughput and low-latency at the same time.

Scheduling