Search Results for author:
Found 2 papers, 0 papers with code
PARIS and ELSA: An Elastic Scheduling Algorithm for Reconfigurable Multi-GPU Inference Servers
However, maximizing server utilization and system throughput is also crucial for ML service providers as it helps lower the total-cost-of-ownership.
LazyBatching: An SLA-aware Batching System for Cloud Machine Learning Inference
In cloud ML inference systems, batching is an essential technique to increase throughput which helps optimize total-cost-of-ownership.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
