Search Results for author:
Found 5 papers, 1 papers with code
Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction
Large language models (LLMs) have been driving a new wave of interactive AI applications across numerous domains.
BayesPerf: Minimizing Performance Monitoring Errors Using Bayesian Statistics
Hardware performance counters (HPCs) that measure low-level architectural and microarchitectural events provide dynamic contextual information about the state of the system.
Inductive-bias-driven Reinforcement Learning For Efficient Schedules in Heterogeneous Clusters
The problem of scheduling of workloads onto heterogeneous processors (e. g., CPUs, GPUs, FPGAs) is of fundamental importance in modern data centers.
Live Forensics for Distributed Storage Systems
We present Kaleidoscope an innovative system that supports live forensics for application performance problems caused by either individual component failures or resource contention issues in large-scale distributed storage systems.
ML-based Fault Injection for Autonomous Vehicles: A Case for Bayesian Fault Injection
The safety and resilience of fully autonomous vehicles (AVs) are of significant concern, as exemplified by several headline-making accidents.
