Search Results for author:
Found 2 papers, 2 papers with code
Leveraging Speculative Sampling and KV-Cache Optimizations Together for Generative AI using OpenVINO
Inference optimizations are critical for improving user experience and reducing infrastructure costs and power consumption.
Neural Network Compression Framework for fast model inference
In this work we present a new framework for neural networks compression with fine-tuning, which we called Neural Network Compression Framework (NNCF).
Ranked #3 on
Binarization
on ImageNet
Cannot find the paper you are looking for? You can
Submit a new open access paper.
