Search Results for author:
Found 3 papers, 1 papers with code
Keyformer: KV Cache Reduction through Key Tokens Selection for Efficient Generative Inference
This approach effectively reduces both the KV cache size and memory bandwidth usage without compromising model accuracy.
Fast Neural Architecture Construction using EnvelopeNets
Fast Neural Architecture Construction (NAC) is a method to construct deep network architectures by pruning and expansion of a base network.
AMLA: an AutoML frAmework for Neural Network Design
Its key architectural features are the decoupling of the network generation from the network evaluation, support for network instrumentation, open model specification and a microservices based architecture for deployment at scale.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
