Search Results for author: Andreea Iuliana Ionescu

Found 1 papers, 0 papers with code

Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers

no code implementations14 Apr 2024 Diana-Nicoleta Grigore, Mariana-Iuliana Georgescu, Jon Alvarez Justo, Tor Johansen, Andreea Iuliana Ionescu, Radu Tudor Ionescu

Few-shot knowledge distillation recently emerged as a viable approach to harness the knowledge of large-scale pre-trained models, using limited data and computational resources.

Knowledge Distillation

Cannot find the paper you are looking for? You can Submit a new open access paper.