Search Results for author:
Found 1 papers, 0 papers with code
FlashDecoding++: Faster Large Language Model Inference on GPUs
A single and static dataflow may lead to a 50. 25% performance loss for GEMMs of different shapes in LLM inference.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
