1 code implementation • 12 Dec 2023 • Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Jeff Huang, Chuyue Sun, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark Barrett, Ying Sheng
SGLang is designed for the efficient programming of LLMs and incorporates primitives for common LLM programming patterns.
1 code implementation • 26 Oct 2023 • Chuyue Sun, Ying Sheng, Oded Padon, Clark Barrett
The use of large language models for code generation is a rapidly growing trend in software development.
1 code implementation • 31 May 2023 • Joel Kuepper, Andres Erbsen, Jason Gross, Owen Conoly, Chuyue Sun, Samuel Tian, David Wu, Adam Chlipala, Chitchanok Chuengsatiansup, Daniel Genkin, Markus Wagner, Yuval Yarom
Manual engineering of high-performance implementations typically consumes many resources and requires in-depth knowledge of the hardware.
1 code implementation • 19 Nov 2022 • Joel Kuepper, Andres Erbsen, Jason Gross, Owen Conoly, Chuyue Sun, Samuel Tian, David Wu, Adam Chlipala, Chitchanok Chuengsatiansup, Daniel Genkin, Markus Wagner, Yuval Yarom
Most software domains rely on compilers to translate high-level code to multiple different machine languages, with performance not too much worse than what developers would have the patience to write directly in assembly language.