Efficiently Programming Large Language Models using SGLang

1 code implementation • 12 Dec 2023 • Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Jeff Huang, Chuyue Sun, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark Barrett, Ying Sheng

SGLang is designed for the efficient programming of LLMs and incorporates primitives for common LLM programming patterns.

Clover: Closed-Loop Verifiable Code Generation

1 code implementation • 26 Oct 2023 • Chuyue Sun, Ying Sheng, Oded Padon, Clark Barrett

The use of large language models for code generation is a rapidly growing trend in software development.

Code Generation

CryptOpt: Automatic Optimization of Straightline Code

1 code implementation • 31 May 2023 • Joel Kuepper, Andres Erbsen, Jason Gross, Owen Conoly, Chuyue Sun, Samuel Tian, David Wu, Adam Chlipala, Chitchanok Chuengsatiansup, Daniel Genkin, Markus Wagner, Yuval Yarom

Manual engineering of high-performance implementations typically consumes many resources and requires in-depth knowledge of the hardware.

CryptOpt: Verified Compilation with Randomized Program Search for Cryptographic Primitives (full version)

1 code implementation • 19 Nov 2022 • Joel Kuepper, Andres Erbsen, Jason Gross, Owen Conoly, Chuyue Sun, Samuel Tian, David Wu, Adam Chlipala, Chitchanok Chuengsatiansup, Daniel Genkin, Markus Wagner, Yuval Yarom

Most software domains rely on compilers to translate high-level code to multiple different machine languages, with performance not too much worse than what developers would have the patience to write directly in assembly language.

Benchmarking C++ code