LLoCO: Learning Long Contexts Offline

2 code implementations • 11 Apr 2024 • Sijun Tan, Xiuyu Li, Shishir Patil, Ziyang Wu, Tianjun Zhang, Kurt Keutzer, Joseph E. Gonzalez, Raluca Ada Popa

We introduce LLoCO, a technique that combines context compression, retrieval, and parameter-efficient finetuning using LoRA.

4k In-Context Learning +1

Least Square Calibration for Peer Reviews

1 code implementation • NeurIPS 2021 • Sijun Tan, Jibang Wu, Xiaohui Bei, Haifeng Xu

Peer review systems such as conference paper review often suffer from the issue of miscalibration.

Least Square Calibration for Peer Review

1 code implementation • 25 Oct 2021 • Sijun Tan, Jibang Wu, Xiaohui Bei, Haifeng Xu

Peer review systems such as conference paper review often suffer from the issue of miscalibration.

Morse-STF: Improved Protocols for Privacy-Preserving Machine Learning

no code implementations • 24 Sep 2021 • Qizhi Zhang, Sijun Tan, Lichun Li, Yun Zhao, Dong Yin, Shan Yin

Finally, we introduce Morse-STF, an end-to-end privacy-preserving system for machine learning training that leverages all these improved protocols.

BIG-bench Machine Learning Privacy Preserving

CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU

1 code implementation • 22 Apr 2021 • Sijun Tan, Brian Knott, Yuan Tian, David J. Wu

We then identify a sequence of "GPU-friendly" cryptographic protocols to enable privacy-preserving evaluation of both linear and non-linear operations on the GPU.

BIG-bench Machine Learning Privacy Preserving +1