FIT-RAG: Black-Box RAG with Factual Information and Token Reduction

no code implementations • 21 Mar 2024 • YUREN MAO, XueMei Dong, Wenyi Xu, Yunjun Gao, Bin Wei, Ying Zhang

Simply concatenating all the retrieved documents brings large amounts of unnecessary tokens for LLMs, which degenerates the efficiency of black-box RAG.

Open-Domain Question Answering Retrieval +2