Search Results for author: Marcos Piau

Found 3 papers, 1 papers with code

The Chronicles of RAG: The Retriever, the Chunk and the Generator

no code implementations15 Jan 2024 Paulo Finardi, Leonardo Avila, Rodrigo Castaldoni, Pedro Gengo, Celio Larcher, Marcos Piau, Pablo Costa, Vinicius Caridá

Retrieval Augmented Generation (RAG) has become one of the most popular paradigms for enabling LLMs to access external data, and also as a mechanism for grounding to mitigate against hallucinations.

Computational Efficiency Representation Learning +2

Cabrita: closing the gap for foreign languages

no code implementations23 Aug 2023 Celio Larcher, Marcos Piau, Paulo Finardi, Pedro Gengo, Piero Esposito, Vinicius Caridá

The main solution to overcome the cost challenge is to rely on available pre-trained models, which, despite recent advancements such as the LLaMA and LLaMA-2 models, still demonstrate inefficiency for certain specific domain problems or prove ineffective in scenarios involving conversational memory resources, given the large number of tokens required to represent text.

Few-Shot Learning

PTT5: Pretraining and validating the T5 model on Brazilian Portuguese data

3 code implementations20 Aug 2020 Diedre Carmo, Marcos Piau, Israel Campiotti, Rodrigo Nogueira, Roberto Lotufo

In natural language processing (NLP), there is a need for more resources in Portuguese, since much of the data used in the state-of-the-art research is in other languages.

Cannot find the paper you are looking for? You can Submit a new open access paper.