Search Results for author:
Found 5 papers, 4 papers with code
Tandem Transformers for Inference Efficient LLMs
On the PaLM2 pretraining dataset, a tandem of PaLM2-Bison and PaLM2-Gecko demonstrates a 3. 3% improvement in next-token prediction accuracy over a standalone PaLM2-Gecko, offering a 1. 16x speedup compared to a PaLM2-Otter model with comparable downstream performance.
Domain Aligned Prefix Averaging for Domain Generalization in Abstractive Summarization
These source prefixes generate summaries for a small number of target domain documents.
The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing
In this work, we analyse the role of output vocabulary for text-to-text (T2T) models on the task of SPARQL semantic parsing.
GETT-QA: Graph Embedding based T2T Transformer for Knowledge Graph Question Answering
To further improve the results, we instruct the model to produce a truncated version of the KG embedding for each entity.
Modern Baselines for SPARQL Semantic Parsing
In this work, we focus on the task of generating SPARQL queries from natural language questions, which can then be executed on Knowledge Graphs (KGs).
