Search Results for author:
Found 2 papers, 1 papers with code
MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining
Here, we introduce MosaicBERT, a BERT-style encoder architecture and training recipe that is empirically optimized for fast pretraining.
LIMIT: Less Is More for Instruction Tuning Across Evaluation Paradigms
We find that subsets of 1k-6k instruction finetuning samples are sufficient to achieve good performance on both (1) traditional NLP benchmarks and (2) model-based evaluation.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
