Search Results for author:
Found 6 papers, 2 papers with code
ITEm: Unsupervised Image-Text Embedding Learning for eCommerce
How to teach a model to learn embedding from different modalities without neglecting information from the less dominant modality is challenging.
Multi-armed bandits for resource efficient, online optimization of language model pre-training: the use case of dynamic masking
We propose a multi-armed bandit framework for the sequential selection of TLM pre-training hyperparameters, aimed at optimizing language model performance, in a resource efficient manner.
Towards Reinforcement Learning for Pivot-based Neural Machine Translation with Non-autoregressive Transformer
Pivot-based neural machine translation (NMT) is commonly used in low-resource setups, especially for translation between non-English language pairs.
Integrated Training for Sequence-to-Sequence Models Using Non-Autoregressive Transformer
Complex natural language applications such as speech translation or pivot translation traditionally rely on cascaded models.
Deploying a BERT-based Query-Title Relevance Classifier in a Production System: a View from the Trenches
We successfully optimize a Query-Title Relevance (QTR) classifier for deployment via a compact model, which we name BERT Bidirectional Long Short-Term Memory (BertBiLSTM).
Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent
Stochastic Gradient Descent (SGD) methods are prominent for training machine learning and deep learning models.
