Search Results for author:
Found 4 papers, 1 papers with code
Towards Structured Dynamic Sparse Pre-Training of BERT
Identifying algorithms for computational efficient unsupervised training of large language models is an important and active area of research.
GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures
Attention based language models have become a critical component in state-of-the-art natural language processing systems.
Improving Neural Network Training in Low Dimensional Random Bases
Stochastic Gradient Descent (SGD) has proven to be remarkably effective in optimizing deep neural networks that employ ever-larger numbers of parameters.
Probabilistic supervised learning
Predictive modelling and supervised learning are central to modern data science.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
