Search Results for author:
Found 7 papers, 4 papers with code
TWIN: TWo-stage Interest Network for Lifelong User Behavior Modeling in CTR Prediction at Kuaishou
And for the user-item cross features, we compress each into a one-dimentional bias term in the attention score calculation to save the computational cost.
CodeEditor: Learning to Edit Source Code with Pre-trained Models
Pre-trained models are first pre-trained with pre-training tasks and fine-tuned with the code editing task.
Contextual Representation Learning beyond Masked Language Modeling
How do masked language models (MLMs) such as BERT learn contextual representations?
A Survey on Green Deep Learning
In recent years, larger and deeper models are springing up and continuously pushing state-of-the-art (SOTA) results across various fields like natural language processing (NLP) and computer vision (CV).
TUTA: Tree-based Transformers for Generally Structured Table Pre-training
First, we devise a unified tree-based structure, called a bi-dimensional coordinate tree, to describe both the spatial and hierarchical information of generally structured tables.
Code Generation as a Dual Task of Code Summarization
Code summarization (CS) and code generation (CG) are two crucial tasks in the field of automatic software development.
A Self-Attentional Neural Architecture for Code Completion with Multi-Task Learning
To enable the knowledge sharing between related tasks, we creatively propose a Multi-Task Learning (MTL) framework to learn two related tasks in code completion jointly.
