Search Results for author:
Found 10 papers, 2 papers with code
Semi-Supervised Lifelong Language Learning
In this paper, we explore a novel setting, semi-supervised lifelong language learning (SSLL), where a model learns sequentially arriving language tasks with both labeled and unlabeled data.
Hard Gate Knowledge Distillation -- Leverage Calibration for Robust and Reliable Language Model
The question is answered in our work with the concept of model calibration; we view a teacher model not only as a source of knowledge but also as a gauge to detect miscalibration of a student.
Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation
Furthermore, inspired by recent work in bridging label smoothing and knowledge distillation, our work utilizes self-knowledge as a prior label distribution in softening target labels, and presents theoretical support for the regularization effect by knowledge distillation and the dynamic smoothing parameter.
Improving Meta-learning for Low-resource Text Classification and Generation via Memory Imitation
Building models of natural language processing (NLP) is challenging in low-resource scenarios where only limited data are available.
Adaptive Label Smoothing with Self-Knowledge
Overconfidence has been shown to impair generalization and calibration of a neural network.
Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalization
A common approach is to map a given sentence to content representation that is free of style, and the content representation is fed to a decoder with a target style.
Learning from My Friends: Few-Shot Personalized Conversation Systems via Social Networks
The task requires models to generate personalized responses for a speaker given a few conversations from the speaker and a social network.
Response-Anticipated Memory for On-Demand Knowledge Integration in Response Generation
In previous work, the external document is utilized by (1) creating a context-aware document memory that integrates information from the document and the conversational context, and then (2) generating responses referring to the memory.
Restore from Restored: Single Image Denoising with Pseudo Clean Image
However, these methods have limitations in using internal information available in a given test image.
Multi-lane Detection Using Instance Segmentation and Attentive Voting
Among these solutions, lane detection is one of the vital driver-assist features that play a crucial role in the decision-making process of the autonomous vehicle.
