Search Results for author:
Found 79 papers, 22 papers with code
Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization
It thereby takes advantage of prior copying distributions and, at each time step, explicitly encourages the model to copy the input word that is relevant to the previously copied one.
Ranked #11 on
Abstractive Text Summarization
on CNN / Daily Mail
(using extra training data)
EASE: Extractive-Abstractive Summarization End-to-End using the Information Bottleneck Principle
To achieve the best of both worlds, we propose EASE, an extractive-abstractive framework that generates concise abstractive summaries that can be traced back to an extractive summary.
You Don’t Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakers’ Private Personas
To this end, we propose effective defense objectives to protect persona leakage from hidden states.
DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Sampling
Text-to-3D scene generation holds immense potential for the gaming, film, and architecture sectors.
LITE: Modeling Environmental Ecosystems with Multimodal Large Language Models
To address these issues, we propose LITE -- a multimodal large language model for environmental ecosystems modeling.
SDPL: Shifting-Dense Partition Learning for UAV-View Geo-Localization
Cross-view geo-localization aims to match images of the same target from different platforms, e. g., drone and satellite.
FedCQA: Answering Complex Queries on Multi-Source Knowledge Graphs via Federated Learning
An entity can be involved in various knowledge graphs and reasoning on multiple KGs and answering complex queries on multi-source KGs is important in discovering knowledge cross graphs.
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
We introduce Generalized Instruction Tuning (called GLAN), a general and scalable method for instruction tuning of Large Language Models (LLMs).
FDNet: Frequency Domain Denoising Network For Cell Segmentation in Astrocytes Derived From Induced Pluripotent Stem Cells
Moreover, a novel frequency domain denoising network, named FDNet, is proposed for astrocyte segmentation.
Towards Optimal Adversarial Robust Q-learning with Bellman Infinity-error
Establishing robust policies is essential to counter attacks or disturbances affecting deep reinforcement learning (DRL) agents.
FM3Q: Factorized Multi-Agent MiniMax Q-Learning for Two-Team Zero-Sum Markov Game
Based on it, we present a novel multi-agent reinforcement learning framework, Factorized Multi-Agent MiniMax Q-Learning (FM3Q), which can factorize the joint minimax Q function into individual ones and iteratively solve for the IGMM-satisfied minimax Q functions for 2t0sMGs.
General Method for Solving Four Types of SAT Problems
We experimentally verify that this paradigm can prune the unnecessary search space to find the optimal Boolean assignments for the problem.
2D-Guided 3D Gaussian Segmentation
Recently, 3D Gaussian, as an explicit 3D representation method, has demonstrated strong competitiveness over NeRF (Neural Radiance Fields) in terms of expressing complex scenes and training duration.
Privacy-Preserved Neural Graph Databases
Neural graph databases (NGDBs) have emerged as a powerful paradigm that combines the strengths of graph databases (GDBs) and neural networks to enable efficient storage, retrieval, and analysis of graph-structured data which can be adaptively trained with LLMs.
A Framework of Full-Process Generation Design for Park Green Spaces Based on Remote Sensing Segmentation-GAN-Diffusion
There are two research gaps in the current research: 1) Most studies only focus on the relationship between design elements and pay little attention to the external information of the site; 2) GAN and other traditional generative algorithms generate results with low resolution and insufficient details.
P-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models
Lastly, P-Bench performs existing privacy attacks on LMs with pre-defined privacy objectives as the empirical evaluation results.
Tuna: Instruction Tuning using Feedback from Large Language Models
Furthermore, we apply probabilistic ranking and contextual ranking sequentially to the instruction-tuned LLM.
Privacy in Large Language Models: Attacks, Defenses and Future Directions
The advancement of large language models (LLMs) has significantly enhanced the ability to effectively tackle various downstream NLP tasks and unify these tasks into generative pipelines.
AFLOW: Developing Adversarial Examples under Extremely Noise-limited Settings
Extensive studies have demonstrated that deep neural networks (DNNs) are vulnerable to adversarial attacks.
Model Inversion Attacks on Homogeneous and Heterogeneous Graph Neural Networks
Inspired by this, we propose a novel model inversion attack method on HomoGNNs and HeteGNNs, namely HomoGMI and HeteGMI.
Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks
To our knowledge, only one method has been proposed to learn a sequence of mixed tasks.
Boosting Continuous Control with Consistency Policy
By establishing a mapping from the reverse diffusion trajectories to the desired policy, we simultaneously address the issues of time efficiency and inaccurate guidance when updating diffusion model-based policy with the learned Q-function.
CgT-GAN: CLIP-guided Text GAN for Image Captioning
Particularly, we use adversarial training to teach CgT-GAN to mimic the phrases of an external text corpus and CLIP-based reward to provide semantic guidance.
Nonconvex optimization for optimum retrieval of the transmission matrix of a multimode fiber
Through numerical evaluations, it shows that the nonconvex method offers an optimum efficiency of focusing with less running time or sampling rate.
Multi-modal Learning based Prediction for Disease
From the dataset, we quantitatively analyze and select clinical metadata that most contribute to NAFLD prediction.
Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentence
In this work, we further investigate the information leakage issue and propose a generative embedding inversion attack (GEIA) that aims to reconstruct input sequences based only on their sentence embeddings.
Multi-step Jailbreaking Privacy Attacks on ChatGPT
With the rapid progress of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts.
Fixed Design Analysis of Regularization-Based Continual Learning
We consider a continual learning (CL) problem with two linear regression tasks in the fixed design setting, where the feature vectors are assumed fixed and the labels are assumed to be random variables.
TKN: Transformer-based Keypoint Prediction Network For Real-time Video Prediction
Video prediction is a complex time-series forecasting task with great potential in many use cases.
Cross-domain Random Pre-training with Prototypes for Reinforcement Learning
CRPTpro significantly outperforms the next best Proto-RL(C) on 11/12 cross-domain downstream tasks with only 54\% wall-clock pre-training time, exhibiting state-of-the-art pre-training performance with greatly improved pre-training efficiency.
STRUDEL: Structured Dialogue Summarization for Dialogue Comprehension
Abstractive dialogue summarization has long been viewed as an important standalone task in natural language processing, but no previous work has explored the possibility of whether abstractive dialogue summarization can also be used as a means to boost an NLP system's performance on other important dialogue comprehension tasks.
Improving Faithfulness of Abstractive Summarization by Controlling Confounding Effect of Irrelevant Sentences
Lack of factual correctness is an issue that still plagues state-of-the-art summarization systems despite their impressive progress on generating seemingly fluent summaries.
DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans
In this work, we propose a Deeply supervIsed knowledGE tranSfer neTwork (DIGEST), which achieves accurate brain tumor segmentation under different modality-missing scenarios.
ED-FAITH: Evaluating Dialogue Summarization on Faithfulness
Abstractive summarization models typically generate content unfaithful to the input, thus highlighting the significance of evaluating the faithfulness of generated summaries.
Prompt-driven efficient Open-set Semi-supervised Learning
In this paper, we propose a prompt-driven efficient OSSL framework, called OpenPrompt, which can propagate class information from labeled to unlabeled data with only a small number of trainable parameters.
Domain Adaptive Nuclei Instance Segmentation and Classification via Category-aware Feature Alignment and Pseudo-labelling
In this work, we propose a novel deep neural network, namely Category-Aware feature alignment and Pseudo-Labelling Network (CAPL-Net) for UDA nuclei instance segmentation and classification.
CoNSoLe: Convex Neural Symbolic Learning
In the first step of searching for right symbols, we convexify the deep Q-learning.
You Don't Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakers' Private Personas
To this end, we propose effective defense objectives to protect persona leakage from hidden states.
A Roadmap for Big Model
With the rapid development of deep learning, training Big Models (BMs) for multiple downstream tasks becomes a popular paradigm.
Load-balanced Gather-scatter Patterns for Sparse Deep Neural Networks
Our experiments show that GS patterns consistently make better trade-offs between accuracy and computation efficiency compared to conventional structured sparse patterns.
CONFIT: Toward Faithful Dialogue Summarization with Linguistically-Informed Contrastive Fine-tuning
Using human evaluation and automatic faithfulness metrics, we show that our model significantly reduces all kinds of factual errors on the dialogue summarization, SAMSum corpus.
AnswerSumm: A Manually-Curated Dataset and Pipeline for Answer Summarization
One goal of answer summarization is to produce a summary that reflects the range of answer perspectives.
The Powerful Use of AI in the Energy Sector: Intelligent Forecasting
To meet society requirements, this paper proposes a methodology to develop, deploy, and evaluate AI systems in the energy sector by: (1) understanding the power system measurements with physics, (2) designing AI algorithms to forecast the need, (3) developing robust and accountable AI methods, and (4) creating reliable measures to evaluate the performance of the AI model.
ABCP: Automatic Block-wise and Channel-wise Network Pruning via Joint Search
Compared with the traditional rule-based pruning method, this pipeline saves human labor and achieves a higher compression ratio with lower accuracy loss.
Adversarial twin neural networks: maximizing physics recovery for physical system
Thus, we propose (1) sparsity regularization for the physical model and (2) physical superiority over the virtual model.
WHAT TO DO IF SPARSE REPRESENTATION LEARNING FAILS UNEXPECTEDLY?
RISE is based on a complete analysis for the generalizability of data properties for physical systems.
The JDDC 2.0 Corpus: A Large-Scale Multimodal Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Service
We present the solutions of top-5 teams participating in the JDDC multimodal dialogue challenge based on this dataset, which provides valuable insights for further researches on the multimodal dialogue task.
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries
Current pre-trained models applied to summarization are prone to factual inconsistencies which either misrepresent the source text or introduce extraneous information.
Blind Image Quality Assessment for MRI with A Deep Three-dimensional content-adaptive Hyper-Network
However, the performance of these methods is limited due to the utilization of simple content-non-adaptive network parameters and the waste of the important 3D spatial information of the medical images.
Mixed Cross Entropy Loss for Neural Machine Translation
In neural machine translation, cross entropy (CE) is the standard loss function in two training methods of auto-regressive models, i. e., teacher forcing and scheduled sampling.
Syntax-augmented Multilingual BERT for Cross-lingual Transfer
In recent years, we have seen a colossal effort in pre-training multilingual text encoders using large-scale corpora in many languages to facilitate cross-lingual transfer learning.
ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Mining
While online conversations can cover a vast amount of information in many different formats, abstractive text summarization has primarily focused on modeling solely news articles.
Differentially Private Federated Knowledge Graphs Embedding
However, for multiple cross-domain knowledge graphs, state-of-the-art embedding models cannot make full use of the data from different knowledge domains while preserving the privacy of exchanged data.
EASE: Extractive-Abstractive Summarization with Explanations
Current abstractive summarization systems outperform their extractive counterparts, but their widespread adoption is inhibited by the inherent lack of interpretability.
Lifelong Learning with Sketched Structural Regularization
In practice and due to computational constraints, most SR methods crudely approximate the importance matrix by its diagonal.
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce
K-PLUG achieves new state-of-the-art results on a suite of domain-specific NLP tasks, including product knowledge base completion, abstractive product summarization, and multi-turn dialogue, significantly outperforms baselines across the board, which demonstrates that the proposed method effectively learns a diverse set of domain-specific knowledge for both language understanding and generation tasks.
K-PLUG: KNOWLEDGE-INJECTED PRE-TRAINED LANGUAGE MODEL FOR NATURAL LANGUAGE UNDERSTANDING AND GENERATION
K-PLUG achieves new state-of-the-art results on a suite of domain-specific NLP tasks, including product knowledge base completion, abstractive product summarization, and multi-turn dialogue, significantly outperforms baselines across the board, which demonstrates that the proposed method effectively learns a diverse set of domain-specific knowledge for both language understanding and generation tasks.
Multimodal Sentence Summarization via Multimodal Selective Encoding
Thus, we propose a multimodal selective gate network that considers reciprocal relationships between textual and multi-level visual features, including global image descriptor, activation grids, and object proposals, to select highlights of the event when encoding the source sentence.
On the Faithfulness for E-commerce Product Summarization
In this work, we present a model to generate e-commerce product summaries.
Dynamic radiomics: a new methodology to extract quantitative time-related features from tomographic images
The feature extraction methods of radiomics are mainly based on static tomographic images at a certain moment, while the occurrence and development of disease is a dynamic process that cannot be fully reflected by only static characteristics.
Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation
Models pretrained with self-supervised objectives on large text corpora achieve state-of-the-art performance on English text summarization tasks.
Conversational Semantic Parsing
In this paper, we propose a semantic representation for such task-oriented conversational systems that can represent concepts such as co-reference and context carryover, enabling comprehensive understanding of queries in a session.
Multimodal Joint Attribute Prediction and Value Extraction for E-commerce Product
We annotate a multimodal product attribute value dataset that contains 87, 194 instances, and the experimental results on this dataset demonstrate that explicitly modeling the relationship between attributes and values facilitates our method to establish the correspondence between them, and selectively utilizing visual product information is necessary for the task.
MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmark
Scaling semantic parsing models for task-oriented dialog systems to new languages is often expensive and time-consuming due to the lack of available datasets.
Self-Attention Guided Copy Mechanism for Abstractive Summarization
Copy module has been widely equipped in the recent abstractive summarization models, which facilitates the decoder to extract words from the source into the summary.
AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks
Inspired by the recent success of AutoML in deep compression, we introduce AutoML to GAN compression and develop an AutoGAN-Distiller (AGD) framework.
General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference
The resulting method offers a compelling solution for using large-scale pre-trained models at a fraction of the computational cost when multiple tasks are performed on the same text.
BiFNet: Bidirectional Fusion Network for Road Segmentation
Considering the bird's eye views(BEV) of the LiDAR remains the space structure in horizontal plane, this paper proposes a bidirectional fusion network(BiFNet) to fuse the image and BEV of the point cloud.
Multi-modal Datasets for Super-resolution
However, due to the variety of image degradation types in the real world, models trained on single-modal simulation datasets do not always have good robustness and generalization ability in different degradation scenarios.
Music-oriented Dance Video Synthesis with Pose Perceptual Loss
We present a learning-based approach with pose perceptual loss for automatic music video generation.
Predictive Multi-level Patient Representations from Electronic Health Records
Most related studies transform EHR data of a patient into a sequence of clinical events in temporal order and then use sequential models to learn patient representations for outcome prediction.
Emerging Cross-lingual Structure in Pretrained Language Models
We study the problem of multilingual masked language modeling, i. e. the training of a single model on concatenated text from multiple languages, and present a detailed study of several factors that influence why these models are so effective for cross-lingual transfer.
Learning Hierarchical Representations of Electronic Health Records for Clinical Outcome Prediction
Our model learns hierarchical representationsof event sequences, to adaptively distinguish between short-range and long-range events, and accurately capture coretemporal dependencies.
MSMO: Multimodal Summarization with Multimodal Output
In this paper, we propose a novel task, multimodal summarization with multimodal output (MSMO).
Ensure the Correctness of the Summary: Incorporate Entailment Knowledge into Abstractive Sentence Summarization
In this paper, we investigate the sentence summarization task that produces a summary from a source sentence.
Ranked #7 on
Text Summarization
on DUC 2004 Task 1
Multilingual Seq2seq Training with Similarity Loss for Cross-Lingual Document Classification
In this paper we continue experiments where neural machine translation training is used to produce joint cross-lingual fixed-dimensional sentence embeddings.
Cross-Lingual Document Classification
Cross-Lingual Transfer
+7
Multi-modal Summarization for Asynchronous Collection of Text, Image, Audio and Video
In this work, we propose an extractive Multi-modal Summarization (MMS) method which can automatically generate a textual summary given a set of documents, images, audios and videos related to a specific topic.
Automatic Speech Recognition (ASR)
Document Summarization
+1
