Search Results for author:
Found 116 papers, 78 papers with code
Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach
In recent years, pre-trained language models (PLMs) have been shown to capture factual knowledge from massive texts, which encourages the proposal of PLM-based knowledge graph completion (KGC) models.
UPER: Boosting Multi-Document Summarization with an Unsupervised Prompt-based Extractor
However, the trained scoring model is prone to under-fitting for low-resource settings, as it relies on the training data.
How Can Cross-lingual Knowledge Contribute Better to Fine-Grained Entity Typing?
Cross-lingual Entity Typing (CLET) aims at improving the quality of entity type prediction by transferring semantic knowledge learned from rich-resourced languages to low-resourced languages.
HOSMEL: A Hot-Swappable Modularized Entity Linking Toolkit for Chinese
We investigate the usage of entity linking (EL)in downstream tasks and present the first modularized EL toolkit for easy task adaptation.
DocEE: A Large-Scale and Fine-grained Benchmark for Document-level Event Extraction
Event extraction aims to identify an event and then extract the arguments participating in the event.
Transferable and Efficient Non-Factual Content Detection via Probe Training with Offline Consistency Checking
Detecting non-factual content is a longstanding goal to increase the trustworthiness of large language models (LLMs) generations.
Evaluating Generative Language Models in Information Extraction as Subjective Question Correction
(1) The imprecision of existing evaluation metrics that struggle to effectively gauge semantic consistency between model outputs and ground truth, and (2) The inherent incompleteness of evaluation benchmarks, primarily due to restrictive human annotation schemas, resulting in underestimated LLM performances.
Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models
However, knowledge in the document may conflict with the memory of LLMs due to outdated or incorrect knowledge in the LLMs' parameters.
A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generation
Recently, knowledge-grounded dialogue generation models, that intentionally invoke external knowledge resources to more informative responses, are also proven to be effective in reducing hallucination.
TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios
We introduce TableLLM, a robust large language model (LLM) with 13 billion parameters, purpose-built for proficiently handling tabular data manipulation tasks, whether they are embedded within documents or spreadsheets, catering to real-world office scenarios.
Reverse That Number! Decoding Order Matters in Arithmetic Learning
Recent advancements in pretraining have demonstrated that modern Large Language Models (LLMs) possess the capability to effectively learn arithmetic operations.
Event-level Knowledge Editing
However, natural knowledge updates in the real world come from the occurrences of new events rather than direct changes in factual triplets.
EmoBench: Evaluating the Emotional Intelligence of Large Language Models
Recent advances in Large Language Models (LLMs) have highlighted the need for robust, comprehensive, and challenging benchmarks.
CogCoM: Train Large Vision-Language Models Diving into Details through Chain of Manipulations
Vision-Language Models (VLMs) have demonstrated their widespread viability thanks to extensive training in aligning visual instructions to answers.
KB-Plugin: A Plug-and-play Framework for Large Language Models to Induce Programs over Low-resourced Knowledge Bases
Secondly, KB-Plugin utilizes abundant annotated data from a rich-resourced KB to train another pluggable module, namely PI plugin, which can help the LLM extract question-relevant schema information from the schema plugin of any KB and utilize this information to induce programs over this KB.
LongAlign: A Recipe for Long Context Alignment of Large Language Models
Extending large language models to effectively handle long contexts requires instruction fine-tuning on input sequences of similar length.
Probing Structured Semantics Understanding and Generation of Language Models via Question Answering
Extensive experiments with models of different sizes and in different formal languages show that today's state-of-the-art LLMs' understanding of the logical forms can approach human level overall, but there still are plenty of room in generating correct logical forms, which suggest that it is more effective to use LLMs to generate more natural language training data to reinforce a small model than directly answering questions with LLMs.
CogAgent: A Visual Language Model for GUI Agents
People are spending an enormous amount of time on digital devices through graphical user interfaces (GUIs), e. g., computer or smartphone screens.
Ranked #14 on
Visual Question Answering
on MM-Vet
Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex Questions
During reasoning, for leaf nodes, LLMs choose a more confident answer from Closed-book QA that employs parametric knowledge and Open-book QA that employs retrieved external knowledge, thus eliminating the negative retrieval problem.
MAVEN-Arg: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation
Understanding events in texts is a core objective of natural language understanding, which requires detecting event occurrences, extracting event arguments, and analyzing inter-event relationships.
When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks
In this paper, we find that ICL falls short of handling specification-heavy tasks, which are tasks with complicated and extensive task specifications, requiring several hours for ordinary humans to master, such as traditional information extraction tasks.
WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models
To mitigate the potential misuse of large language models (LLMs), recent research has developed watermarking algorithms, which restrict the generation process to leave an invisible trace for watermark detection.
CogVLM: Visual Expert for Pretrained Language Models
We introduce CogVLM, a powerful open-source visual language foundation model.
Ranked #4 on
Visual Question Answering (VQA)
on InfiMM-Eval
Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environment
Open Information Extraction (OIE) aims to extract objective structured knowledge from natural texts, which has attracted growing attention to build dedicated models with human experience.
BiLL-VTG: Bridging Large Language Models and Lightweight Visual Tools for Video-based Texts Generation
Building models that generate textual responses to user instructions for videos is a practical and challenging topic, as it requires both vision understanding and knowledge reasoning.
Exploring the Cognitive Knowledge Structure of Large Language Models: An Educational Diagnostic Assessment Approach
We aim to reveal the knowledge structures of LLMs and gain insights of their cognitive capabilities.
T$^3$Bench: Benchmarking Current Progress in Text-to-3D Generation
Recent methods in text-to-3D leverage powerful pretrained diffusion models to optimize NeRF.
OmniEvent: A Comprehensive, Fair, and Easy-to-Use Toolkit for Event Understanding
Event understanding aims at understanding the content and relationship of events within texts, which covers multiple complicated information extraction tasks: event detection, event argument extraction, and event relation extraction.
ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation
Vision-language pre-training (VLP) methods are blossoming recently, and its crucial goal is to jointly learn visual and textual features via a transformer-based architecture, demonstrating promising improvements on a variety of vision-language tasks.
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
In this paper, we introduce LongBench, the first bilingual, multi-task benchmark for long context understanding, enabling a more rigorous evaluation of long context understanding.
LittleMu: Deploying an Online Virtual Teaching Assistant via Heterogeneous Sources Integration and Chain of Teach Prompts
However, few MOOC platforms are providing human or virtual teaching assistants to support learning for massive online students due to the complexity of real-world online education scenarios and the lack of training data.
KoRC: Knowledge oriented Reading Comprehension Benchmark for Deep Text Understanding
However, these benchmarks have encountered two major limitations.
VisKoP: Visual Knowledge oriented Programming for Interactive Knowledge Base Question Answering
We present Visual Knowledge oriented Programming platform (VisKoP), a knowledge base question answering (KBQA) system that integrates human into the loop to edit and debug the knowledge base (KB) queries.
FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base Question Answering
The generalization problem on KBQA has drawn considerable attention.
KoLA: Carefully Benchmarking World Knowledge of Large Language Models
The unprecedented performance of large language models (LLMs) necessitates improvements in evaluations.
The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation
In this paper, we check the reliability of EE evaluations and identify three major pitfalls: (1) The data preprocessing discrepancy makes the evaluation results on the same dataset not directly comparable, but the data preprocessing details are not widely noted and specified in papers.
Learn to Not Link: Exploring NIL Prediction in Entity Linking
We conduct a series of experiments with the widely used bi-encoder and cross-encoder entity linking models, results show that both types of NIL mentions in training data have a significant influence on the accuracy of NIL prediction.
Reasoning over Hierarchical Question Decomposition Tree for Explainable Question Answering
To facilitate reasoning, we propose a novel two-stage XQA framework, Reasoning over Hierarchical Question Decomposition Tree (RoHT).
Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extraction
In this paper, we present the first benchmark that simulates the evaluation of open information extraction models in the real world, where the syntactic and expressive distributions under the same knowledge meaning may drift variously.
ChatLog: Recording and Analyzing ChatGPT Across Time
While there are abundant researches about evaluating ChatGPT on natural language understanding and generation tasks, few studies have investigated how ChatGPT's behavior changes over time.
MoocRadar: A Fine-grained and Multi-aspect Knowledge Repository for Improving Cognitive Student Modeling in MOOCs
Student modeling, the task of inferring a student's learning characteristics through their interactions with coursework, is a fundamental issue in intelligent education.
GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation
Despite the recent emergence of video captioning models, how to generate vivid, fine-grained video descriptions based on the background knowledge (i. e., long and informative commentary about the domain-specific scenes with appropriate reasoning) is still far from being solved, which however has great applications such as automatic sports narrative.
GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generation
We present GLM-Dialog, a large-scale language model (LLM) with 10B parameters capable of knowledge-grounded conversation in Chinese using a search engine to access the Internet knowledge.
Syntactically Robust Training on Partially-Observed Data for Open Information Extraction
In this paper, we propose a syntactically robust training framework that enables models to be trained on a syntactic-abundant distribution based on diverse paraphrase generation.
Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimization
QTO finds the optimal solution by a forward-backward propagation on the tree-like computation graph, i. e., query computation tree.
Ranked #1 on
Complex Query Answering
on NELL-995
MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction
It contains 103, 193 event coreference chains, 1, 216, 217 temporal relations, 57, 992 causal relations, and 15, 841 subevent relations, which is larger than existing datasets of all the ERE tasks by at least an order of magnitude.
Finding Skill Neurons in Pre-trained Transformer-based Language Models
Furthermore, we demonstrate the skill neurons are most likely generated in pre-training rather than fine-tuning by showing that the skill neurons found with prompt tuning are also crucial for other fine-tuning methods freezing neuron weights, such as the adapter-based tuning and BitFit.
A Survey of Knowledge Enhanced Pre-trained Language Models
We introduce appropriate taxonomies respectively for Natural Language Understanding (NLU) and Natural Language Generation (NLG) to highlight these two main tasks of NLP.
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models
We believe this is a critical bottleneck for realizing human-like cognition in PLMs.
EDUKG: a Heterogeneous Sustainable K-12 Educational Knowledge Graph
To tackle these issues, we propose EDUKG, a heterogeneous sustainable K-12 Educational Knowledge Graph.
Step out of KG: Knowledge Graph Completion via Knowledgeable Retrieval and Reading Comprehension
To alleviate this problem, we propose a new model based on information retrieval and reading comprehension, namely IR4KGC.
ConstGCN: Constrained Transmission-based Graph Convolutional Networks for Document-level Relation Extraction
Document-level relation extraction with graph neural networks faces a fundamental graph construction gap between training and inference - the golden graph structure only available during training, which causes that most methods adopt heuristic or syntactic rules to construct a prior graph as a pseudo proxy.
Unveiling the Black Box of PLMs with Semantic Anchors: Towards Interpretable Neural Semantic Parsing
The recent prevalence of pretrained language models (PLMs) has dramatically shifted the paradigm of semantic parsing, where the mapping from natural language utterances to structured logical forms is now formulated as a Seq2Seq task.
Information Extraction and Human-Robot Dialogue towards Real-life Tasks: A Baseline Study with the MobileCS Dataset
Recently, there have merged a class of task-oriented dialogue (TOD) datasets collected through Wizard-of-Oz simulated games.
Towards a General Pre-training Framework for Adaptive Learning in MOOCs
Adaptive learning aims to stimulate and meet the needs of individual learners, which requires sophisticated system-level coordination of diverse tasks, including modeling learning resources, estimating student states, and making personalized recommendations.
A Challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Systems
A challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Systems, Co-located with EMNLP2022 SereTOD Workshop.
GraphQ IR: Unifying the Semantic Parsing of Graph Query Languages with One Intermediate Representation
Subject to the huge semantic gap between natural and formal languages, neural semantic parsing is typically bottlenecked by its complexity of dealing with both input semantics and output syntax.
A Roadmap for Big Model
With the rapid development of deep learning, training Big Models (BMs) for multiple downstream tasks becomes a popular paradigm.
LEVEN: A Large-Scale Chinese Legal Event Detection Dataset
However, existing Legal Event Detection (LED) datasets only concern incomprehensive event types and have limited annotated data, which restricts the development of LED methods and their downstream applications.
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models
This necessitates a new branch of research focusing on the parameter-efficient adaptation of PLMs, dubbed as delta tuning in this paper.
Schema-Free Dependency Parsing via Sequence Generation
To remedy these drawbacks, we propose to achieve universal and schema-free Dependency Parsing (DP) via Sequence Generation (SG) DPSG by utilizing only the pre-trained language model (PLM) without any auxiliary structures or parsing algorithms.
Interactive Contrastive Learning for Self-supervised Entity Alignment
Self-supervised entity alignment (EA) aims to link equivalent entities across different knowledge graphs (KGs) without seed alignments.
SQUIRE: A Sequence-to-sequence Framework for Multi-hop Knowledge Graph Reasoning
Multi-hop knowledge graph (KG) reasoning has been widely studied in recent years to provide interpretable predictions on missing links with evidential paths.
CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark
We argue that for general-purpose language intelligence evaluation, the benchmark itself needs to be comprehensive and systematic.
Multimodal Entity Tagging with Multimodal Knowledge Base
We also develop a dataset for the problem using an existing MKB.
On Transferability of Prompt Tuning for Natural Language Processing
To explore whether we can improve PT via prompt transfer, we empirically investigate the transferability of soft prompts across different downstream tasks and PLMs in this work.
Exploring Universal Intrinsic Task Subspace via Prompt Tuning
In the experiments, we study diverse few-shot NLP tasks and surprisingly find that in a 250-dimensional subspace found with 100 tasks, by only tuning 250 free parameters, we can recover 97% and 83% of the full prompt tuning performance for 100 seen tasks (using different training data) and 20 unseen tasks, respectively, showing great generalization ability of the found intrinsic task subspace.
Program Transfer for Answering Complex Questions over Knowledge Bases
In this paper, we propose the approach of program transfer, which aims to leverage the valuable program annotations on the rich-resourced KBs as external supervision signals to aid program induction for the low-resourced KBs that lack program annotations.
Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation
In this paper, we propose a heterogeneous knowledge language model (\textbf{HKLM}), a unified pre-trained language model (PLM) for all forms of text, including unstructured text, semi-structured text, and well-structured text.
Prompt-Learning for Fine-Grained Entity Typing
In this work, we investigate the application of prompt-learning on fine-grained entity typing in fully supervised, few-shot and zero-shot scenarios.
Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification
Tuning pre-trained language models (PLMs) with task-specific prompts has been a promising approach for text classification.
Are Missing Links Predictable? An Inferential Benchmark for Knowledge Graph Completion
We present InferWiki, a Knowledge Graph Completion (KGC) dataset that improves upon existing benchmarks in inferential ability, assumptions, and patterns.
Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition
Few-shot Named Entity Recognition (NER) exploits only a handful of annotations to identify and classify named entity mentions.
TWAG: A Topic-Guided Wikipedia Abstract Generator
Wikipedia abstract generation aims to distill a Wikipedia abstract from web sources and has met significant success by adopting multi-document summarization techniques.
Interpretable and Low-Resource Entity Matching via Decoupling Feature Learning from Decision Making
Using a set of comparison features and a limited amount of annotated data, KAT Induction learns an efficient decision tree that can be interpreted by generating entity matching rules whose structure is advocated by domain experts.
CLEVE: Contrastive Pre-training for Event Extraction
Event extraction (EE) has considerably benefited from pre-trained language models (PLMs) by fine-tuning.
TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graph
Multi-hop Question Answering (QA) is a challenging task because it requires precise reasoning with entity relations at every step towards the answer.
Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability
However, we find in experiments that many paths given by these models are actually unreasonable, while little works have been done on interpretability evaluation for them.
Neural Gibbs Sampling for Joint Event Argument Extraction
Existing EAE methods either extract each event argument roles independently or sequentially, which cannot adequately model the joint probability distribution among event arguments and their roles.
ExpanRL: Hierarchical Reinforcement Learning for Course Concept Expansion in MOOCs
Within the prosperity of Massive Open Online Courses (MOOCs), the education applications that automatically provide extracurricular knowledge for MOOC users become rising research topics.
Hierarchical Reinforcement Learning
reinforcement-learning
+1
CPM: A Large-scale Generative Chinese Pre-trained Language Model
However, applying GPT-3 to address Chinese NLP tasks is still challenging, as the training corpus of GPT-3 is primarily English, and the parameters are not publicly available.
Exploring and Evaluating Attributes, Values, and Structures for Entity Alignment
GNN-based EA methods present promising performances by modeling the KG structure defined by relation triples.
Dynamic Anticipation and Completion for Multi-Hop Reasoning over Sparse Knowledge Graph
On the one hand, sparse KGs contain less information, which makes it difficult for the model to choose correct paths.
Learning Syllogism with Euler Neural-Networks
In contrast to traditional neural network, ENN can precisely represent all 24 different structures of Syllogism.
KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge Base
To this end, we introduce KQA Pro, a dataset for Complex KBQA including ~120K diverse natural language questions.
MOOCCube: A Large-scale Data Repository for NLP Applications in MOOCs
The prosperity of Massive Open Online Courses (MOOCs) provides fodder for many NLP and AI research for education applications, e. g., course concept extraction, prerequisite relation discovery, etc.
Improving Event Detection via Open-domain Trigger Knowledge
Event Detection (ED) is a fundamental task in automatically structuring texts.
KACC: A Multi-task Benchmark for Knowledge Abstraction, Concretization and Completion
Based on the datasets, we propose novel tasks such as multi-hop knowledge abstraction (MKA), multi-hop knowledge concretization (MKC) and then design a comprehensive benchmark.
MAVEN: A Massive General Domain Event Detection Dataset
Most existing datasets exhibit the following issues that limit further development of ED: (1) Data scarcity.
KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation
Pre-trained language representation models (PLMs) cannot well capture factual knowledge from text.
Fine-Grained Entity Typing via Hierarchical Multi Graph Convolutional Networks
This paper addresses the problem of inferring the fine-grained type of an entity from a knowledge base.
HMEAE: Hierarchical Modular Event Argument Extraction
Existing event extraction methods classify each argument role independently, ignoring the conceptual correlations between different argument roles.
Semi-supervised Entity Alignment via Joint Knowledge Embedding Model and Cross-graph Model
Specifically, as for the knowledge embedding model, we utilize TransE to implicitly complete two KGs towards consistency and learn relational constraints between entities.
Course Concept Expansion in MOOCs with External Knowledge and Interactive Game
As Massive Open Online Courses (MOOCs) become increasingly popular, it is promising to automatically provide extracurricular knowledge for MOOC users.
Adapting Meta Knowledge Graph Information for Multi-Hop Reasoning over Few-Shot Relations
Multi-hop knowledge graph (KG) reasoning is an effective and explainable method for predicting the target entity via reasoning paths in query answering (QA) task.
Ranked #3 on
Link Prediction
on NELL-995
Multi-Channel Graph Neural Network for Entity Alignment
Entity alignment typically suffers from the issues of structural heterogeneity and limited seed alignments.
Ranked #30 on
Entity Alignment
on DBP15k zh-en
Encoding Category Trees Into Word-Embeddings Using Geometric Approach
Experiment results also show that $n$-ball embeddings demonstrate surprisingly good performance in validating the category of unknown word.
Explainable and Explicit Visual Reasoning over Scene Graphs
We aim to dismantle the prevalent black-box neural architectures used in complex visual reasoning tasks, into the proposed eXplainable and eXplicit Neural Modules (XNMs), which advance beyond existing neural module networks towards using scene graphs --- objects as nodes and the pairwise relationships as edges --- for explainable and explicit reasoning with structured knowledge.
Ranked #10 on
Visual Question Answering (VQA)
on CLEVR
Joint Representation Learning of Cross-lingual Words and Entities via Attentive Distant Supervision
Joint representation learning of words and entities benefits many NLP tasks, but has not been well explored in cross-lingual settings.
Neural Collective Entity Linking
To address this issue, we propose a novel neural model for collective entity linking, named as NCEL.
Differentiating Concepts and Instances for Knowledge Graph Embedding
Most conventional knowledge embedding methods encode both entities (concepts and instances) and relations as vectors in a low dimensional semantic space equally, ignoring the difference between concepts and instances.
Ranked #1 on
Link Prediction
on YAGO39K
DeepChannel: Salience Estimation by Contrastive Learning for Extractive Document Summarization
We propose DeepChannel, a robust, data-efficient, and interpretable neural model for extractive document summarization.
Learning to Embed Sentences Using Attentive Recursive Trees
Sentence embedding is an effective feature representation for most deep learning-based NLP tasks.
OpenKE: An Open Toolkit for Knowledge Embedding
We release an open toolkit for knowledge embedding (OpenKE), which provides a unified framework and various fundamental models to embed knowledge graphs into a continuous low-dimensional space.
Attributed and Predictive Entity Embedding for Fine-Grained Entity Typing in Knowledge Bases
Fine-grained entity typing aims at identifying the semantic type of an entity in KB.
On Modeling Sense Relatedness in Multi-prototype Word Embedding
To enhance the expression ability of distributional word representation learning model, many researchers tend to induce word senses through clustering, and learn multiple embedding vectors for each word, namely multi-prototype word embedding model.
Course Concept Extraction in MOOCs via Embedding-Based Graph Propagation
Massive Open Online Courses (MOOCs), offering a new way to study online, are revolutionizing education.
Prerequisite Relation Learning for Concepts in MOOCs
What prerequisite knowledge should students achieve a level of mastery before moving forward to learn subsequent coursewares?
Bridge Text and Knowledge by Learning Multi-Prototype Entity Mention Embedding
Integrating text and knowledge into a unified semantic space has attracted significant research interests recently.
Feature Engineering and Ensemble Modeling for Paper Acceptance Rank Prediction
Measuring research impact and ranking academic achievement are important and challenging problems.
RDF2Rules: Learning Rules from RDF Knowledge Bases by Mining Frequent Predicate Cycles
Recently, several large-scale RDF knowledge bases have been built and applied in many knowledge-based applications.
Panther: Fast Top-k Similarity Search in Large Networks
The algorithm is based on a novel idea of random path, and an extended method is also presented, to enhance the structural similarity when two vertices are completely disconnected.
Social and Information Networks
