Search Results for author: Zichao Wang

Found 22 papers, 9 papers with code

AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language Models

1 code implementation23 Oct 2023 Sicheng Zhu, Ruiyi Zhang, Bang An, Gang Wu, Joe Barrow, Zichao Wang, Furong Huang, Ani Nenkova, Tong Sun

Safety alignment of Large Language Models (LLMs) can be compromised with manual jailbreak attacks and (automatic) adversarial attacks.

Adversarial Attack Blocking

MultiQG-TI: Towards Question Generation from Multi-modal Sources

1 code implementation7 Jul 2023 Zichao Wang, Richard Baraniuk

We study the new problem of automatic question generation (QG) from multi-modal sources containing images and texts, significantly expanding the scope of most of the existing work that focuses exclusively on QG from only textual sources.

Optical Character Recognition Question Generation +1

Improving Reading Comprehension Question Generation with Data Augmentation and Overgenerate-and-rank

1 code implementation15 Jun 2023 Nischal Ashok Kumar, Nigel Fernandez, Zichao Wang, Andrew Lan

Reading comprehension is a crucial skill in many aspects of education, including language learning, cognitive development, and fostering early literacy skills in children.

Data Augmentation Question Generation +2

Interpretable Math Word Problem Solution Generation Via Step-by-step Planning

no code implementations1 Jun 2023 Mengxue Zhang, Zichao Wang, Zhichao Yang, Weiqi Feng, Andrew Lan

We propose a step-by-step planning approach for intermediate solution generation, which strategically plans the generation of the next solution step based on the MWP and the previous solution steps.

GSM8K Language Modelling +1

Retrieval-based Controllable Molecule Generation

1 code implementation23 Aug 2022 Zichao Wang, Weili Nie, Zhuoran Qiao, Chaowei Xiao, Richard Baraniuk, Anima Anandkumar

On various tasks ranging from simple design criteria to a challenging real-world scenario for designing lead compounds that bind to the SARS-CoV-2 main protease, we demonstrate our approach extrapolates well beyond the retrieval database, and achieves better performance and wider applicability than previous methods.

Drug Discovery Retrieval

NeurIPS Competition Instructions and Guide: Causal Insights for Learning Paths in Education

no code implementations17 Aug 2022 Wenbo Gong, Digory Smith, Zichao Wang, Craig Barton, Simon Woodhead, Nick Pawlowski, Joel Jennings, Cheng Zhang

In this competition, participants will address two fundamental causal challenges in machine learning in the context of education using time-series data.

Causal Discovery Selection bias +2

Automated Scoring for Reading Comprehension via In-context BERT Tuning

1 code implementation19 May 2022 Nigel Fernandez, Aritra Ghosh, Naiming Liu, Zichao Wang, Benoît Choffin, Richard Baraniuk, Andrew Lan

Our approach, in-context BERT fine-tuning, produces a single shared scoring model for all items with a carefully-designed input structure to provide contextual information on each item.

Reading Comprehension

GPT-based Open-Ended Knowledge Tracing

1 code implementation21 Feb 2022 Naiming Liu, Zichao Wang, Richard G. Baraniuk, Andrew Lan

In education applications, knowledge tracing refers to the problem of estimating students' time-varying concept/skill mastery level from their past responses to questions and predicting their future performance.

Code Generation Knowledge Tracing +3

A Step-Wise Weighting Approach for Controllable Text Generation

no code implementations29 Sep 2021 Zichao Wang, Weili Nie, Zhenwei Dai, Richard Baraniuk

Many existing approaches either require extensive training/fine-tuning of the LM for each single attribute under control or are slow to generate text.

Attribute Language Modelling +1

Math Word Problem Generation with Mathematical Consistency and Problem Context Constraints

no code implementations EMNLP 2021 Zichao Wang, Andrew S. Lan, Richard G. Baraniuk

We study the problem of generating arithmetic math word problems (MWPs) given a math equation that specifies the mathematical computation and a context that specifies the problem scenario.

Math Question Generation

Math Operation Embeddings for Open-ended Solution Analysis and Feedback

no code implementations25 Apr 2021 Mengxue Zhang, Zichao Wang, Richard Baraniuk, Andrew Lan

Feedback on student answers and even during intermediate steps in their solutions to open-ended questions is an important element in math education.

Math

Enhanced Recurrent Neural Tangent Kernels for Non-Time-Series Data

2 code implementations9 Dec 2020 Sina AlEMohammad, Randall Balestriero, Zichao Wang, Richard Baraniuk

Kernels derived from deep neural networks (DNNs) in the infinite-width regime provide not only high performance in a range of machine learning tasks but also new theoretical insights into DNN training dynamics and generalization.

Time Series Time Series Analysis

Instructions and Guide for Diagnostic Questions: The NeurIPS 2020 Education Challenge

no code implementations23 Jul 2020 Zichao Wang, Angus Lamb, Evgeny Saveliev, Pashmina Cameron, Yordan Zaykov, José Miguel Hernández-Lobato, Richard E. Turner, Richard G. Baraniuk, Craig Barton, Simon Peyton Jones, Simon Woodhead, Cheng Zhang

In this competition, participants will focus on the students' answer records to these multiple-choice diagnostic questions, with the aim of 1) accurately predicting which answers the students provide; 2) accurately predicting which questions have high quality; and 3) determining a personalized sequence of questions for each student that best predicts the student's answers.

Misconceptions Multiple-choice

The Recurrent Neural Tangent Kernel

no code implementations ICLR 2021 Sina Al-E-Mohammad, Zichao Wang, Randall Balestriero, Richard Baraniuk

The study of deep neural networks (DNNs) in the infinite-width limit, via the so-called neural tangent kernel (NTK) approach, has provided new insights into the dynamics of learning, generalization, and the impact of initialization.

An Improved Semi-Supervised VAE for Learning Disentangled Representations

no code implementations12 Jun 2020 Weili Nie, Zichao Wang, Ankit B. Patel, Richard G. Baraniuk

Learning interpretable and disentangled representations is a crucial yet challenging task in representation learning.

Disentanglement

VarFA: A Variational Factor Analysis Framework For Efficient Bayesian Learning Analytics

no code implementations27 May 2020 Zichao Wang, Yi Gu, Andrew Lan, Richard Baraniuk

We propose VarFA, a variational inference factor analysis framework that extends existing factor analysis models for educational data mining to efficiently output uncertainty estimation in the model's estimated factors.

Bayesian Inference Variational Inference

Educational Question Mining At Scale: Prediction, Analysis and Personalization

no code implementations12 Mar 2020 Zichao Wang, Sebastian Tschiatschek, Simon Woodhead, Jose Miguel Hernandez-Lobato, Simon Peyton Jones, Richard G. Baraniuk, Cheng Zhang

Online education platforms enable teachers to share a large number of educational resources such as questions to form exercises and quizzes for students.

A MAX-AFFINE SPLINE PERSPECTIVE OF RECURRENT NEURAL NETWORKS

no code implementations ICLR 2019 Zichao Wang, Randall Balestriero, Richard Baraniuk

Second, we show that the affine parameter of an RNN corresponds to an input-specific template, from which we can interpret an RNN as performing a simple template matching (matched filtering) given the input.

L2 Regularization Template Matching

Cannot find the paper you are looking for? You can Submit a new open access paper.