Search Results for author: Zongyi Li

Found 30 papers, 15 papers with code

Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs

1 code implementation19 Mar 2024 Md Ashiqur Rahman, Robert Joseph George, Mogab Elleithy, Daniel Leibovici, Zongyi Li, Boris Bonev, Colin White, Julius Berner, Raymond A. Yeh, Jean Kossaifi, Kamyar Azizzadenesheli, Anima Anandkumar

On complex downstream tasks with limited data, such as fluid flow simulations and fluid-structure interactions, we found CoDA-NO to outperform existing methods on the few-shot learning task by over $36\%$.

Few-Shot Learning Self-Supervised Learning

FusionU-Net: U-Net with Enhanced Skip Connection for Pathology Image Segmentation

1 code implementation17 Oct 2023 Zongyi Li, Hongbing Lyu, Jun Wang

One of the key designs of U-Net is the use of skip connections between the encoder and decoder, which helps to recover detailed information after upsampling.

Image Segmentation Semantic Segmentation

Neural Operators for Accelerating Scientific Simulations and Design

no code implementations27 Sep 2023 Kamyar Azizzadenesheli, Nikola Kovachki, Zongyi Li, Miguel Liu-Schiaffini, Jean Kossaifi, Anima Anandkumar

Scientific discovery and engineering design are currently limited by the time and cost of physical experiments, selected mostly through trial-and-error and intuition that require deep domain expertise.

Super-Resolution Weather Forecasting

The Nonlocal Neural Operator: Universal Approximation

no code implementations26 Apr 2023 Samuel Lanthaler, Zongyi Li, Andrew M. Stuart

A popular variant of neural operators is the Fourier neural operator (FNO).

Operator learning

Forecasting subcritical cylinder wakes with Fourier Neural Operators

no code implementations19 Jan 2023 Peter I Renn, Cong Wang, Sahin Lale, Zongyi Li, Anima Anandkumar, Morteza Gharib

The learned FNO solution operator can be evaluated in milliseconds, potentially enabling faster-than-real-time modeling for predictive flow control in physical systems.

Operator learning

Fourier Continuation for Exact Derivative Computation in Physics-Informed Neural Operators

no code implementations29 Nov 2022 Haydn Maust, Zongyi Li, YiXuan Wang, Daniel Leibovici, Oscar Bruno, Thomas Hou, Anima Anandkumar

The physics-informed neural operator (PINO) is a machine learning architecture that has shown promising empirical results for learning partial differential equations.

Machine Learning Accelerated PDE Backstepping Observers

no code implementations28 Nov 2022 Yuanyuan Shi, Zongyi Li, Huan Yu, Drew Steeves, Anima Anandkumar, Miroslav Krstic

State estimation is important for a variety of tasks, from forecasting to substituting for unmeasured states in feedback controllers.

Computational Efficiency

Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEs

no code implementations28 Nov 2022 Robert Joseph George, Jiawei Zhao, Jean Kossaifi, Zongyi Li, Anima Anandkumar

Fourier Neural Operators (FNO) offer a principled approach to solving challenging partial differential equations (PDE) such as turbulent flows.

Improving the Transferability of Adversarial Attacks on Face Recognition with Beneficial Perturbation Feature Augmentation

no code implementations28 Oct 2022 Fengfan Zhou, Hefei Ling, Yuxuan Shi, Jiazhong Chen, Zongyi Li, Ping Li

Though generating hard samples has shown its effectiveness in improving the generalization of models in training tasks, the effectiveness of utilizing this idea to improve the transferability of adversarial face examples remains unexplored.

Adversarial Attack Face Recognition

Fourier Neural Operator with Learned Deformations for PDEs on General Geometries

6 code implementations11 Jul 2022 Zongyi Li, Daniel Zhengyu Huang, Burigede Liu, Anima Anandkumar

The resulting geo-FNO model has both the computation efficiency of FFT and the flexibility of handling arbitrary geometries.

valid

Large Scale Mask Optimization Via Convolutional Fourier Neural Operator and Litho-Guided Self Training

no code implementations8 Jul 2022 HaoYu Yang, Zongyi Li, Kumara Sastry, Saumyadip Mukhopadhyay, Anima Anandkumar, Brucek Khailany, Vivek Singh, Haoxing Ren

Machine learning techniques have been extensively studied for mask optimization problems, aiming at better mask printability, shorter turnaround time, better mask manufacturability, and so on.

BIG-bench Machine Learning

Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformers

2 code implementations24 Nov 2021 John Guibas, Morteza Mardani, Zongyi Li, Andrew Tao, Anima Anandkumar, Bryan Catanzaro

AFNO is based on a principled foundation of operator learning which allows us to frame token mixing as a continuous global convolution without any dependence on the input resolution.

Computational Efficiency Operator learning +1

Efficient Token Mixing for Transformers via Adaptive Fourier Neural Operators

no code implementations ICLR 2022 John Guibas, Morteza Mardani, Zongyi Li, Andrew Tao, Anima Anandkumar, Bryan Catanzaro

AFNO is based on a principled foundation of operator learning which allows us to frame token mixing as a continuous global convolution without any dependence on the input resolution.

Computational Efficiency Operator learning +1

U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flow

1 code implementation3 Sep 2021 Gege Wen, Zongyi Li, Kamyar Azizzadenesheli, Anima Anandkumar, Sally M. Benson

Here we present U-FNO, a novel neural network architecture for solving multiphase flow problems with superior accuracy, speed, and data efficiency.

Decision Making

Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitution

1 code implementation EMNLP 2021 Zongyi Li, Jianhan Xu, Jiehang Zeng, Linyang Li, Xiaoqing Zheng, Qi Zhang, Kai-Wei Chang, Cho-Jui Hsieh

Recent studies have shown that deep neural networks are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural NLP models.

Benchmarking

Neural Operator: Learning Maps Between Function Spaces

1 code implementation19 Aug 2021 Nikola Kovachki, Zongyi Li, Burigede Liu, Kamyar Azizzadenesheli, Kaushik Bhattacharya, Andrew Stuart, Anima Anandkumar

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets.

Operator learning

Learning Dissipative Dynamics in Chaotic Systems

2 code implementations13 Jun 2021 Zongyi Li, Miguel Liu-Schiaffini, Nikola Kovachki, Burigede Liu, Kamyar Azizzadenesheli, Kaushik Bhattacharya, Andrew Stuart, Anima Anandkumar

Chaotic systems are notoriously challenging to predict because of their sensitivity to perturbations and errors due to time stepping.

Unsupervised Word Segmentation with Bi-directional Neural Language Model

1 code implementation2 Mar 2021 Lihao Wang, Zongyi Li, Xiaoqing Zheng

We present an unsupervised word segmentation model, in which the learning objective is to maximize the generation probability of a sentence given its all possible segmentation.

Language Modelling Segmentation +1

Unsupervised Summarization by Jointly Extracting Sentences and Keywords

no code implementations16 Sep 2020 Zongyi Li, Xiaoqing Zheng, Jun He

We present RepRank, an unsupervised graph-based ranking model for extractive multi-document summarization in which the similarity between words, sentences, and word-to-sentence can be estimated by the distances between their vector representations in a unified vector space.

Document Summarization Multi-Document Summarization +2

Multipole Graph Neural Operator for Parametric Partial Differential Equations

4 code implementations NeurIPS 2020 Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Kaushik Bhattacharya, Andrew Stuart, Anima Anandkumar

One of the main challenges in using deep learning-based methods for simulating physical systems and solving partial differential equations (PDEs) is formulating physics-based data in the desired structure for neural networks.

Neural Operator: Graph Kernel Network for Partial Differential Equations

6 code implementations ICLR Workshop DeepDiffEq 2019 Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Kaushik Bhattacharya, Andrew Stuart, Anima Anandkumar

The classical development of neural networks has been primarily for mappings between a finite-dimensional Euclidean space and a set of classes, or between two finite-dimensional Euclidean spaces.

Conditional Linear Regression

1 code implementation6 Jun 2018 Diego Calderon, Brendan Juba, Sirui Li, Zongyi Li, Lisa Ruan

Work in machine learning and statistics commonly focuses on building models that capture the vast majority of data, possibly ignoring a segment of the population as outliers.

regression

Learning Abduction under Partial Observability

no code implementations13 Nov 2017 Brendan Juba, Zongyi Li, Evan Miller

The main shortcoming of this formulation of the task is that it assumes access to full-information (i. e., fully specified) examples; relatedly, it offers no role for declarative background knowledge, as such knowledge is rendered redundant in the abduction task by complete information.

valid

Cannot find the paper you are looking for? You can Submit a new open access paper.