Search Results for author: Shinjae Yoo

Found 43 papers, 14 papers with code

Studying the Impact of Latent Representations in Implicit Neural Networks for Scientific Continuous Field Reconstruction

no code implementations9 Apr 2024 Wei Xu, Derek Freeman DeSantis, Xihaier Luo, Avish Parmar, Klaus Tan, Balu Nadiga, Yihui Ren, Shinjae Yoo

Learning a continuous and reliable representation of physical fields from sparse sampling is challenging and it affects diverse scientific disciplines.

Extracting Protein-Protein Interactions (PPIs) from Biomedical Literature using Attention-based Relational Context Information

1 code implementation8 Mar 2024 Gilchan Park, Sean McCorkle, Carlos Soto, Ian Blaby, Shinjae Yoo

On the other hand, machine learning methods to automate PPI knowledge extraction from the scientific literature have been limited by a shortage of appropriate annotated data.

Relation Relation Classification

An Evaluation of Real-time Adaptive Sampling Change Point Detection Algorithm using KCUSUM

no code implementations15 Feb 2024 Vijayalakshmi Saravanan, Perry Siehien, Shinjae Yoo, Hubertus van Dam, Thomas Flynn, Christopher Kelly, Khaled Z Ibrahim

Detecting abrupt changes in real-time data streams from scientific simulations presents a challenging task, demanding the deployment of accurate and efficient algorithms.

Change Detection Change Point Detection +1

Continuous Field Reconstruction from Sparse Observations with Implicit Neural Networks

no code implementations21 Jan 2024 Xihaier Luo, Wei Xu, Yihui Ren, Shinjae Yoo, Balu Nadiga

Reliably reconstructing physical fields from sparse sensor data is a challenge that frequently arises in many scientific domains.

Federated Quantum Long Short-term Memory (FedQLSTM)

no code implementations21 Dec 2023 Mahdi Chehimi, Samuel Yen-Chi Chen, Walid Saad, Shinjae Yoo

The proposed federated QLSTM (FedQLSTM) framework is exploited for performing the task of function approximation.

Federated Learning Quantum Machine Learning

AesFA: An Aesthetic Feature-Aware Arbitrary Neural Style Transfer

1 code implementation10 Dec 2023 Joonwoo Kwon, Sooyoung Kim, Yuewei Lin, Shinjae Yoo, Jiook Cha

The primary idea is to decompose the image via its frequencies to better disentangle aesthetic styles from the reference image while training the entire model in an end-to-end manner to exclude pre-trained models at inference completely.

Disentanglement Style Transfer

Fast 2D Bicephalous Convolutional Autoencoder for Compressing 3D Time Projection Chamber Data

1 code implementation23 Oct 2023 Yi Huang, Yihui Ren, Shinjae Yoo, Jin Huang

Developing real-time data compression algorithms to reduce such data at high throughput to fit permanent storage has drawn increasing attention.

Data Compression

Quantum Federated Learning With Quantum Networks

no code implementations23 Oct 2023 Tyler Wang, Huan-Hsin Tseng, Shinjae Yoo

A major concern of deep learning models is the large amount of data that is required to build and train them, much of which is reliant on sensitive and personally identifiable information that is vulnerable to access by third parties.

Federated Learning Transfer Learning

Federated Quantum Machine Learning with Differential Privacy

no code implementations10 Oct 2023 Rod Rofougaran, Shinjae Yoo, Huan-Hsin Tseng, Samuel Yen-Chi Chen

The preservation of privacy is a critical concern in the implementation of artificial intelligence on sensitive training data.

Binary Classification Federated Learning +2

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies

no code implementations6 Oct 2023 Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang, Conglong Li, Shiyang Chen, Chengming Zhang, Masahiro Tanaka, Xiaoxia Wu, Jeff Rasley, Ammar Ahmad Awan, Connor Holmes, Martin Cai, Adam Ghanem, Zhongzhu Zhou, Yuxiong He, Pete Luferenko, Divya Kumar, Jonathan Weyn, Ruixiong Zhang, Sylwester Klocek, Volodymyr Vragov, Mohammed AlQuraishi, Gustaf Ahdritz, Christina Floristean, Cristina Negri, Rao Kotamarthi, Venkatram Vishwanath, Arvind Ramanathan, Sam Foreman, Kyle Hippe, Troy Arcomano, Romit Maulik, Maxim Zvyagin, Alexander Brace, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael Irvin, J. Gregory Pauloski, Logan Ward, Valerie Hayot, Murali Emani, Zhen Xie, Diangen Lin, Maulik Shukla, Ian Foster, James J. Davis, Michael E. Papka, Thomas Brettin, Prasanna Balaprakash, Gina Tourassi, John Gounley, Heidi Hanson, Thomas E Potok, Massimiliano Lupo Pasini, Kate Evans, Dan Lu, Dalton Lunga, Junqi Yin, Sajal Dash, Feiyi Wang, Mallikarjun Shankar, Isaac Lyngaas, Xiao Wang, Guojing Cong, Pei Zhang, Ming Fan, Siyan Liu, Adolfy Hoisie, Shinjae Yoo, Yihui Ren, William Tang, Kyle Felker, Alexey Svyatkovskiy, Hang Liu, Ashwin Aji, Angela Dalton, Michael Schulte, Karl Schulz, Yuntian Deng, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Anima Anandkumar, Rick Stevens

In the upcoming decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences.

Exploring Robust Features for Improving Adversarial Robustness

no code implementations9 Sep 2023 Hong Wang, Yuefan Deng, Shinjae Yoo, Yuewei Lin

In this paper, we strive to explore the robust features which are not affected by the adversarial perturbations, i. e., invariant to the clean image and its adversarial examples, to improve the model's adversarial robustness.

Adversarial Robustness Disentanglement

INSURE: An Information Theory Inspired Disentanglement and Purification Model for Domain Generalization

no code implementations8 Sep 2023 Xi Yu, Huan-Hsin Tseng, Shinjae Yoo, Haibin Ling, Yuewei Lin

Specifically, we first propose an information theory inspired loss function to ensure the disentangled class-relevant features contain sufficient class label information and the other disentangled auxiliary feature has sufficient domain information.

Disentanglement Domain Generalization

An extensible point-based method for data chart value detection

1 code implementation22 Aug 2023 Carlos Soto, Shinjae Yoo

We present an extensible method for identifying semantic points to reverse engineer (i. e. extract the values of) data charts, particularly those in scientific articles.

object-detection Object Detection +1

Comparative Performance Evaluation of Large Language Models for Extracting Molecular Interactions and Pathway Knowledge

1 code implementation17 Jul 2023 Gilchan Park, Byung-Jun Yoon, Xihaier Luo, Vanessa López-Marrero, Shinjae Yoo, Shantenu Jha

Understanding protein interactions and pathway knowledge is crucial for unraveling the complexities of living systems and investigating the underlying mechanisms of biological functions and complex diseases.

SwiFT: Swin 4D fMRI Transformer

1 code implementation NeurIPS 2023 Peter Yongho Kim, Junbeom Kwon, Sunghwan Joo, Sangyoon Bae, DongGyu Lee, Yoonho Jung, Shinjae Yoo, Jiook Cha, Taesup Moon

To address this challenge, we present SwiFT (Swin 4D fMRI Transformer), a Swin Transformer architecture that can learn brain dynamics directly from fMRI volumes in a memory and computation-efficient manner.

Optimal sensor placement for reconstructing wind pressure field around buildings using compressed sensing

no code implementations7 Jun 2023 Xihaier Luo, Ahsan Kareem, Shinjae Yoo

Deciding how to optimally deploy sensors in a large, complex, and spatially extended structure is critical to ensure that the surface pressure field is accurately captured for subsequent analysis and design.

UVCGAN v2: An Improved Cycle-Consistent GAN for Unpaired Image-to-Image Translation

2 code implementations28 Mar 2023 Dmitrii Torbunov, Yi Huang, Huan-Hsin Tseng, Haiwang Yu, Jin Huang, Shinjae Yoo, MeiFeng Lin, Brett Viren, Yihui Ren

An unpaired image-to-image (I2I) translation technique seeks to find a mapping between two domains of data in a fully unsupervised manner.

Image-to-Image Translation Translation

A Neural PDE Solver with Temporal Stencil Modeling

1 code implementation16 Feb 2023 Zhiqing Sun, Yiming Yang, Shinjae Yoo

Numerical simulation of non-linear partial differential equations plays a crucial role in modeling physical science and engineering phenomena, such as weather, climate, and aerodynamics.

Time Series Time Series Analysis

A Bayesian Deep Learning Approach to Near-Term Climate Prediction

no code implementations23 Feb 2022 Xihaier Luo, Balasubramanya T. Nadiga, Yihui Ren, Ji Hwan Park, Wei Xu, Shinjae Yoo

Since model bias and associated initialization shock are serious shortcomings that reduce prediction skills in state-of-the-art decadal climate prediction efforts, we pursue a complementary machine-learning-based approach to climate prediction.

A Machine Learning-based Characterization Framework for Parametric Representation of Nonlinear Sloshing

no code implementations25 Jan 2022 Xihaier Luo, Ahsan Kareem, Liting Yu, Shinjae Yoo

The growing interest in creating a parametric representation of liquid sloshing inside a container stems from its practical applications in modern engineering systems.

BIG-bench Machine Learning Representation Learning

Efficient Data Compression for 3D Sparse TPC via Bicephalous Convolutional Autoencoder

1 code implementation9 Nov 2021 Yi Huang, Yihui Ren, Shinjae Yoo, Jin Huang

This method shows advantages both in compression fidelity and ratio compared to traditional data compression methods, such as MGARD, SZ, and ZFP.

Data Compression

Sparse Attention with Learning to Hash

no code implementations ICLR 2022 Zhiqing Sun, Yiming Yang, Shinjae Yoo

To overcome these issues, this paper proposes a new strategy for sparse attention, namely LHA (Learning-to-Hash Attention), which directly learns separate parameterized hash functions for queries and keys, respectively.

Image Classification Language Modelling +2

Feature Importance in a Deep Learning Climate Emulator

no code implementations27 Aug 2021 Wei Xu, Xihaier Luo, Yihui Ren, Ji Hwan Park, Shinjae Yoo, Balasubramanya T. Nadiga

From the perspective of climate dynamics, these findings suggest a dominant role for local processes and a negligible role for remote teleconnections at the spatial and temporal scales we consider.

Feature Importance

AGKD-BML: Defense Against Adversarial Attack by Attention Guided Knowledge Distillation and Bi-directional Metric Learning

1 code implementation ICCV 2021 Hong Wang, Yuefan Deng, Shinjae Yoo, Haibin Ling, Yuewei Lin

The attention knowledge is obtained from a weight-fixed model trained on a clean dataset, referred to as a teacher model, and transferred to a model that is under training on adversarial examples (AEs), referred to as a student model.

Adversarial Attack Adversarial Robustness +2

Stochastic Projective Splitting: Solving Saddle-Point Problems with Multiple Regularizers

no code implementations24 Jun 2021 Patrick R. Johnstone, Jonathan Eckstein, Thomas Flynn, Shinjae Yoo

We present a new, stochastic variant of the projective splitting (PS) family of algorithms for monotone inclusion problems.

regression

Federated Quantum Machine Learning

no code implementations22 Mar 2021 Samuel Yen-Chi Chen, Shinjae Yoo

Distributed training across several quantum computers could significantly improve the training time and if we could share the learned model, not the data, it could potentially improve the data privacy as the training would happen where the data is located.

BIG-bench Machine Learning Federated Learning +1

Quantum machine learning with differential privacy

no code implementations10 Mar 2021 William M Watkins, Samuel Yen-Chi Chen, Shinjae Yoo

In this study, we develop a hybrid quantum-classical model that is trained to preserve privacy using differentially private optimization algorithm.

BIG-bench Machine Learning General Classification +2

Three-dimensional Coherent X-ray Diffraction Imaging via Deep Convolutional Neural Networks

no code implementations26 Feb 2021 Longlong Wu, Shinjae Yoo, Ana F. Suzana, Tadesse A. Assefa, Jiecheng Diao, Ross J. Harder, Wonsuk Cha, Ian K. Robinson

The trained ML model can rapidly provide an immediate result with high accuracy which could benefit real-time experiments, and the predicted result can be further refined with transfer learning.

Retrieval Transfer Learning

Quantum Long Short-Term Memory

no code implementations3 Sep 2020 Samuel Yen-Chi Chen, Shinjae Yoo, Yao-Lung L. Fang

Long short-term memory (LSTM) is a kind of recurrent neural networks (RNN) for sequence and temporal dependency data modeling and its effectiveness has been extensively established.

Bounding the expected run-time of nonconvex optimization with early stopping

no code implementations20 Feb 2020 Thomas Flynn, Kwang Min Yu, Abid Malik, Nicolas D'Imperio, Shinjae Yoo

This work examines the convergence of stochastic gradient-based optimization algorithms that use early stopping based on a validation function.

Visual Detection with Context for Document Layout Analysis

no code implementations IJCNLP 2019 Carlos Soto, Shinjae Yoo

Due to the limited availability of high-quality region-labels for scientific articles, we also contribute a novel dataset of region annotations, the first version of which covers 9 region classes and 822 article pages.

Document Layout Analysis Literature Mining +2

On the expected running time of nonconvex optimization with early stopping

no code implementations25 Sep 2019 Thomas Flynn, Kwang Min Yu, Abid Malik, Shinjae Yoo, Nicholas D'Imperio

This work examines the convergence of stochastic gradient algorithms that use early stopping based on a validation function, wherein optimization ends when the magnitude of a validation function gradient drops below a threshold.

Layered SGD: A Decentralized and Synchronous SGD Algorithm for Scalable Deep Neural Network Training

no code implementations13 Jun 2019 Kwangmin Yu, Thomas Flynn, Shinjae Yoo, Nicholas D'Imperio

The efficiency of the algorithm is tested by training a deep network on the ImageNet classification task.

Performance Analysis of Deep Learning Workloads on Leading-edge Systems

no code implementations21 May 2019 Yi-Hui Ren, Shinjae Yoo, Adolfy Hoisie

This work examines the performance of leading-edge systems designed for machine learning computing, including the NVIDIA DGX-2, Amazon Web Services (AWS) P3, IBM Power System Accelerated Compute Server AC922, and a consumer-grade Exxact TensorEX TS4 GPU server.

Re-examination of the Role of Latent Variables in Sequence Modeling

1 code implementation NeurIPS 2019 Zihang Dai, Guokun Lai, Yiming Yang, Shinjae Yoo

With latent variables, stochastic recurrent models have achieved state-of-the-art performance in modeling sound-wave sequence.

Density Estimation

Cannot find the paper you are looking for? You can Submit a new open access paper.