Search Results for author: Steven Su

Found 7 papers, 4 papers with code

BaLeNAS: Differentiable Architecture Search via the Bayesian Learning Rule

no code implementations CVPR 2022 Miao Zhang, Jilin Hu, Steven Su, Shirui Pan, Xiaojun Chang, Bin Yang, Gholamreza Haffari

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation.

Neural Architecture Search Variational Inference

iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients

1 code implementation21 Jun 2021 Miao Zhang, Steven Su, Shirui Pan, Xiaojun Chang, Ehsan Abbasnejad, Reza Haffari

A key challenge to the scalability and quality of the learned architectures is the need for differentiating through the inner-loop optimisation.

Neural Architecture Search

Differentiable Neural Architecture Search in Equivalent Space with Exploration Enhancement

1 code implementation NeurIPS 2020 Miao Zhang, Huiqi Li, Shirui Pan, Xiaojun Chang, ZongYuan Ge, Steven Su

A probabilistic exploration enhancement method is accordingly devised to encourage intelligent exploration during the architecture search in the latent space, to avoid local optimal in architecture search.

Bilevel Optimization Neural Architecture Search

Extension of causal decomposition in the mutual complex dynamic process

no code implementations17 Aug 2020 Yi Zhang, Qin Yang, Lifu Zhang, Branko Celler, Steven Su, Peng Xu, Dezhong Yao

Causal decomposition depicts a cause-effect relationship that is not based on the concept of prediction, but based on the phase dependence of time series.

Time Series Time Series Analysis

Efficient Novelty-Driven Neural Architecture Search

no code implementations22 Jul 2019 Miao Zhang, Huiqi Li, Shirui Pan, Taoping Liu, Steven Su

The best architecture obtained by our algorithm with the same search space achieves the state-of-the-art test error rate of 2. 51\% on CIFAR-10 with only 7. 5 hours search time in a single GPU, and a validation perplexity of 60. 02 and a test perplexity of 57. 36 on PTB.

Neural Architecture Search

High Dimensional Bayesian Optimization via Supervised Dimension Reduction

1 code implementation21 Jul 2019 Miao Zhang, Huiqi Li, Steven Su

Furthermore, a kernel trick is developed to reduce computational complexity and learn nonlinear subset of the unknowing function when applying SIR to extremely high dimensional BO.

Bayesian Optimization Dimensionality Reduction +1

Multi-level CNN for lung nodule classification with Gaussian Process assisted hyperparameter optimization

1 code implementation2 Jan 2019 Miao Zhang, Huiqi Li, Juan Lyu, Sai Ho Ling, Steven Su

In this paper, a non-stationary kernel is proposed which allows the surrogate model to adapt to functions whose smoothness varies with the spatial location of inputs, and a multi-level convolutional neural network (ML-CNN) is built for lung nodule classification whose hyperparameter configuration is optimized by using the proposed non-stationary kernel based Gaussian surrogate model.

Bayesian Optimization Gaussian Processes +3

Cannot find the paper you are looking for? You can Submit a new open access paper.