Search Results for author: Mengjie Zhang

Found 52 papers, 13 papers with code

Learning Traffic Signal Control via Genetic Programming

no code implementations26 Mar 2024 Xiao-Cheng Liao, Yi Mei, Mengjie Zhang

In our approach, we design a concept of phase urgency for each signal phase.

Fast and Efficient Local Search for Genetic Programming Based Loss Function Learning

1 code implementation1 Mar 2024 Christian Raymond, Qi Chen, Bing Xue, Mengjie Zhang

In this paper, we develop upon the topic of loss function learning, an emergent meta-learning paradigm that aims to learn loss functions that significantly improve the performance of the models trained under them.

Meta-Learning

Genetic-based Constraint Programming for Resource Constrained Job Scheduling

no code implementations1 Feb 2024 Su Nguyen, Dhananjay Thiruvady, Yuan Sun, Mengjie Zhang

In the proposed algorithm, evolved programs represent variable selectors to be used in the search process of constraint programming, and their fitness is determined by the quality of solutions obtained for training instances.

Scheduling

A Consistent Lebesgue Measure for Multi-label Learning

no code implementations1 Feb 2024 Kaan Demir, Bach Nguyen, Bing Xue, Mengjie Zhang

The consistency of surrogate loss functions is not proven and is exacerbated by the conflicting nature of multi-label loss functions.

Multi-Label Learning

Improving Buoy Detection with Deep Transfer Learning for Mussel Farm Automation

no code implementations18 Aug 2023 Carl McMillan, Junhong Zhao, Bing Xue, Ross Vennell, Mengjie Zhang

To establish an effective deep learning model for buoy detection with a limited number of labeled data, we employ transfer learning techniques.

object-detection Object Detection +1

Differentiable Genetic Programming for High-dimensional Symbolic Regression

no code implementations18 Apr 2023 Peng Zeng, Xiaotian Song, Andrew Lensen, Yuwei Ou, Yanan sun, Mengjie Zhang, Jiancheng Lv

With these designs, the proposed DGP method can efficiently search for the GP trees with higher performance, thus being capable of dealing with high-dimensional SR. To demonstrate the effectiveness of DGP, we conducted various experiments against the state of the arts based on both GP and deep neural networks.

Interpretable Machine Learning regression +2

Online Loss Function Learning

no code implementations30 Jan 2023 Christian Raymond, Qi Chen, Bing Xue, Mengjie Zhang

Loss function learning is a new meta-learning paradigm that aims to automate the essential task of designing a loss function for a machine learning model.

Meta-Learning

An Efficient Evolutionary Deep Learning Framework Based on Multi-source Transfer Learning to Evolve Deep Convolutional Neural Networks

no code implementations7 Dec 2022 Bin Wang, Bing Xue, Mengjie Zhang

In this paper, inspired by transfer learning, a new evolutionary computation based framework is proposed to efficiently evolve CNNs without compromising the classification accuracy.

Transfer Learning

Explaining Deep Convolutional Neural Networks for Image Classification by Evolving Local Interpretable Model-agnostic Explanations

no code implementations28 Nov 2022 Bin Wang, Wenbin Pei, Bing Xue, Mengjie Zhang

The evolved local explanations on four images, randomly selected from ImageNet, are presented, which show that the evolved local explanations are straightforward to be recognised by humans.

Image Classification

Genetic Programming-Based Evolutionary Deep Learning for Data-Efficient Image Classification

no code implementations27 Sep 2022 Ying Bi, Bing Xue, Mengjie Zhang

The new approach can automatically evolve variable-length models using many important operators from both image and classification domains.

Classification Image Classification

Learning Symbolic Model-Agnostic Loss Functions via Meta-Learning

no code implementations19 Sep 2022 Christian Raymond, Qi Chen, Bing Xue, Mengjie Zhang

In this paper, we develop upon the emerging topic of loss function learning, which aims to learn loss functions that significantly improve the performance of the models trained under them.

Meta-Learning

A Survey on Evolutionary Computation for Computer Vision and Image Analysis: Past, Present, and Future Trends

no code implementations14 Sep 2022 Ying Bi, Bing Xue, Pablo Mesejo, Stefano Cagnoni, Mengjie Zhang

This survey aims to provide a better understanding of evolutionary computer vision (ECV) by discussing the contributions of different approaches and exploring how and why EC is used for CV and image analysis.

Edge Detection Image Classification +4

Survey on Evolutionary Deep Learning: Principles, Algorithms, Applications and Open Issues

no code implementations23 Aug 2022 Nan Li, Lianbo Ma, Guo Yu, Bing Xue, Mengjie Zhang, Yaochu Jin

Specifically, we firstly illuminate EDL from machine learning and EC and regard EDL as an optimization problem.

AutoML Feature Engineering

Architecture Augmentation for Performance Predictor Based on Graph Isomorphism

no code implementations3 Jul 2022 Xiangning Xie, Yuqiao Liu, Yanan sun, Mengjie Zhang, Kay Chen Tan

Performance predictors can greatly alleviate the prohibitive cost of NAS by directly predicting the performance of DNNs.

Neural Architecture Search

Deep Learning Model with GA based Feature Selection and Context Integration

no code implementations13 Apr 2022 Ranju Mandal, Basim Azam, Brijesh Verma, Mengjie Zhang

The empirical analysis reveals that optimized visual features with global and local contextual information play a significant role to improve accuracy and produce stable predictions comparable to state-of-the-art deep CNN models.

feature selection Image Segmentation +1

Genetic Programming for Manifold Learning: Preserving Local Topology

no code implementations23 Aug 2021 Andrew Lensen, Bing Xue, Mengjie Zhang

Recently, genetic programming has emerged as a very promising approach to manifold learning by evolving functional mappings from the original space to an embedding.

BenchENAS: A Benchmarking Platform for Evolutionary Neural Architecture Search

1 code implementation9 Aug 2021 Xiangning Xie, Yuqiao Liu, Yanan sun, Gary G. Yen, Bing Xue, Mengjie Zhang

The paper conducts efficient comparison experiments on eight ENAS algorithms with high GPU utilization on this platform.

Benchmarking Neural Architecture Search

Learning and Sharing: A Multitask Genetic Programming Approach to Image Feature Learning

no code implementations17 Dec 2020 Ying Bi, Bing Xue, Mengjie Zhang

Therefore, this paper develops a multitask GP approach to image feature learning for classification with limited training data.

General Classification Image Classification

Evolving Deep Convolutional Neural Networks for Hyperspectral Image Denoising

no code implementations15 Aug 2020 Yuqiao Liu, Yanan sun, Bing Xue, Mengjie Zhang

Hyperspectral images (HSIs) are susceptible to various noise factors leading to the loss of information, and the noise restricts the subsequent HSIs object detection and classification tasks.

Hyperspectral Image Denoising Image Denoising +2

Surrogate-assisted Particle Swarm Optimisation for Evolving Variable-length Transferable Blocks for Image Classification

no code implementations3 Jul 2020 Bin Wang, Bing Xue, Mengjie Zhang

A new effective and efficient surrogate-assisted particle swarm optimisation algorithm is proposed to automatically evolve convolutional neural networks.

General Classification Image Classification +1

Relatedness Measures to Aid the Transfer of Building Blocks among Multiple Tasks

no code implementations8 May 2020 Trung B. Nguyen, Will N. Browne, Mengjie Zhang

This paper seeks to facilitate the automation of feature transferring in between tasks by utilising the observed list.

Classification General Classification +1

ArcText: A Unified Text Approach to Describing Convolutional Neural Network Architectures

no code implementations16 Feb 2020 Yanan Sun, Ziyao Ren, Gary G. Yen, Bing Xue, Mengjie Zhang, Jiancheng Lv

Data mining on existing CNN can discover useful patterns and fundamental sub-comments from their architectures, providing researchers with strong prior knowledge to design proper CNN architectures when they have no expertise in CNNs.

An Adaptive and Near Parameter-free Evolutionary Computation Approach Towards True Automation in AutoML

1 code implementation28 Jan 2020 Benjamin Patrick Evans, Bing Xue, Mengjie Zhang

We apply this to the area of automated machine learning (by extending TPOT), to produce pipelines which can effectively be claimed to be free from human input, and show that the results are competitive with existing state-of-the-art which use hand-selected hyperparameter values.

AutoML

Genetic Programming for Evolving a Front of Interpretable Models for Data Visualisation

1 code implementation27 Jan 2020 Andrew Lensen, Bing Xue, Mengjie Zhang

Many domains require an understanding of the data in terms of the original features; there is hence a need for powerful visualisation methods which use understandable models.

Improving generalisation of AutoML systems with dynamic fitness evaluations

no code implementations23 Jan 2020 Benjamin Patrick Evans, Bing Xue, Mengjie Zhang

A common problem machine learning developers are faced with is overfitting, that is, fitting a pipeline too closely to the training data that the performance degrades for unseen data.

AutoML BIG-bench Machine Learning

Multi-Objective Genetic Programming for Manifold Learning: Balancing Quality and Dimensionality

no code implementations5 Jan 2020 Andrew Lensen, Mengjie Zhang, Bing Xue

This method required the dimensionality of the embedding to be known a priori, which makes it hard to use when little is known about a dataset.

Genetic Programming Hyper-Heuristics with Vehicle Collaboration for Uncertain Capacitated Arc Routing Problems

no code implementations20 Nov 2019 Jordan MacLachlan, Yi Mei, Juergen Branke, Mengjie Zhang

Due to its direct relevance to post-disaster operations, meter reading and civil refuse collection, the Uncertain Capacitated Arc Routing Problem (UCARP) is an important optimisation problem.

Meter Reading

Genetic Programming for Evolving Similarity Functions for Clustering: Representations and Analysis

no code implementations22 Oct 2019 Andrew Lensen, Bing Xue, Mengjie Zhang

In this paper, we propose a new approach to automatically evolving similarity functions for a given clustering algorithm by using genetic programming.

Clustering feature selection

Genetic Programming and Gradient Descent: A Memetic Approach to Binary Image Classification

1 code implementation28 Sep 2019 Benjamin Patrick Evans, Harith Al-Sahaf, Bing Xue, Mengjie Zhang

Image classification is an essential task in computer vision, which aims to categorise a set of images into different groups based on some visual criteria.

Binary Classification Classification +2

Particle Swarm Optimisation for Evolving Deep Neural Networks for Image Classification by Evolving and Stacking Transferable Blocks

no code implementations29 Jul 2019 Bin Wang, Bing Xue, Mengjie Zhang

Deep Convolutional Neural Networks (CNNs) have been widely used in image classification tasks, but the process of designing CNN architectures is very complex, so Neural Architecture Search (NAS), automatically searching for optimal CNN architectures, has attracted more and more research interests.

Classification General Classification +3

Evolving Deep Neural Networks by Multi-objective Particle Swarm Optimization for Image Classification

1 code implementation21 Mar 2019 Bin Wang, Yanan sun, Bing Xue, Mengjie Zhang

In recent years, convolutional neural networks (CNNs) have become deeper in order to achieve better classification accuracy in image classification.

Classification General Classification +1

A Hybrid GA-PSO Method for Evolving Architecture and Short Connections of Deep Convolutional Neural Networks

no code implementations10 Mar 2019 Bin Wang, Yanan sun, Bing Xue, Mengjie Zhang

Three major contributions of this work are: Firstly, a new encoding strategy is proposed to encode a CNN, where the architecture and the shortcut connections are encoded separately; Secondly, a hybrid two-level EC method, which combines particle swarm optimisation and genetic algorithms, is developed to search for the optimal CNNs; Lastly, an adjustable learning rate is introduced for the fitness evaluations, which provides a better learning rate for the training process given a fixed number of epochs.

General Classification Image Classification

Can Genetic Programming Do Manifold Learning Too?

no code implementations8 Feb 2019 Andrew Lensen, Bing Xue, Mengjie Zhang

Exploratory data analysis is a fundamental aspect of knowledge discovery that aims to find the main characteristics of a dataset.

Dimensionality Reduction

Automatically Evolving CNN Architectures Based on Blocks

no code implementations28 Oct 2018 Yanan Sun, Bing Xue, Mengjie Zhang, Gary G. Yen

The proposed algorithm is evaluated on CIFAR10 and CIFAR100 against 18 state-of-the-art peer competitors.

General Classification

Effective Exploration for Deep Reinforcement Learning via Bootstrapped Q-Ensembles under Tsallis Entropy Regularization

no code implementations2 Sep 2018 Gang Chen, Yiming Peng, Mengjie Zhang

With the aim of improving sample efficiency and learning performance, we will develop a new DRL algorithm in this paper that seamless integrates entropy-induced and bootstrap-induced techniques for efficient and deep exploration of the learning environment.

Reinforcement Learning (RL)

A Hybrid Differential Evolution Approach to Designing Deep Convolutional Neural Networks for Image Classification

no code implementations20 Aug 2018 Bin Wang, Yanan sun, Bing Xue, Mengjie Zhang

In this paper, a new hybrid differential evolution (DE) algorithm with a newly added crossover operator is proposed to evolve the architectures of CNNs of any lengths, which is named DECNN.

General Classification Image Classification

Automatically designing CNN architectures using genetic algorithm for image classification

4 code implementations11 Aug 2018 Yanan Sun, Bing Xue, Mengjie Zhang, Gary G. Yen

Convolutional Neural Networks (CNNs) have gained a remarkable success on many image classification tasks in recent years.

Classification General Classification +1

An Adaptive Clipping Approach for Proximal Policy Optimization

no code implementations17 Apr 2018 Gang Chen, Yiming Peng, Mengjie Zhang

While PPO is inspired by the same learning theory that justifies trust region policy optimization (TRPO), PPO substantially simplifies algorithm design and improves data efficiency by performing multiple epochs of \emph{clipped policy optimization} from sampled data.

Learning Theory

Evolving Deep Convolutional Neural Networks by Variable-length Particle Swarm Optimization for Image Classification

no code implementations17 Mar 2018 Bin Wang, Yanan sun, Bing Xue, Mengjie Zhang

Convolutional neural networks (CNNs) are one of the most effective deep learning methods to solve image classification problems, but the best architecture of a CNN to solve a specific problem can be extremely complicated and hard to design.

General Classification Image Classification

Generating Redundant Features with Unsupervised Multi-Tree Genetic Programming

no code implementations2 Feb 2018 Andrew Lensen, Bing Xue, Mengjie Zhang

Recently, feature selection has become an increasingly important area of research due to the surge in high-dimensional datasets in all areas of modern life.

feature selection

A Particle Swarm Optimization-based Flexible Convolutional Auto-Encoder for Image Classification

1 code implementation13 Dec 2017 Yanan Sun, Bing Xue, Mengjie Zhang, Gary G. Yen

Convolutional auto-encoders have shown their remarkable performance in stacking to deep convolutional neural networks for classifying image data during past several years.

General Classification Image Classification

Evolving Deep Convolutional Neural Networks for Image Classification

1 code implementation30 Oct 2017 Yanan Sun, Bing Xue, Mengjie Zhang, Gary G. Yen

Evolutionary computation methods have been successfully applied to neural networks since two decades ago, while those methods cannot scale well to the modern deep neural networks due to the complicated architectures and large quantities of connection weights.

Classification General Classification +1

Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation

2 code implementations12 Jul 2016 Muhammad Ghifary, W. Bastiaan Kleijn, Mengjie Zhang, David Balduzzi, Wen Li

In this paper, we propose a novel unsupervised domain adaptation algorithm based on deep learning for visual object recognition.

Classification General Classification +2

Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalization

no code implementations15 Oct 2015 Muhammad Ghifary, David Balduzzi, W. Bastiaan Kleijn, Mengjie Zhang

We propose Scatter Component Analyis (SCA), a fast representation learning algorithm that can be applied to both domain adaptation and domain generalization.

Domain Generalization General Classification +2

Domain Generalization for Object Recognition with Multi-task Autoencoders

3 code implementations ICCV 2015 Muhammad Ghifary, W. Bastiaan Kleijn, Mengjie Zhang, David Balduzzi

The problem of domain generalization is to take knowledge acquired from a number of related domains where training data is available, and to then successfully apply it to previously unseen domains.

Denoising Domain Generalization +2

Domain Adaptive Neural Networks for Object Recognition

no code implementations21 Sep 2014 Muhammad Ghifary, W. Bastiaan Kleijn, Mengjie Zhang

We propose a simple neural network model to deal with the domain adaptation problem in object recognition.

Denoising Domain Adaptation +2

Cannot find the paper you are looking for? You can Submit a new open access paper.