Search Results for author: Xiaowen Dong

Found 52 papers, 18 papers with code

Maximum Likelihood Estimation on Stochastic Blockmodels for Directed Graph Clustering

1 code implementation28 Mar 2024 Mihai Cucuringu, Xiaowen Dong, Ning Zhang

This paper studies the directed graph clustering problem through the lens of statistics, where we formulate clustering as estimating underlying communities in the directed stochastic block model (DSBM).

Clustering Graph Clustering +1

STEntConv: Predicting Disagreement with Stance Detection and a Signed Graph Convolutional Network

1 code implementation23 Mar 2024 Isabelle Lorge, Li Zhang, Xiaowen Dong, Janet B. Pierrehumbert

The rise of social media platforms has led to an increase in polarised online discussions, especially on political and socio-cultural topics such as elections and climate change.

Stance Detection

Rough Transformers for Continuous and Efficient Time-Series Modelling

no code implementations15 Mar 2024 Fernando Moreno-Pino, Álvaro Arroyo, Harrison Waldon, Xiaowen Dong, Álvaro Cartea

To mitigate this, we introduce the Rough Transformer, a variation of the Transformer model which operates on continuous-time representations of input sequences and incurs significantly reduced computational costs, critical for addressing long-range dependencies common in medical contexts.

Time Series

Decentralized and Lifelong-Adaptive Multi-Agent Collaborative Learning

no code implementations11 Mar 2024 Shuo Tang, Rui Ye, Chenxin Xu, Xiaowen Dong, Siheng Chen, Yanfeng Wang

In this paper, we propose DeLAMA, a decentralized multi-agent lifelong collaborative learning algorithm with dynamic collaboration graphs.

Computational Efficiency Graph structure learning

Hypergraph Node Classification With Graph Neural Networks

no code implementations8 Feb 2024 Bohan Tang, Zexi Liu, Keyue Jiang, Siheng Chen, Xiaowen Dong

However, in this paper, we theoretically demonstrate that, in the context of node classification, most HyperGNNs can be approximated using a GNN with a weighted clique expansion of the hypergraph.

Classification Node Classification

A Characterization Theorem for Equivariant Networks with Point-wise Activations

no code implementations17 Jan 2024 Marco Pacini, Xiaowen Dong, Bruno Lepri, Gabriele Santin

Equivariant neural networks have shown improved performance, expressiveness and sample complexity on symmetrical domains.

Hypergraph Transformer for Semi-Supervised Classification

1 code implementation18 Dec 2023 Zexi Liu, Bohan Tang, Ziyuan Ye, Xiaowen Dong, Siheng Chen, Yanfeng Wang

Hypergraphs play a pivotal role in the modelling of data featuring higher-order relations involving more than two entities.

Classification Node Classification +1

Hypergraph-MLP: Learning on Hypergraphs without Message Passing

1 code implementation15 Dec 2023 Bohan Tang, Siheng Chen, Xiaowen Dong

Hypergraphs are vital in modelling data with higher-order relations containing more than two entities, gaining prominence in machine learning and signal processing.

Node Classification Representation Learning

Gromov-Hausdorff Distances for Comparing Product Manifolds of Model Spaces

no code implementations9 Sep 2023 Haitz Saez de Ocariz Borde, Alvaro Arroyo, Ismael Morales, Ingmar Posner, Xiaowen Dong

Recent studies propose enhancing machine learning models by aligning the geometric characteristics of the latent space with the underlying data structure.

Hypergraph Structure Inference From Data Under Smoothness Prior

no code implementations27 Aug 2023 Bohan Tang, Siheng Chen, Xiaowen Dong

However, existing methods either adopt simple pre-defined rules that fail to precisely capture the distribution of the potential hypergraph structure, or learn a mapping between hypergraph structures and node features but require a large amount of labelled data, i. e., pre-existing hypergraph structures, for training.

Learning to Learn Financial Networks for Optimising Momentum Strategies

no code implementations23 Aug 2023 Xingyue, Pu, Stefan Zohren, Stephen Roberts, Xiaowen Dong

Network momentum provides a novel type of risk premium, which exploits the interconnections among assets in a financial network to predict future returns.

Network Momentum across Asset Classes

no code implementations22 Aug 2023 Xingyue, Pu, Stephen Roberts, Xiaowen Dong, Stefan Zohren

We investigate the concept of network momentum, a novel trading signal derived from momentum spillover across assets.

Graph Learning

Wisdom of the Crowds or Ignorance of the Masses? A data-driven guide to WSB

no code implementations18 Aug 2023 Valentina Semenova, Dragos Gorduza, William Wildi, Xiaowen Dong, Stefan Zohren

Our initial experiments decompose the forum using a large language topic model and network tools.

Graph Neural Networks for Forecasting Multivariate Realized Volatility with Spillover Effects

no code implementations1 Aug 2023 Chao Zhang, Xingyue Pu, Mihai Cucuringu, Xiaowen Dong

We present a novel methodology for modeling and forecasting multivariate realized volatilities using customized graph neural networks to incorporate spillover effects across stocks.

On the Impact of Sample Size in Reconstructing Graph Signals

no code implementations1 Jul 2023 Baskaran Sripathmanathan, Xiaowen Dong, Michael Bronstein

We show that under the setting of noisy observation and least-squares reconstruction this is not always the case, characterising the behaviour both theoretically and experimentally.

Structure-Aware Robustness Certificates for Graph Classification

1 code implementation20 Jun 2023 Pierre Osselin, Henry Kenlay, Xiaowen Dong

Certifying the robustness of a graph-based machine learning model poses a critical challenge for safety.

Graph Classification

DRew: Dynamically Rewired Message Passing with Delay

1 code implementation13 May 2023 Benjamin Gutteridge, Xiaowen Dong, Michael Bronstein, Francesco Di Giovanni

Message passing neural networks (MPNNs) have been shown to suffer from the phenomenon of over-squashing that causes poor performance for tasks relying on long-range interactions.

Graph Classification Graph Regression +3

Transductive Kernels for Gaussian Processes on Graphs

no code implementations28 Nov 2022 Yin-Cong Zhi, Felix L. Opolka, Yin Cheng Ng, Pietro Liò, Xiaowen Dong

To address this, we present a novel, generalized kernel for graphs with node feature data for semi-supervised learning.

Gaussian Processes

Learning Hypergraphs From Signals With Dual Smoothness Prior

no code implementations3 Nov 2022 Bohan Tang, Siheng Chen, Xiaowen Dong

Hypergraph structure learning, which aims to learn the hypergraph structures from the observed signals to capture the intrinsic high-order relationships among the entities, becomes crucial when a hypergraph topology is not readily available in the datasets.

Unrolled Graph Learning for Multi-Agent Collaboration

no code implementations31 Oct 2022 Enpei Zhang, Shuo Tang, Xiaowen Dong, Siheng Chen, Yanfeng Wang

To fill this gap, we propose a distributed multi-agent learning model inspired by human collaboration, in which the agents can autonomously detect suitable collaborators and refer to collaborators' model for better performance.

Graph Learning Rolling Shutter Correction

Learning to Infer Structures of Network Games

no code implementations16 Jun 2022 Emanuele Rossi, Federico Monti, Yan Leng, Michael M. Bronstein, Xiaowen Dong

We adopt a transformer-like architecture which correctly accounts for the symmetries of the problem and learns a mapping from the equilibrium actions to the network structure of the game without explicit knowledge of the utility function.

Graph similarity learning for change-point detection in dynamic networks

no code implementations29 Mar 2022 Deborah Sulem, Henry Kenlay, Mihai Cucuringu, Xiaowen Dong

The main novelty of our method is to use a siamese graph neural network architecture for learning a data-driven graph similarity function, which allows to effectively compare the current graph and its recent history.

Change Point Detection Fraud Detection +2

Local2Global: A distributed approach for scaling representation learning on graphs

1 code implementation12 Jan 2022 Lucas G. S. Jeub, Giovanni Colavizza, Xiaowen Dong, Marya Bazzi, Mihai Cucuringu

Our local2global approach proceeds by first dividing the input graph into overlapping subgraphs (or "patches") and training local representations for each patch independently.

Anomaly Detection Graph Representation Learning

Adversarial Attacks on Graph Classifiers via Bayesian Optimisation

1 code implementation NeurIPS 2021 Xingchen Wan, Henry Kenlay, Robin Ru, Arno Blaas, Michael Osborne, Xiaowen Dong

While the majority of the literature focuses on such vulnerability in node-level classification tasks, little effort has been dedicated to analysing adversarial attacks on graph-level classification, an important problem with numerous real-life applications such as biochemistry and social network analysis.

Adversarial Robustness Bayesian Optimisation +1

On the Unreasonable Effectiveness of Feature propagation in Learning on Graphs with Missing Node Features

1 code implementation23 Nov 2021 Emanuele Rossi, Henry Kenlay, Maria I. Gorinova, Benjamin Paul Chamberlain, Xiaowen Dong, Michael Bronstein

While Graph Neural Networks (GNNs) have recently become the de facto standard for modeling relational data, they impose a strong assumption on the availability of the node or edge features of the graph.

Node Classification

Adversarial Attacks on Graph Classification via Bayesian Optimisation

1 code implementation4 Nov 2021 Xingchen Wan, Henry Kenlay, Binxin Ru, Arno Blaas, Michael A. Osborne, Xiaowen Dong

While the majority of the literature focuses on such vulnerability in node-level classification tasks, little effort has been dedicated to analysing adversarial attacks on graph-level classification, an important problem with numerous real-life applications such as biochemistry and social network analysis.

Adversarial Robustness Bayesian Optimisation +1

Adaptive Gaussian Processes on Graphs via Spectral Graph Wavelets

no code implementations25 Oct 2021 Felix L. Opolka, Yin-Cong Zhi, Pietro Liò, Xiaowen Dong

Graph-based models require aggregating information in the graph from neighbourhoods of different sizes.

Gaussian Processes

Learning to Learn Graph Topologies

1 code implementation NeurIPS 2021 Xingyue Pu, Tianyue Cao, Xiaoyun Zhang, Xiaowen Dong, Siheng Chen

The model is trained in an end-to-end fashion with pairs of node data and graph samples.

Beltrami Flow and Neural Diffusion on Graphs

1 code implementation NeurIPS 2021 Benjamin Paul Chamberlain, James Rowbottom, Davide Eynard, Francesco Di Giovanni, Xiaowen Dong, Michael M Bronstein

We propose a novel class of graph neural networks based on the discretised Beltrami flow, a non-Euclidean diffusion PDE.

Learning to Infer the Structure of Network Games

no code implementations29 Sep 2021 Emanuele Rossi, Federico Monti, Yan Leng, Michael M. Bronstein, Xiaowen Dong

Strategic interactions between a group of individuals or organisations can be modelled as games played on networks, where a player's payoff depends not only on their actions but also on those of their neighbors.

Local2Global: Scaling global representation learning on graphs via local training

2 code implementations26 Jul 2021 Lucas G. S. Jeub, Giovanni Colavizza, Xiaowen Dong, Marya Bazzi, Mihai Cucuringu

Our local2global approach proceeds by first dividing the input graph into overlapping subgraphs (or "patches") and training local representations for each patch independently.

Graph Reconstruction Graph Representation Learning +2

Modeling Ideological Salience and Framing in Polarized Online Groups with Graph Neural Networks and Structured Sparsity

1 code implementation Findings (NAACL) 2022 Valentin Hofmann, Xiaowen Dong, Janet B. Pierrehumbert, Hinrich Schütze

The increasing polarization of online political discourse calls for computational tools that automatically detect and monitor ideological divides in social media.

Interpretable Stability Bounds for Spectral Graph Filters

no code implementations18 Feb 2021 Henry Kenlay, Dorina Thanou, Xiaowen Dong

In this paper, we study filter stability and provide a novel and interpretable upper bound on the change of filter output, where the bound is expressed in terms of the endpoint degrees of the deleted and newly added edges, as well as the spatial proximity of those edges.

Anomaly Detection Denoising

On the Stability of Graph Convolutional Neural Networks under Edge Rewiring

no code implementations ICLR Workshop GTRL 2021 Henry Kenlay, Dorina Thanou, Xiaowen Dong

Graph neural networks are experiencing a surge of popularity within the machine learning community due to their ability to adapt to non-Euclidean domains and instil inductive biases.

Kernel-based Graph Learning from Smooth Signals: A Functional Viewpoint

no code implementations23 Aug 2020 Xingyue Pu, Siu Lun Chau, Xiaowen Dong, Dino Sejdinovic

In this paper, we propose a novel graph learning framework that incorporates the node-side and observation-side information, and in particular the covariates that help to explain the dependency structures in graph signals.

Graph Learning

Graph signal processing for machine learning: A review and new perspectives

no code implementations31 Jul 2020 Xiaowen Dong, Dorina Thanou, Laura Toni, Michael Bronstein, Pascal Frossard

The effective representation, processing, analysis, and visualization of large-scale structured data, especially those related to complex domains such as networks and graphs, are one of the key questions in modern machine learning.

BIG-bench Machine Learning Computational Efficiency

Interpretable Neural Architecture Search via Bayesian Optimisation with Weisfeiler-Lehman Kernels

1 code implementation ICLR 2021 Binxin Ru, Xingchen Wan, Xiaowen Dong, Michael Osborne

Our method optimises the architecture in a highly data-efficient manner: it is capable of capturing the topological structures of the architectures and is scalable to large graphs, thus making the high-dimensional and graph-like search spaces amenable to BO.

Bayesian Optimisation Neural Architecture Search

Gaussian Processes on Graphs via Spectral Kernel Learning

no code implementations12 Jun 2020 Yin-Cong Zhi, Yin Cheng Ng, Xiaowen Dong

We propose a graph spectrum-based Gaussian process for prediction of signals defined on nodes of the graph.

Gaussian Processes

A Maximum Entropy approach to Massive Graph Spectra

no code implementations19 Dec 2019 Diego Granziol, Robin Ru, Stefan Zohren, Xiaowen Dong, Michael Osborne, Stephen Roberts

Graph spectral techniques for measuring graph similarity, or for learning the cluster number, require kernel smoothing.

Graph Similarity

Laplacian-regularized graph bandits: Algorithms and theoretical analysis

no code implementations12 Jul 2019 Kaige Yang, Xiaowen Dong, Laura Toni

In terms of network regret (sum of cumulative regret over $n$ users), the proposed algorithm leads to a scaling as $\tilde{\mathcal{O}}(\Psi d\sqrt{nT})$, which is a significant improvement over $\tilde{\mathcal{O}}(nd\sqrt{T})$ in the state-of-the-art algorithm \algo{Gob. Lin} \Ccite{cesa2013gang}.

Error Analysis on Graph Laplacian Regularized Estimator

no code implementations11 Feb 2019 Kaige Yang, Xiaowen Dong, Laura Toni

We provide a theoretical analysis of the representation learning problem aimed at learning the latent variables (design matrix) $\Theta$ of observations $Y$ with the knowledge of the coefficient matrix $X$.

Representation Learning

Learning Quadratic Games on Networks

no code implementations ICML 2020 Yan Leng, Xiaowen Dong, Junfeng Wu, Alex Pentland

Individuals, or organizations, cooperate with or compete against one another in a wide range of practical situations.

Learning graphs from data: A signal representation perspective

no code implementations3 Jun 2018 Xiaowen Dong, Dorina Thanou, Michael Rabbat, Pascal Frossard

The construction of a meaningful graph topology plays a crucial role in the effective representation, processing, analysis and visualization of structured data.

Graph Learning

Entropic Spectral Learning for Large-Scale Graphs

no code implementations18 Apr 2018 Diego Granziol, Binxin Ru, Stefan Zohren, Xiaowen Dong, Michael Osborne, Stephen Roberts

Graph spectra have been successfully used to classify network types, compute the similarity between graphs, and determine the number of communities in a network.

Community Detection

Learning heat diffusion graphs

no code implementations4 Nov 2016 Dorina Thanou, Xiaowen Dong, Daniel Kressner, Pascal Frossard

Effective information analysis generally boils down to properly identifying the structure or geometry of the data, which is often represented by a graph.

Graph Learning

Multi-modal image retrieval with random walk on multi-layer graphs

no code implementations12 Jul 2016 Renata Khasanova, Xiaowen Dong, Pascal Frossard

The analysis of large collections of image data is still a challenging problem due to the difficulty of capturing the true concepts in visual data.

Image Retrieval Retrieval

Learning Laplacian Matrix in Smooth Graph Signal Representations

2 code implementations30 Jun 2014 Xiaowen Dong, Dorina Thanou, Pascal Frossard, Pierre Vandergheynst

We show that the Gaussian prior leads to an efficient representation that favors the smoothness property of the graph signals.

Graph Learning

Multiscale Event Detection in Social Media

no code implementations25 Apr 2014 Xiaowen Dong, Dimitrios Mavroeidis, Francesco Calabrese, Pascal Frossard

In this paper, we propose a novel approach towards multiscale event detection using social media data, which takes into account different temporal and spatial scales of events in the data.

Clustering Event Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.