Search Results for author: Anton Tsitsulin

Found 21 papers, 10 papers with code

Let Your Graph Do the Talking: Encoding Structured Data for LLMs

no code implementations8 Feb 2024 Bryan Perozzi, Bahare Fatemi, Dustin Zelle, Anton Tsitsulin, Mehran Kazemi, Rami Al-Rfou, Jonathan Halcrow

How can we best encode structured data into sequential form for use in large language models (LLMs)?

The Graph Lottery Ticket Hypothesis: Finding Sparse, Informative Graph Structure

no code implementations8 Dec 2023 Anton Tsitsulin, Bryan Perozzi

Subsequently, we define the notion of a "winning ticket" for graph structure - an extremely sparse subset of edges that can deliver a robust approximation of the entire graph's performance.

Graph Learning

UGSL: A Unified Framework for Benchmarking Graph Structure Learning

1 code implementation21 Aug 2023 Bahare Fatemi, Sami Abu-El-Haija, Anton Tsitsulin, Mehran Kazemi, Dustin Zelle, Neslihan Bulut, Jonathan Halcrow, Bryan Perozzi

We implement a wide range of existing models in our framework and conduct extensive analyses of the effectiveness of different components in the framework.

Benchmarking Graph structure learning

HUGE: Huge Unsupervised Graph Embeddings with TPUs

no code implementations26 Jul 2023 Brandon Mayer, Anton Tsitsulin, Hendrik Fichtenberger, Jonathan Halcrow, Bryan Perozzi

A high-performance graph embedding architecture leveraging Tensor Processing Units (TPUs) with configurable amounts of high-bandwidth memory is presented that simplifies the graph embedding problem and can scale to graphs with billions of nodes and trillions of edges.

Graph Embedding Link Prediction

Examining the Effects of Degree Distribution and Homophily in Graph Learning Models

1 code implementation17 Jul 2023 Mustafa Yasir, John Palowitch, Anton Tsitsulin, Long Tran-Thanh, Bryan Perozzi

In this work we examine how two additional synthetic graph generators can improve GraphWorld's evaluation; LFR, a well-established model in the graph clustering literature and CABAM, a recent adaptation of the Barabasi-Albert model tailored for GNN benchmarking.

Benchmarking Graph Clustering +3

Unsupervised Embedding Quality Evaluation

no code implementations26 May 2023 Anton Tsitsulin, Marina Munkhoeva, Bryan Perozzi

Unsupervised learning has recently significantly gained in popularity, especially with deep learning-based approaches.

Self-Supervised Learning

On Classification Thresholds for Graph Attention with Edge Features

no code implementations18 Oct 2022 Kimon Fountoulakis, Dake He, Silvio Lattanzi, Bryan Perozzi, Anton Tsitsulin, Shenghao Yang

In CSBM the nodes and edge features are obtained from a mixture of Gaussians and the edges from a stochastic block model.

Classification Graph Attention +2

Differentially Private Graph Learning via Sensitivity-Bounded Personalized PageRank

1 code implementation14 Jul 2022 Alessandro Epasto, Vahab Mirrokni, Bryan Perozzi, Anton Tsitsulin, Peilin Zhong

Personalized PageRank (PPR) is a fundamental tool in unsupervised learning of graph representations such as node ranking, labeling, and graph embedding.

Graph Embedding Graph Learning +1

Tackling Provably Hard Representative Selection via Graph Neural Networks

1 code implementation20 May 2022 Mehran Kazemi, Anton Tsitsulin, Hossein Esfandiari, Mohammadhossein Bateni, Deepak Ramachandran, Bryan Perozzi, Vahab Mirrokni

Representative Selection (RS) is the problem of finding a small subset of exemplars from a dataset that is representative of the dataset.

Active Learning Data Compression +1

Synthetic Graph Generation to Benchmark Graph Learning

1 code implementation4 Apr 2022 Anton Tsitsulin, Benedek Rozemberczki, John Palowitch, Bryan Perozzi

This shockingly small sample size (~10) allows for only limited scientific insight into the problem.

Graph Generation Graph Learning +2

GraphWorld: Fake Graphs Bring Real Insights for GNNs

1 code implementation28 Feb 2022 John Palowitch, Anton Tsitsulin, Brandon Mayer, Bryan Perozzi

Using GraphWorld, a user has fine-grained control over graph generator parameters, and can benchmark arbitrary GNN models with built-in hyperparameter tuning.

Benchmarking

GRASP: Graph Alignment through Spectral Signatures

no code implementations10 Jun 2021 Judith Hermanns, Anton Tsitsulin, Marina Munkhoeva, Alex Bronstein, Davide Mottin, Panagiotis Karras

In this paper, we transfer the shape-analysis concept of functional maps from the continuous to the discrete case, and treat the graph alignment problem as a special case of the problem of finding a mapping between functions on graphs.

InstantEmbedding: Efficient Local Node Representations

no code implementations14 Oct 2020 Ştefan Postăvaru, Anton Tsitsulin, Filipe Miguel Gonçalves de Almeida, Yingtao Tian, Silvio Lattanzi, Bryan Perozzi

In this paper, we introduce InstantEmbedding, an efficient method for generating single-node representations using local PageRank computations.

Link Prediction Node Classification +1

Graph Clustering with Graph Neural Networks

no code implementations NeurIPS 2023 Anton Tsitsulin, John Palowitch, Bryan Perozzi, Emmanuel Müller

Graph Neural Networks (GNNs) have achieved state-of-the-art results on many graph analysis tasks such as node classification and link prediction.

Attribute Clustering +3

FREDE: Anytime Graph Embeddings

no code implementations8 Jun 2020 Anton Tsitsulin, Marina Munkhoeva, Davide Mottin, Panagiotis Karras, Ivan Oseledets, Emmanuel Müller

Low-dimensional representations, or embeddings, of a graph's nodes facilitate several practical data science and data engineering tasks.

Graph Embedding

The Shape of Data: Intrinsic Distance for Data Distributions

2 code implementations ICLR 2020 Anton Tsitsulin, Marina Munkhoeva, Davide Mottin, Panagiotis Karras, Alex Bronstein, Ivan Oseledets, Emmanuel Müller

The ability to represent and compare machine learning models is crucial in order to quantify subtle model changes, evaluate generative models, and gather insights on neural network architectures.

SGR: Self-Supervised Spectral Graph Representation Learning

no code implementations15 Nov 2018 Anton Tsitsulin, Davide Mottin, Panagiotis Karras, Alex Bronstein, Emmanuel Müller

Representing a graph as a vector is a challenging task; ideally, the representation should be easily computable and conducive to efficient comparisons among graphs, tailored to the particular data and analytical task at hand.

Graph Representation Learning

NetLSD: Hearing the Shape of a Graph

1 code implementation27 May 2018 Anton Tsitsulin, Davide Mottin, Panagiotis Karras, Alex Bronstein, Emmanuel Müller

However, it is a hard task in terms of the expressiveness of the employed similarity measure and the efficiency of its computation.

Social and Information Networks

VERSE: Versatile Graph Embeddings from Similarity Measures

2 code implementations13 Mar 2018 Anton Tsitsulin, Davide Mottin, Panagiotis Karras, Emmanuel Müller

Embedding a web-scale information network into a low-dimensional vector space facilitates tasks such as link prediction, classification, and visualization.

Link Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.