Search Results for author: Andrei Kucharavy

Found 11 papers, 4 papers with code

LLMs Perform Poorly at Concept Extraction in Cyber-security Research Literature

no code implementations12 Dec 2023 Maxime Würsch, Andrei Kucharavy, Dimitri Percia David, Alain Mermoud

The results suggest that LLMs do not produce good knowledge entities that reflect the cybersecurity context, but our results show some potential for noun extractors.

Evolutionary Algorithms in the Light of SGD: Limit Equivalence, Minima Flatness, and Transfer Learning

no code implementations20 May 2023 Andrei Kucharavy, Rachid Guerraoui, Ljiljana Dolamic

In this paper, we show that a class of evolutionary algorithms (EAs) inspired by the Gillespie-Orr Mutational Landscapes model for natural evolution is formally equivalent to SGD in certain settings and, in practice, is well adapted to large ANNs.

Evolutionary Algorithms Transfer Learning

Byzantine-Resilient Learning Beyond Gradients: Distributing Evolutionary Search

no code implementations20 Apr 2023 Andrei Kucharavy, Matteo Monti, Rachid Guerraoui, Ljiljana Dolamic

We then leverage this definition to show that a general class of gradient-free ML algorithms - ($1,\lambda$)-Evolutionary Search - can be combined with classical distributed consensus algorithms to generate gradient-free byzantine-resilient distributed learning algorithms.

Stochastic Parrots Looking for Stochastic Parrots: LLMs are Easy to Fine-Tune and Hard to Detect with other LLMs

1 code implementation18 Apr 2023 Da Silva Gameiro Henrique, Andrei Kucharavy, Rachid Guerraoui

This prominence amplified prior concerns regarding the misuse of LLMs and led to the emergence of numerous tools to detect LLMs in the wild.

Fundamentals of Generative Large Language Models and Perspectives in Cyber-Defense

no code implementations21 Mar 2023 Andrei Kucharavy, Zachary Schillaci, Loïc Maréchal, Maxime Würsch, Ljiljana Dolamic, Remi Sabonnadiere, Dimitri Percia David, Alain Mermoud, Vincent Lenders

Generative Language Models gained significant attention in late 2022 / early 2023, notably with the introduction of models refined to act consistently with users' expectations of interactions with AI (conversational models).

Needle In A Haystack, Fast: Benchmarking Image Perceptual Similarity Metrics At Scale

1 code implementation1 Jun 2022 Cyril Vallez, Andrei Kucharavy, Ljiljana Dolamic

The advent of the internet, followed shortly by the social media made it ubiquitous in consuming and sharing information between anyone with access to it.

Benchmarking

Evolutionary perspective on model fine-tuning

no code implementations29 Sep 2021 Andrei Kucharavy, Ljiljana Dolamic, Rachid Guerraoui

Be it in natural language generation or in the image generation, massive performances gains have been achieved in the last years.

BIG-bench Machine Learning Image Generation +1

Host-Pathongen Co-evolution Inspired Algorithm Enables Robust GAN Training

1 code implementation22 May 2020 Andrei Kucharavy, El Mahdi El Mhamdi, Rachid Guerraoui

Generative adversarial networks (GANs) are pairs of artificial neural networks that are trained one against each other.

The Probabilistic Fault Tolerance of Neural Networks in the Continuous Limit

3 code implementations ICLR 2020 El-Mahdi El-Mhamdi, Rachid Guerraoui, Andrei Kucharavy, Sergei Volodin

We study fault tolerance of neural networks subject to small random neuron/weight crash failures in a probabilistic setting.

Cannot find the paper you are looking for? You can Submit a new open access paper.