Search Results for author: Mohamed Elsayed

Found 8 papers, 4 papers with code

Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning

1 code implementation31 Mar 2024 Mohamed Elsayed, A. Rupam Mahmood

Deep representation learning methods struggle with continual learning, suffering from both catastrophic forgetting of useful units and loss of plasticity, often due to rigid and unuseful units.

Continual Learning Representation Learning

Utility-based Perturbed Gradient Descent: An Optimizer for Continual Learning

no code implementations7 Feb 2023 Mohamed Elsayed, A. Rupam Mahmood

Modern representation learning methods often struggle to adapt quickly under non-stationarity because they suffer from catastrophic forgetting and decaying plasticity.

Continual Learning Representation Learning

HesScale: Scalable Computation of Hessian Diagonals

1 code implementation20 Oct 2022 Mohamed Elsayed, A. Rupam Mahmood

Second-order optimization uses curvature information about the objective function, which can help in faster convergence.

Hybrid-Layers Neural Network Architectures for Modeling the Self-Interference in Full-Duplex Systems

no code implementations18 Oct 2021 Mohamed Elsayed, Ahmad A. Aziz El-Banna, Octavia A. Dobre, Wanyi Shiu, Peiwei Wang

In contrast to the state-of-the-art NNs that employ dense or recurrent layers for SI modeling, the proposed NNs exploit, in a novel manner, a combination of different hidden layers (e. g., convolutional, recurrent, and/or dense) in order to model the SI with lower computational complexity than the polynomial and the state-of-the-art NN-based cancelers.

Autonomous object harvesting using synchronized optoelectronic microrobots

no code implementations8 Mar 2021 Christopher Bendkowski, Laurent Mennillo, Tao Xu, Mohamed Elsayed, Filip Stojic, Harrison Edwards, Shuailong Zhang, Cindi Morshead, Vijay Pawar, Aaron R. Wheeler, Danail Stoyanov, Michael Shaw

Optoelectronic tweezer-driven microrobots (OETdMs) are a versatile micromanipulation technology based on the use of light induced dielectrophoresis to move small dielectric structures (microrobots) across a photoconductive substrate.

Cultural Vocal Bursts Intensity Prediction Object

Low Complexity Neural Network Structures for Self-Interference Cancellation in Full-Duplex Radio

no code implementations23 Sep 2020 Mohamed Elsayed, Ahmad A. Aziz El-Banna, Octavia A. Dobre, Wanyi Shiu, Peiwei Wang

The core idea of these two structures is to mimic the non-linearity and memory effect introduced to the SI signal in order to achieve proper SI cancellation while exhibiting low computational complexity.

Cannot find the paper you are looking for? You can Submit a new open access paper.