Search Results for author: Sunghyeon Woo

Found 2 papers, 1 papers with code

DropBP: Accelerating Fine-Tuning of Large Language Models by Dropping Backward Propagation

1 code implementation27 Feb 2024 Sunghyeon Woo, Baeseong Park, Byeongwook Kim, Minjung Jo, Sejung Kwon, Dongsuk Jeon, Dongsoo Lee

In this paper, we propose Dropping Backward Propagation (DropBP), a novel approach designed to reduce computational costs while maintaining accuracy.

Activation Sharing with Asymmetric Paths Solves Weight Transport Problem without Bidirectional Connection

no code implementations NeurIPS 2021 Sunghyeon Woo, Jeongwoo Park, Jiwoo Hong, Dongsuk Jeon

One of the reasons why it is difficult for the brain to perform backpropagation (BP) is the weight transport problem, which argues forward and feedback neurons cannot share the same synaptic weights during learning in biological neural networks.

Cannot find the paper you are looking for? You can Submit a new open access paper.