Search Results for author: Myeongwoo Kim

Found 2 papers, 0 papers with code

Breaking MLPerf Training: A Case Study on Optimizing BERT

no code implementations4 Feb 2024 YongDeok Kim, Jaehyung Ahn, Myeongwoo Kim, Changin Choi, Heejae Kim, Narankhuu Tuvshinjargal, Seungwon Lee, Yanzi Zhang, Yuan Pei, Xiongzhan Linghu, Jingkun Ma, Lin Chen, Yuehua Dai, Sungjoo Yoo

Speeding up the large-scale distributed training is challenging in that it requires improving various components of training including load balancing, communication, optimizers, etc.

Hyperparameter Optimization

vTrain: A Simulation Framework for Evaluating Cost-effective and Compute-optimal Large Language Model Training

no code implementations27 Nov 2023 Jehyeon Bang, Yujeong Choi, Myeongwoo Kim, YongDeok Kim, Minsoo Rhu

As large language models (LLMs) become widespread in various application domains, a critical challenge the AI community is facing is how to train these large AI models in a cost-effective manner.

Language Modelling Large Language Model

Cannot find the paper you are looking for? You can Submit a new open access paper.