Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation

1 code implementation • 22 Sep 2023 • Kai Huang, Hanyun Yin, Heng Huang, Wei Gao

With the fast growth of LLM-enabled AI applications and democratization of open-souced LLMs, fine-tuning has become possible for non-expert individuals, but intensively performed LLM fine-tuning worldwide could result in significantly high energy consumption and carbon footprint, which may bring large environmental impact.

Abstractive Text Summarization