FlexModel: A Framework for Interpretability of Distributed Large Language Models

1 code implementation • 5 Dec 2023 • Matthew Choi, Muhammad Adil Asif, John Willes, David Emerson

With the growth of large language models, now incorporating billions of parameters, the hardware prerequisites for their training and deployment have seen a corresponding increase.

Distributed Computing