Evaluating the Factuality of Zero-shot Summarizers Across Varied Domains

no code implementations • 5 Feb 2024 • Sanjana Ramprasad, Kundan Krishna, Zachary C Lipton, Byron C Wallace

We analyze whether the prevalence of a given domain in the pretraining corpus affects extractiveness and faithfulness of generated summaries of articles in this domain.

Perspectives on the State and Future of Deep Learning -- 2023

no code implementations • 7 Dec 2023 • Micah Goldblum, Anima Anandkumar, Richard Baraniuk, Tom Goldstein, Kyunghyun Cho, Zachary C Lipton, Melanie Mitchell, Preetum Nakkiran, Max Welling, Andrew Gordon Wilson

The goal of this series is to chronicle opinions and issues in the field of machine learning as they stand today and as they change over time.

Benchmarking