ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Prediction

1 code implementation • 1 Feb 2024 • Juan Nathaniel, Yongquan Qu, Tung Nguyen, Sungduk Yu, Julius Busecke, Aditya Grover, Pierre Gentine

Thus, we propose ChaosBench, a large-scale, multi-channel, physics-based benchmark for S2S prediction.

Systematic Sampling and Validation of Machine Learning-Parameterizations in Climate Models

1 code implementation • 28 Sep 2023 • Jerry Lin, Sungduk Yu, Tom Beucler, Pierre Gentine, David Walling, Mike Pritchard

The implication is that hundreds of candidate ML models should be evaluated online to detect the effects of parameterization design choices.

ClimSim: A large multi-scale dataset for hybrid physics-ML climate emulation

1 code implementation • NeurIPS 2023 • Sungduk Yu, Walter Hannah, Liran Peng, Jerry Lin, Mohamed Aziz Bhouri, Ritwik Gupta, Björn Lütjens, Justus Christopher Will, Gunnar Behrens, Julius Busecke, Nora Loose, Charles I Stern, Tom Beucler, Bryce Harrop, Benjamin R Hillman, Andrea Jenney, Savannah Ferretti, Nana Liu, Anima Anandkumar, Noah D Brenowitz, Veronika Eyring, Nicholas Geneva, Pierre Gentine, Stephan Mandt, Jaideep Pathak, Akshay Subramaniam, Carl Vondrick, Rose Yu, Laure Zanna, Tian Zheng, Ryan Abernathey, Fiaz Ahmed, David C Bader, Pierre Baldi, Elizabeth Barnes, Christopher Bretherton, Peter Caldwell, Wayne Chuang, Yilun Han, Yu Huang, Fernando Iglesias-Suarez, Sanket Jantre, Karthik Kashinath, Marat Khairoutdinov, Thorsten Kurth, Nicholas Lutsko, Po-Lun Ma, Griffin Mooers, J. David Neelin, David Randall, Sara Shamekh, Mark A Taylor, Nathan Urban, Janni Yuval, Guang Zhang, Michael Pritchard

The dataset is global in coverage, spans multiple years at high sampling frequency, and is designed such that resulting emulators are compatible with downstream coupling into operational climate simulators.

Two-step hyperparameter optimization method: Accelerating hyperparameter search by using a fraction of a training dataset

1 code implementation • 8 Feb 2023 • Sungduk Yu, Mike Pritchard, Po-Lun Ma, Balwinder Singh, Sam Silva

Hyperparameter optimization (HPO) is an important step in machine learning (ML) model development, but common practices are archaic -- primarily relying on manual or grid searches.

Hyperparameter Optimization

Climate-Invariant Machine Learning

1 code implementation • 14 Dec 2021 • Tom Beucler, Pierre Gentine, Janni Yuval, Ankitesh Gupta, Liran Peng, Jerry Lin, Sungduk Yu, Stephan Rasp, Fiaz Ahmed, Paul A. O'Gorman, J. David Neelin, Nicholas J. Lutsko, Michael Pritchard

Projecting climate change is a generalization problem: we extrapolate the recent past using physical models across past, present, and future climates.

BIG-bench Machine Learning