1 code implementation • 18 Apr 2022 • Alex Tamkin, Dat Nguyen, Salil Deshpande, Jesse Mu, Noah Goodman
Models can fail in unpredictable ways during deployment due to task ambiguity, when multiple behaviors are consistent with the provided training data.
no code implementations • 29 Sep 2021 • Alex Tamkin, Dat Nguyen, Salil Deshpande, Jesse Mu, Noah Goodman
An important barrier to the safe deployment of machine learning systems is the risk of \emph{task ambiguity}, where multiple behaviors are consistent with the provided examples.