1 code implementation • 19 Apr 2024 • Yuchi Liu, Lei Wang, Yuli Zou, James Zou, Liang Zheng
For example, for a narrow misclassification, a calibrator trained by the CE loss often produces high confidence on the wrongly predicted class (e. g., a test sample is wrongly classified and its softmax score on the ground truth class is around 0. 4), which is undesirable.
no code implementations • 9 Mar 2023 • Yuli Zou, Weijian Deng, Liang Zheng
In other words, a calibrator optimal on the calibration set would be suboptimal on the OOD test set and thus has degraded performance.
1 code implementation • ICCV 2023 • Yuli Zou, Weijian Deng, Liang Zheng
With this knowledge, we propose a simple and effective method named adaptive calibrator ensemble (ACE) to calibrate OOD datasets whose difficulty is usually higher than the calibration set.
