Search Results for author:
Found 7 papers, 2 papers with code
Capabilities of Gemini Models in Medicine
We evaluate Med-Gemini on 14 medical benchmarks, establishing new state-of-the-art (SoTA) performance on 10 of them, and surpass the GPT-4 model family on every benchmark where a direct comparison is viable, often by a wide margin.
Towards Conversational Diagnostic AI
The study included 149 case scenarios from clinical providers in Canada, the UK, and India, 20 PCPs for comparison with AMIE, and evaluations by specialist physicians and patient actors.
Towards Accurate Differential Diagnosis with Large Language Models
Comparing the two assisted study arms, the DDx quality score was higher for clinicians assisted by our LLM (top-10 accuracy 51. 7%) compared to clinicians without its assistance (36. 1%) (McNemar's Test: 45. 7, p < 0. 01) and clinicians with search (44. 4%) (4. 75, p = 0. 03).
Conformal Prediction with Large Language Models for Multi-Choice Question Answering
In this work, we explore how conformal prediction can be used to provide uncertainty quantification in language models for the specific task of multiple-choice question-answering.
TIER: Text-Image Entropy Regularization for CLIP-style models
We formalize this observation using a novel regularization scheme that penalizes the entropy of the text-token to image-patch similarity scores.
Towards Reliable Zero Shot Classification in Self-Supervised Models with Conformal Prediction
Self-supervised models trained with a contrastive loss such as CLIP have shown to be very powerful in zero-shot classification settings.
Self-Supervision on Images and Text Reduces Reliance on Visual Shortcut Features
Deep learning models trained in a fully supervised manner have been shown to rely on so-called "shortcut" features.
