Search Results for author:
Found 20 papers, 5 papers with code
Eye-gaze Guided Multi-modal Alignment Framework for Radiology
Additionally, we explore the impact of varying amounts of eye-gaze data on model performance, highlighting the feasibility and utility of integrating this auxiliary data into multi-modal pre-training.
Large Language Models for Robotics: Opportunities, Challenges, and Perspectives
Notably, in the realm of robot task planning, LLMs harness their advanced reasoning and language comprehension capabilities to formulate precise and efficient action plans based on natural language instructions.
Holistic Evaluation of GPT-4V for Biomedical Imaging
GPT-4V represents a breakthrough in artificial general intelligence (AGI) for computer vision, with applications in the biomedical domain.
PolicyGPT: Automated Analysis of Privacy Policies with Large Language Models
In this study, we investigate a privacy policy text analysis framework PolicyGPT based on the LLM.
Chat2Brain: A Method for Mapping Open-Ended Semantic Queries to Brain Activation Maps
In this study, we propose a method called Chat2Brain that combines LLMs to basic text-2-image model, known as Text2Brain, to map open-ended semantic queries to brain activation maps in data-scarce and complex query environments.
Radiology-Llama2: Best-in-Class Large Language Model for Radiology
This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning.
Evaluating Large Language Models for Radiology Natural Language Processing
The rise of large language models (LLMs) has marked a pivotal shift in the field of natural language processing (NLP).
Review of Large Vision Models and Visual Prompt Engineering
This review aims to summarize the methods employed in the computer vision domain for large vision models and visual prompt engineering, exploring the latest advancements in visual prompt engineering.
SAMAug: Point Prompt Augmentation for Segment Anything Model
Starting with an initial point prompt, SAM produces an initial mask, which is then fed into our proposed SAMAug to generate augmented point prompts.
Radiology-GPT: A Large Language Model for Radiology
We introduce Radiology-GPT, a large language model for radiology.
Learning Better Contrastive View from Radiologist's Gaze
Then, we propose a novel augmentation method, i. e., FocusContrast, to learn from radiologists' gaze in diagnosis and generate contrastive views for medical images with guidance from radiologists' visual attention.
Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT
Prompts have been proven to play a crucial role in large language models, and in recent years, vision models have also been using prompts to improve scalability for multiple downstream tasks.
Prompt Engineering for Healthcare: Methodologies and Applications
Prompt engineering is a critical technique in the field of natural language processing that involves designing and optimizing the prompts used to input information into models, aiming to enhance their performance on specific tasks.
ChatABL: Abductive Learning via Natural Language Interaction with ChatGPT
The proposed method uses the strengths of LLMs' understanding and logical reasoning to correct the incomplete logical facts for optimizing the performance of perceptual module, by summarizing and reorganizing reasoning rules represented in natural language format.
Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Task
To this end, in this study, we evaluate the performance of ChatGPT/GPT-4 on a radiology NLI task and compare it to other models fine-tuned specifically on task-related data samples.
ImpressionGPT: An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT
The 'Impression' section of a radiology report is a critical basis for communication between radiologists and other physicians, and it is typically written by radiologists based on the 'Findings' section.
Rectify ViT Shortcut Learning by Visual Saliency
In this work, we propose a novel and effective saliency-guided vision transformer (SGT) model to rectify shortcut learning in ViT with the absence of eye-gaze data.
Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning
To address this problem, we propose to infuse human experts' intelligence and domain knowledge into the training of deep neural networks.
JointsGait:A model-based Gait Recognition Method based on Gait Graph Convolutional Networks and Joints Relationship Pyramid Mapping
However, appearance features suffer from external factors which can cause drastic appearance variations, e. g. clothing.
Structural modeling using overlapped group penalties for discovering predictive biomarkers for subgroup analysis
The identification of predictive biomarkers from a large scale of covariates for subgroup analysis has attracted fundamental attention in medical research.
