Search Results for author: Shwetak Patel

Found 27 papers, 10 papers with code

HeAR -- Health Acoustic Representations

no code implementations4 Mar 2024 Sebastien Baur, Zaid Nabulsi, Wei-Hung Weng, Jake Garrison, Louis Blankemeier, Sam Fishman, Christina Chen, Sujay Kakarmath, Minyoi Maimbolwa, Nsala Sanjase, Brian Shuma, Yossi Matias, Greg S. Corrado, Shwetak Patel, Shravya Shetty, Shruthi Prabhakara, Monde Muyoyeta, Diego Ardila

Health acoustic sounds such as coughs and breaths are known to contain useful health signals with significant potential for monitoring health and disease, yet are underexplored in the medical machine learning community.

Self-Supervised Learning

Towards Accurate Differential Diagnosis with Large Language Models

no code implementations30 Nov 2023 Daniel McDuff, Mike Schaekermann, Tao Tu, Anil Palepu, Amy Wang, Jake Garrison, Karan Singhal, Yash Sharma, Shekoofeh Azizi, Kavita Kulkarni, Le Hou, Yong Cheng, Yun Liu, S Sara Mahdavi, Sushant Prakash, Anupam Pathak, Christopher Semturs, Shwetak Patel, Dale R Webster, Ewa Dominowska, Juraj Gottweis, Joelle Barral, Katherine Chou, Greg S Corrado, Yossi Matias, Jake Sunshine, Alan Karthikesalingam, Vivek Natarajan

Comparing the two assisted study arms, the DDx quality score was higher for clinicians assisted by our LLM (top-10 accuracy 51. 7%) compared to clinicians without its assistance (36. 1%) (McNemar's Test: 45. 7, p < 0. 01) and clinicians with search (44. 4%) (4. 75, p = 0. 03).

From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models

no code implementations21 Nov 2023 Zachary Englhardt, Chengqian Ma, Margaret E. Morris, Xuhai "Orson" Xu, Chun-Cheng Chang, Lianhui Qin, Daniel McDuff, Xin Liu, Shwetak Patel, Vikram Iyer

Passively collected behavioral health data from ubiquitous sensors holds significant promise to provide mental health professionals insights from patient's daily lives; however, developing analysis tools to use this data in clinical practice requires addressing challenges of generalization across devices and weak or ambiguous correlations between the measured signals and an individual's mental health.

Decision Making

Training Robust Deep Physiological Measurement Models with Synthetic Video-based Data

no code implementations9 Nov 2023 Yuxuan Ou, Yuzhe Zhang, Yuntang Wang, Shwetak Patel, Daniel McDuf, Yuzhe Yang, Xin Liu

However, there exists a significant gap between synthetic and real-world data, which hinders the generalization of neural models trained on these synthetic datasets.

Exploring and Characterizing Large Language Models For Embedded System Development and Debugging

no code implementations7 Jul 2023 Zachary Englhardt, Richard Li, Dilini Nissanka, Zhihan Zhang, Girish Narayanswamy, Joseph Breda, Xin Liu, Shwetak Patel, Vikram Iyer

We leverage this finding to study how human programmers interact with these tools, and develop an human-AI based software engineering workflow for building embedded systems.

BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurements

2 code implementations21 Mar 2023 Girish Narayanswamy, Yujia Liu, Yuzhe Yang, Chengqian Ma, Xin Liu, Daniel McDuff, Shwetak Patel

As an example, perception occurs at different scales both spatially and temporally, suggesting that the extraction of salient visual information may be made more effective by paying attention to specific features at varying scales.

Multi-Task Learning

Motion Matters: Neural Motion Transfer for Better Camera Physiological Measurement

1 code implementation21 Mar 2023 Akshay Paruchuri, Xin Liu, Yulu Pan, Shwetak Patel, Daniel McDuff, Soumyadip Sengupta

Our findings illustrate the usefulness of motion transfer as a data augmentation technique for improving the generalization of models for camera-based physiological sensing.

Data Augmentation Photoplethysmography (PPG)

Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images

no code implementations18 Mar 2023 Yuntao Wang, Zirui Cheng, Xin Yi, Yan Kong, Xueyang Wang, Xuhai Xu, Yukang Yan, Chun Yu, Shwetak Patel, Yuanchun Shi

Modeling the trade-off of privacy preservation and machine recognition performance can guide future privacy-preserving computer vision systems using low-resolution image sensors.

Activity Recognition Image Super-Resolution +1

MMPD: Multi-Domain Mobile Video Physiology Dataset

2 code implementations8 Feb 2023 Jiankai Tang, Kequan Chen, Yuntao Wang, Yuanchun Shi, Shwetak Patel, Daniel McDuff, Xin Liu

Second, most datasets are relatively small and therefore are limited in diversity, both in appearance (e. g., skin tone), behaviors (e. g., motion) and environment (e. g., lighting conditions).

Descriptive

MMTSA: Multimodal Temporal Segment Attention Network for Efficient Human Activity Recognition

no code implementations14 Oct 2022 Ziqi Gao, Yuntao Wang, Jianguo Chen, Junliang Xing, Shwetak Patel, Xin Liu, Yuanchun Shi

The efficiency evaluation on an edge device showed that MMTSA achieved significantly better accuracy, lower computational load, and lower inference latency than SOTA methods.

Human Activity Recognition

Federated Remote Physiological Measurement with Imperfect Data

no code implementations11 Mar 2022 Xin Liu, Mingchuan Zhang, Ziheng Jiang, Shwetak Patel, Daniel McDuff

The growing need for technology that supports remote healthcare is being acutely highlighted by an aging population and the COVID-19 pandemic.

Federated Learning Privacy Preserving

SpiroMask: Measuring Lung Function Using Consumer-Grade Masks

1 code implementation23 Jan 2022 Rishiraj Adhikary, Dhruvi Lodhavia, Chris Francis, Rohit Patil, Tanmay Srivastava, Prerna Khanna, Nipun Batra, Joe Breda, Jacob Peplinski, Shwetak Patel

According to the World Health Organisation (WHO), 235 million people suffer from respiratory illnesses and four million people die annually due to air pollution.

MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensing

no code implementations11 Jan 2022 Xin Liu, Yuntao Wang, Sinan Xie, XiaoYu Zhang, Zixian Ma, Daniel McDuff, Shwetak Patel

Camera-based contactless photoplethysmography refers to a set of popular techniques for contactless physiological measurement.

Reliable and Trustworthy Machine Learning for Health Using Dataset Shift Detection

no code implementations NeurIPS 2021 Chunjong Park, Anas Awadalla, Tadayoshi Kohno, Shwetak Patel

We then translate the out-of-distribution score into a human interpretable CONFIDENCE SCORE to investigate its effect on the users' interaction with health ML applications.

BIG-bench Machine Learning Medical Diagnosis +1

RGB Camera-based Physiological Sensing: Challenges and Future Directions

no code implementations26 Oct 2021 Xin Liu, Shwetak Patel, Daniel McDuff

Numerous real-world applications have been driven by the recent algorithmic advancement of artificial intelligence (AI).

EfficientPhys: Enabling Simple, Fast, and Accurate Camera-Based Vitals Measurement

no code implementations29 Sep 2021 Xin Liu, Brian L. Hill, Ziheng Jiang, Shwetak Patel, Daniel McDuff

Camera-based physiological measurement is a growing field with neural models providing state-the-art-performance.

Face Detection

SplitSR: An End-to-End Approach to Super-Resolution on Mobile Devices

no code implementations20 Jan 2021 Xin Liu, Yuang Li, Josh Fromm, Yuntao Wang, Ziheng Jiang, Alex Mariakakis, Shwetak Patel

In this work, we demonstrate state-of-the-art latency and accuracy for on-device super-resolution using a novel hybrid architecture called SplitSR and a novel lightweight residual block called SplitSRBlock.

Super-Resolution

MetaPhys: Few-Shot Adaptation for Non-Contact Physiological Measurement

1 code implementation5 Oct 2020 Xin Liu, Ziheng Jiang, Josh Fromm, Xuhai Xu, Shwetak Patel, Daniel McDuff

There are large individual differences in physiological processes, making designing personalized health sensing algorithms challenging.

Meta-Learning

Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement

3 code implementations NeurIPS 2020 Xin Liu, Josh Fromm, Shwetak Patel, Daniel McDuff

Telehealth and remote health monitoring have become increasingly important during the SARS-CoV-2 pandemic and it is widely expected that this will have a lasting impact on healthcare practices.

Photoplethysmography (PPG) heart rate estimation

Cannot find the paper you are looking for? You can Submit a new open access paper.