Search Results for author: Linda Shapiro

Found 20 papers, 11 papers with code

Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videos

1 code implementation7 Dec 2023 Mehmet Saygin Seyfioglu, Wisdom O. Ikezogwo, Fatemeh Ghezloo, Ranjay Krishna, Linda Shapiro

Current visual instruction datasets, generated through large language models, focus on creating question/answer pairs for individual image patches, which may lack diagnostic capacity on their own in histopathology, further complicated by the absence of spatial grounding in histopathology image captions.

Image Captioning Visual Question Answering (VQA) +1

Multi-modal Masked Autoencoders Learn Compositional Histopathological Representations

1 code implementation4 Sep 2022 Wisdom Oluchi Ikezogwo, Mehmet Saygin Seyfioglu, Linda Shapiro

However, the domain shift between natural images and digital pathology images requires further research in designing MAE for patch-level WSIs.

Self-Supervised Learning

Brain-Aware Replacements for Supervised Contrastive Learning in Detection of Alzheimer's Disease

1 code implementation11 Jul 2022 Mehmet Saygın Seyfioğlu, Zixuan Liu, Pranav Kamath, Sadjyot Gangolli, Sheng Wang, Thomas Grabowski, Linda Shapiro

On top of BAR, we propose using a soft-label-capable supervised contrastive loss, aiming to learn the relative similarity of representations that reflect how mixed are the synthetic MRIs using our soft labels.

Contrastive Learning Data Augmentation

Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humans

no code implementations CVPR 2021 Bindita Chaudhuri, Nikolaos Sarafianos, Linda Shapiro, Tony Tung

Given a segmentation mask defining the layout of the semantic regions in the texture map, our network generates high-resolution textures with a variety of styles, that are then used for rendering purposes.

Virtual Try-on Vocal Bursts Intensity Prediction

HATNet: An End-to-End Holistic Attention Network for Diagnosis of Breast Biopsy Images

1 code implementation25 Jul 2020 Sachin Mehta, Ximing Lu, Donald Weaver, Joann G. Elmore, Hannaneh Hajishirzi, Linda Shapiro

HATNet extends the bag-of-words approach and uses self-attention to encode global information, allowing it to learn representations from clinically relevant tissue structures without any explicit supervision.

Histopathological Image Classification Image Classification

Personalized Face Modeling for Improved Face Reconstruction and Motion Retargeting

no code implementations ECCV 2020 Bindita Chaudhuri, Noranart Vesdapunt, Linda Shapiro, Baoyuan Wang

Traditional methods for image-based 3D face reconstruction and facial motion retargeting fit a 3D morphable model (3DMM) to the face, which has limited modeling capacity and fail to generalize well to in-the-wild data.

3D Face Reconstruction Face Model +1

Sparsely Grouped Input Variables for Neural Networks

1 code implementation29 Nov 2019 Beibin Li, Nicholas Nuechterlein, Erin Barney, Caitlin Hudac, Pamela Ventola, Linda Shapiro, Frederick Shic

In genomic analysis, biomarker discovery, image recognition, and other systems involving machine learning, input variables can often be organized into different groups by their source or semantic category.

Meta-Learning

Learning Stylized Character Expressions from Humans

no code implementations19 Nov 2019 Deepali Aneja, Alex Colburn, Gary Faigin, Linda Shapiro, Barbara Mones

We present DeepExpr, a novel expression transfer system from humans to multiple stylized characters via deep learning.

Retrieval

A Facial Affect Analysis System for Autism Spectrum Disorder

no code implementations7 Apr 2019 Beibin Li, Sachin Mehta, Deepali Aneja, Claire Foster, Pamela Ventola, Frederick Shic, Linda Shapiro

In this paper, we introduce an end-to-end machine learning-based system for classifying autism spectrum disorder (ASD) using facial attributes such as expressions, action units, arousal, and valence.

BIG-bench Machine Learning Classification +2

Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images

2 code implementations4 Jun 2018 Sachin Mehta, Ezgi Mercan, Jamen Bartlett, Donald Weave, Joann G. Elmore, Linda Shapiro

In this paper, we introduce a conceptually simple network for generating discriminative tissue-level segmentation masks for the purpose of breast cancer diagnosis.

Descriptive General Classification +2

Identifying Most Walkable Direction for Navigation in an Outdoor Environment

no code implementations21 Nov 2017 Sachin Mehta, Hannaneh Hajishirzi, Linda Shapiro

We present an approach for identifying the most walkable direction for navigation using a hand-held camera.

Segmentation Semantic Segmentation

Learning to Segment Breast Biopsy Whole Slide Images

1 code implementation8 Sep 2017 Sachin Mehta, Ezgi Mercan, Jamen Bartlett, Donald Weaver, Joann Elmore, Linda Shapiro

We trained and applied an encoder-decoder model to semantically segment breast biopsy images into biologically meaningful tissue labels.

Segmentation whole slide images

Generating Notifications for Missing Actions: Don't Forget to Turn the Lights Off!

no code implementations ICCV 2015 Bilge Soran, Ali Farhadi, Linda Shapiro

The overall prediction accuracy is 46. 2% when only 10 frames of an action are seen (2/3 of a sec).

Supervised Semantic Gradient Extraction Using Linear-Time Optimization

no code implementations CVPR 2013 Shulin Yang, Jue Wang, Linda Shapiro

This paper proposes a new supervised semantic edge and gradient extraction approach, which allows the user to roughly scribble over the desired region to extract semantically-dominant and coherent edges in it.

Edge Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.