Search Results for author: Xiaoyi Zhang

Found 10 papers, 0 papers with code

Talaria: Interactively Optimizing Machine Learning Models for Efficient Inference

no code implementations3 Apr 2024 Fred Hohman, Chaoqun Wang, Jinmook Lee, Jochen Görtler, Dominik Moritz, Jeffrey P Bigham, Zhile Ren, Cecile Foret, Qi Shan, Xiaoyi Zhang

On-device machine learning (ML) moves computation from the cloud to personal devices, protecting user privacy and enabling intelligent user experiences.

Reinforced UI Instruction Grounding: Towards a Generic UI Task Automation API

no code implementations7 Oct 2023 Zhizheng Zhang, Wenxuan Xie, Xiaoyi Zhang, Yan Lu

In this work, we build a multimodal model to ground natural language instructions in given UI screenshots as a generic UI task automation executor.

document understanding Reinforcement Learning (RL)

Intestinal Microecology in Pediatric Surgery-Related Gastrointestinal Diseases Current Insights and Future Perspectives

no code implementations14 Aug 2023 Yingchao Li, Yuqing Wu, Suolin Li, Lin Liu, Xiaoyi Zhang, Jiaxun Lv, Qinqin Li

We review the relationship between pathogenesis, diagnosis and treatment of pediatric surgery-related gastrointestinal diseases and intestinal microecology, in order to provide new ideas and methods for clinical diagnosis, treatment and research.

Responsible Task Automation: Empowering Large Language Models as Responsible Task Automators

no code implementations2 Jun 2023 Zhizheng Zhang, Xiaoyi Zhang, Wenxuan Xie, Yan Lu

In specific, we present Responsible Task Automation (ResponsibleTA) as a fundamental framework to facilitate responsible collaboration between LLM-based coordinators and executors for task automation with three empowered capabilities: 1) predicting the feasibility of the commands for executors; 2) verifying the completeness of executors; 3) enhancing the security (e. g., the protection of users' privacy).

Prompt Engineering

Unifying Layout Generation with a Decoupled Diffusion Model

no code implementations CVPR 2023 Mude Hui, Zhizheng Zhang, Xiaoyi Zhang, Wenxuan Xie, Yuwang Wang, Yan Lu

Since different attributes have their individual semantics and characteristics, we propose to decouple the diffusion processes for them to improve the diversity of training samples and learn the reverse process jointly to exploit global-scope contexts for facilitating generation.

Understanding Mobile GUI: from Pixel-Words to Screen-Sentences

no code implementations25 May 2021 Jingwen Fu, Xiaoyi Zhang, Yuwang Wang, Wenjun Zeng, Sam Yang, Grayson Hilliard

A dataset, RICO-PW, of screenshots with Pixel-Words annotations is built based on the public RICO dataset, which will be released to help to address the lack of high-quality training data in this area.

Retrieval Sentence

Realistic Large-Scale Fine-Depth Dehazing Dataset from 3D Videos

no code implementations18 Apr 2020 Ruoteng Li, Xiaoyi Zhang, ShaoDi You, Yu Li

We select a large number of high-quality frames of real outdoor scenes and render haze on them using depth from stereo.

Autonomous Driving Benchmarking +1

Cannot find the paper you are looking for? You can Submit a new open access paper.