Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V

no code implementations • 16 Apr 2024 • Peiyuan Zhi, Zhiyuan Zhang, Muzhi Han, Zeyu Zhang, Zhitian Li, Ziyuan Jiao, Baoxiong Jia, Siyuan Huang

Autonomous robot navigation and manipulation in open environments require reasoning and replanning with closed-loop feedback.

Instruction Following Multimodal Reasoning +1

PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI

no code implementations • 15 Apr 2024 • Yandan Yang, Baoxiong Jia, Peiyuan Zhi, Siyuan Huang

With recent developments in Embodied Artificial Intelligence (EAI) research, there has been a growing demand for high-quality, large-scale interactive scene generation.

Scene Generation

Joint Learning for Scattered Point Cloud Understanding with Hierarchical Self-Distillation

no code implementations • 28 Dec 2023 • Kaiyue Zhou, Ming Dong, Peiyuan Zhi, Shengjin Wang

Numerous point-cloud understanding techniques focus on whole entities and have succeeded in obtaining satisfactory results and limited sparsity tolerance.

Hybrid Physical Metric For 6-DoF Grasp Pose Detection

1 code implementation • 22 Jun 2022 • Yuhao Lu, Beixing Deng, Zhenyu Wang, Peiyuan Zhi, YaLi Li, Shengjin Wang

6-DoF grasp pose detection of multi-grasp and multi-object is a challenge task in the field of intelligent robot.