Conference on Robot Learning (CoRL)
Fabrica: Dual-Arm Assembly of General Multi-Part Objects via Integrated Planning and Learning
Multi-part assembly poses significant challenges for robots to execute long-horizon, contact-rich manipulation with generalization across complex geometries. We present Fabrica, a dual-arm robotic system capable of end-to-end planning and control for autonomous assembly of general multi-part objects. For planning over long horizons, we develop hierarchies of precedence, sequence, grasp, and motion planning with automated fixture generation, enabling general multi-step assembly on any dual-arm robots. The planner is made efficient through a parallelizable design and is optimized for downstream control stability. For contact-rich assembly steps, we propose a lightweight reinforcement learning framework that trains generalist policies across object geometries, assembly directions, and grasp poses, guided by equivariance and residual actions obtained from the plan. These policies transfer zero-shot to the real world and achieve 80% successful steps. For systematic evaluation, we propose a benchmark suite of multi-part assemblies resembling industrial and daily objects across diverse categories and geometries. By integrating efficient global planning and robust local control, we showcase the first system to achieve complete and generalizable real-world multi-part assembly without domain knowledge or human demonstrations.
This paper was named Outstanding Paper at CoRL 2025.
Download publicationAssociated Researchers
Yunsheng Tian
Massachusetts Institute of Technology
Joshua Jacob
Massachusetts Institute of Technology
Edward Gu
Massachusetts Institute of Technology
Pingchuan Ma
Massachusetts Institute of Technology
Farhad Javid
Former Autodesk
Shinjiro Sueda
Texas A&M University
Wojciech Matusik
MIT
Yijiang Huang
ETH Zurich
Branden Romero
MIT CSAIL
Annan Zhang
MIT CSAIL
Jialiang Zhao
MIT CSAIL
Related Publications
2025
ARCH: Hierarchical Hybrid Learning for Long-Horizon Contact-Rich Robotic AssemblyIntroduces a hierarchical modular learning framework which enables…
2025
Flow-based Domain Randomization for Learning and Sequencing Robotic SkillsDevelops a method for robust sim to real transfer in highly complex…
2025
In-Context Imitation Learning via Next-Token PredictionThis robotics approach allows flexible and training-free execution of…
2024
Toward Automated Programming for Robotic Assembly Using ChatGPTBy using specialized language agents for task decomposition and code…
2024
Bridging the Sim-to-Real Gap with Dynamic Compliance Tuning for Industrial InsertionA novel framework for robustly learning manipulation skills…
2024
ASAP: Automated Sequence Planning for Complex Robotic Assembly with Physical FeasibilityA physics-based planning approach for automatically generating…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us