Publication | IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2022
JoinABLe
Learning Bottom-up Assembly of Parametric CAD Joints
An overview of assemblies in the Fusion 360 Gallery assembly dataset.
A critical part of assembly design in Fusion 360 and Inventor is aligning parts to one another to form joints. However, fully defining assembly joints is time-consuming for our customers and not fully automated. To address this challenge, we developed ‘JoinABLe’ a machine learning based approach to automatically create joints between pairs of parts in an assembly.
Download publicationAbstract
JoinABLe: Learning Bottom-up Assembly of Parametric CAD Joints
Karl D.D. Willis, Pradeep Kumar Jayaraman, Hang Chu, Yunsheng Tian, Yifei Li, Daniele Grandi, Aditya Sanghi, Linh Tran, Joseph G. Lambourne, Armando Solar-Lezama, Wojciech Matusik
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2022
Physical products are often complex assemblies combining a multitude of 3D parts modeled in computer-aided design (CAD) software. CAD designers build up these assemblies by aligning individual parts to one another using constraints called joints. In this paper we introduce JoinABLe, a learning-based method that assembles parts together to form joints. JoinABLe uses the weak supervision available in standard parametric CAD files without the help of object class labels or human guidance. Our results show that by making network predictions over a graph representation of solid models we can outperform multiple baseline methods with an accuracy (79.53%) that approaches human performance (80%). Finally, to support future research we release the Fusion 360 Gallery assembly dataset, containing assemblies with rich information on joints, contact surfaces, holes, and the underlying assembly graph structure.
CAD assemblies contain valuable joint information describing how parts are locally constrained and positioned together. We use this weak supervision to learn a bottom-up approach to assembly. JoinABLe combines an encoder and joint axis prediction network together with a neurally guided joint pose search to assemble pairs of parts without class labels or human guidance.
Associated Researchers
Yunsheng Tian
MIT
Linh Tran
Autodesk AI Lab
Wojciech Matusik
MIT
Armando Solar-Lezama
MIT
Yifei Li
MIT
Related Resources
2022
MaskTune: Mitigating Spurious Correlations by Forcing to Explore
This work proposes a masking strategy that prevents over-reliance on…
2020
PointMask: Towards Interpretable and Bias-Resilient Point Cloud Processing
Deep classifiers tend to associate a few discriminative input…
2021
Robust Representation Learning via Perceptual Similarity Metrics
A fundamental challenge in artificial intelligence is learning useful…
2022
Evolving Through the Looking Glass: Learning Improved Search Spaces with Variational Autoencoders.
Nature has spent billions of years perfecting our genetic…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us