Publication | Automation in Construction 2021
Robotic assembly of timber joints using reinforcement learning
This paper describes applying Reinforcement Learning to control robot movements in contact-rich and tolerance-prone assembly tasks and presents the first successful demonstration of this approach in the context of architectural construction.
Download publicationAbstract
Robotic assembly of timber joints using reinforcement learning
Aleksandra Anna Apolinarska, Matteo Pacher, Hui Li, Nicholas Cote, Rafael Pastrana, Fabio Gramazio, Matthias Kohler
Automation in Construction 2021
In architectural construction, automated robotic assembly is challenging due to occurring tolerances, small series production and complex contact situations, especially in assembly of elements with form-closure such as timber structures with integral joints. This paper proposes to apply Reinforcement Learning to control robot movements in contact-rich and tolerance-prone assembly tasks and presents the first successful demonstration of this approach in the context of architectural construction. Exemplified by assembly of lap joints for custom timber frames, robot movements are guided by force/torque and pose data to insert a timber element in its mating counterpart(s). Using an adapted Ape-X DDPG algorithm, the control policy is trained entirely in simulation and successfully deployed in reality. The experiments show the policy can also generalize to situations in real world not seen in training, such as tolerances and shape variations. This caters to uncertainties occurring in construction processes and facilitates fabrication of differentiated, customized designs.
Associated Autodesk Researchers
Related Resources
2022
Harnessing Game-Inspired Content Creation for Intuitive Generative Design and Optimization
A multi-scale generative design model that adapts the Wave Function…
2023
Learned Visual Features to Textual Explanations
A novel method that leverages the capabilities of large language…
2002
3D Freeform Design
Alternative input devices and new interaction paradigms can better…
2023
Safe Self-Supervised Learning of Insertion Skills in the Real World using Tactile and Visual Sensing
Exploring how to safely train robots how to perform industrial…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us