Publication | IEEE International Conference on Computer Vision (ICCV) 2019

Unsupervised Multi-Task Feature Learning on Point Clouds

3D point clouds are used in AEC applications such as Scan2BIM and also are compact representations of complex 3D models such as models used in manufacturing. Annotating point clouds is a labor-intensive and time-consuming task that is required to accurately classify or segment them. To address this, we introduce a unsupervised multi-task approach to learn high level features which in turn minimizes the need for labels. This can help to automatically segments objects to their parts or cluster 3D models. Specifically, automatic segmentation of 3D models to their constituent parts can help to automatically expand “Design Graph.”

Download publication


Unsupervised Multi-Task Feature Learning on Point Clouds

Kaveh Hassani, Mike Haley

IEEE International Conference on Computer Vision (ICCV) 2019

We introduce an unsupervised multi-task model to jointly learn point and shape features on point clouds. We define three unsupervised tasks including clustering, reconstruction, and self-supervised classification to train a multi-scale graph-based encoder. We evaluate our model on shape classification and segmentation benchmarks. The results suggest that it outperforms prior state-of-the-art unsupervised models: In the ModelNet40 classification task, it achieves an accuracy of 89.1% and in ShapeNet segmentation task, it achieves an mIoU of 68.2 and accuracy of 88.6%.

Related Resources



Development of an Architecturally Comprehensive Database of Forearm Flexors and Extensors from a Single Cadaveric Specimen

Technology has markedly improved the data that are used to generate…



BRepNet: A topological message passing system for solid models

Boundary representation (B-rep) models are the standard way 3D shapes…



Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs

During asynchronous collaborative analysis, handoff of partial…



Post-Deployment Usability: A Survey of Current Practices

Despite the growing research on usability in the pre-development…

Get in touch

Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.

Contact us