open access publication

Conference Paper, 2024

AssemblyNet: A Point Cloud Dataset and Benchmark for Predicting Part Directions in an Exploded Layout

2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), ISBN 979-8-3503-1892-0, Volume 00, Pages 5824-5833, 10.1109/wacv57701.2024.00573

Contributors

Gaarsdal, Jesper 0000-0002-4046-6513 (Corresponding author) [1] [2] Haurum, Joakim Bruslund 0000-0002-0544-0422 [1] Wolff, Sune [2] Madsen, Claus Brøndgaard 0000-0003-0762-3713 [1]

Affiliations

  1. [1] Aalborg University
  2. [NORA names: AAU Aalborg University; University; Denmark; Europe, EU; Nordic; OECD];
  3. [2] SynergyXR ApS, Aarhus, Denmark
  4. [NORA names: Denmark; Europe, EU; Nordic; OECD]

Abstract

Exploded views are powerful tools for visualizing the assembly and disassembly of complex objects, widely used in technical illustrations, assembly instructions, and product presentations. Previous methods for automating the creation of exploded views are either slow and computationally costly or compromise on accuracy. Therefore, the construction of exploded views is typically a manual process. In this paper, we propose a novel approach for automatically predicting the direction of parts in an exploded view using deep learning. To achieve this, we introduce a new dataset, AssemblyNet, which contains point cloud data sampled from 3D models of real-world assemblies, including water pumps, mixed industrial assemblies, and LEGO models. The AssemblyNet dataset includes a total of 44 assemblies, separated into 495 subassemblies with a total of 5420 parts. We provide ground truth labels for regression and classification, representing the directions in which the parts are moved in the exploded views. We also provide performance benchmarks using various state-of-the-art models for shape classification on point clouds and propose a novel two-path network architecture. Project page available at https://github.com/jgaarsdal/AssemblyNet

Keywords

LEGO, Lego models, accuracy, architecture, assembly, assembly instructions, benchmarks, classification, cloud, cloud datasets, complex objects, compromise, construction, creation, dataset, deep learning, direction, direction of parts, disassembly, exploded view, exploding, illustrations, industrial assembly, instruction, layout, learning, manual process, method, model, network architecture, objective, pages, parting direction, parts, performance, performance benchmarks, point, point cloud datasets, prediction, presentation, process, product presentation, production, project, project page, pump, real-world assemblies, regression, state-of-the-art, state-of-the-art models, subassemblies, technical illustrations, views, water, water pump

Funders

  • Innovation Fund Denmark

Data Provider: Digital Science