MatchMakerNet: Enabling Fragment Matching for Cultural Heritage Analysis

Villegas-Suarez A.M.; Lopez C.; Sipiran I. · Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023 (2023) · DOI: 10.1109/iccvw60793.2023.00178

Resumen

Automating the reassembly of fragmented objects is a complex task with applications in cultural heritage preservation, paleontology, and medicine. However, the matching subtask of the reassembly process has received limited attention, despite its crucial role in reducing the alignment search space. To address this gap, we propose Match-MakerNet, a network architecture designed to automate the pairing of object fragments for reassembly. By taking two point clouds as input and leveraging graph convolution alongside a simplified version of DGCNN, MatchMakerNet achieves remarkable results. After training on the Artifact (synthetic) dataset, we achieve an accuracy of 87.31% in all-to-all comparisons between the fragments. In addition, it demonstrates robust generalization capabilities, achieving 86.93% accuracy on the Everyday (synthetic) dataset and 83.03% on the Puzzles 3D (real-world) dataset. These findings highlight the effectiveness and versatility of Match-MakerNet in solving the matching subtask.

Instituciones: Universidad de Ingeniería y Tecnología