Journal of Information Technology in Construction
Journal of Information Technology in Construction
ITcon Vol. 29, pg. 914-934, http://www.itcon.org/2024/40
MSFD-Net: A Multiscale Spatial Feature Descriptor Network for Semantic Segmentation of Large-Scale Bridge Point Clouds
| DOI: | 10.36680/j.itcon.2024.040 | |
| submitted: | September 2024 | |
| revised: | November 2024 | |
| published: | December 2024 | |
| editor(s): | Amor R | |
| authors: | M. Saeed Mafipour, Dr.-Ing.
Chair of Computational Modeling and Simulation, Technical University of Munich ORCID: https://orcid.org/0000-0002-2076-8653 saeed.mafipour@gmail.com Simon Vilgertshofer, Prof. Dr.-Ing. HM Munich University of Applied Sciences ORCID: https://orcid.org/0000-0003-4271-2076 simon.vilgerthsofer@hm.edu André Borrmann, Prof. Dr.-Ing. Chair of Computational Modeling and Simulation, Technical University of Munich ORCID: https://orcid.org/0000-0003-2088-7254 andre.borrmann@tum.de | |
| summary: | Digital Twins (DTs) provide a promising solution for bridge operation, thanks to their ability to mirror the physical conditions into a digital representation. At the core of the DTs is a geometric-semantic model. The modeling process for existing bridges, however, requires extensive manual effort. Given the high number of bridges in operation worldwide, there is an urgent need for automating this process. Available low-effort capturing methods, including laser-scanning and photogrammetry, generate raw point cloud data (PCD) that requires further processing to achieve a high-quality model. This paper focuses on the semantic segmentation of the PCD, which is the essential first step in an automated processing pipeline. A novel deep learning model, called multi-scale spatial feature descriptor network (MSFD-Net), is proposed for the semantic segmentation of PCD. The model is tested using the PCD of six bridges in Bavaria, Germany. The results show that MSFD-Net can automate semantic segmentation of bridges with mean accuracy (mAcc) of 98.29 % and mean intersection over union (mIoU) of 93.57 %. | |
| keywords: | Digital Twin, Bridge Information Modeling, Semantic Segmentation, Deep Learning, Point Cloud Data | |
| full text: | (PDF file, 1.431 MB) | |
| citation: | Mafipour M S, Vilgertshofer S, Borrmann A (2024). MSFD-Net: A Multiscale Spatial Feature Descriptor Network for Semantic Segmentation of Large-Scale Bridge Point Clouds, ITcon Vol. 29, pg. 914-934, https://doi.org/10.36680/j.itcon.2024.040 | |
| statistics: |