ITcon Vol. 29, pg. 1239-1256, http://www.itcon.org/2024/55

Automatic crack classification on asphalt pavement surfaces using convolutional neural networks and transfer learning

DOI:10.36680/j.itcon.2024.055
submitted:September 2024
revised:December 2024
published:December 2024
editor(s):Getuli V, Rahimian F, Dawood N, Capone P, Bruttini A
authors:Sandra Matarneh, Associate Professor,
Department of Civil Engineering, Al-Ahliyya Amman University, Amman, Jordan;
s.matarneh@ammanu.edu.jo

Faris Elghaish, Lecturer,
School of Natural and Built Environment, Queen's University Belfast; UK
F.Elghaish@qub.ac.uk

David John Edwards, Professor,
Department of the Built Environment, Birmingham City University, UK;
Faculty of Engineering and the Built Environment, University of Johannesburg, South Africa;
david.edwards@bcu.ac.uk

Farzad Pour Rahimian, Professor,
School of Computing, Engineering and Digital Technologies, Teesside University; UK
F.Rahimian@tees.ac.uk

Essam Abdellatef, Assistant Professor,
Department of Electrical Engineering, Faculty of Engineering, Sinai University, Arish;
essam.abdellatef@su.edu.eg

Obuks Ejohwomu, Associate Professor,
Civil Engineering and Management, The University of Manchester; UK
obuks.ejohwomu@manchester.ac.uk
summary:Asphalt pavement cracks constitute a prevalent and severe distress of surfacing materials and before selecting the appropriate repair strategy, the type of deterioration must be classified to identify root causes. Efficient detection and classification minimize concomitant costs and simultaneously increase pavement service life. This study adopts convolutional neural networks (CNN) for asphalt pavement crack detection using secondary data available via the CRACK500 dataset and other datasets provided by GitHub. This dataset had four types of cracks viz.: horizontal, vertical, diagonal and alligator. Five pre-trained CNN models trained by ImageNet were also trained and evaluated for transfer learning. Emergent results demonstrate that the EfficientNet B3 is the most reliable model and achieved results of 94% F1_Score and 94% accuracy. This model was trained on the same dataset by performing transfer learning on pre-trained weights of ImageNet and fine-tuning the CNN. Results revealed that the modified model shows better classification performance with 96% F1_Score and 96% accuracy. This high classification accuracy was achieved by a combination of effective transfer-learning of ImageNet weight and fine-tuning of the top layers of EfficientNet B3 architecture to satisfy classification requirements. Finally, confusion matrices demonstrated that some classes of cracks performed better than others in terms of generalization. Further additional advancement with fine-tuned pre-trained models is therefore required. This study showed that the high classification results resulted from using a successful transfer learning of ImageNet weights, and fine-tuning.
keywords:Convolutional Neural Networks; CNN; Deep Learning; Transfer Learning, Multiclass Classification; Asphalt Pavement
full text: (PDF file, 1.111 MB)
citation:Matarneh S, Elghaish F, Edwards D J, Rahimian F P, Abdellatef E, Ejohwomu O (2024). Automatic crack classification on asphalt pavement surfaces using convolutional neural networks and transfer learning, ITcon Vol. 29, Special issue Managing the digital transformation of construction industry (CONVR 2023), pg. 1239-1256, https://doi.org/10.36680/j.itcon.2024.055
statistics: