ITcon Vol. 29, pg. 264-280, http://www.itcon.org/2024/13

Integrating Domain Knowledge with Deep Learning Model for Automated Worker Activity Classification in mobile work zone

DOI:10.36680/j.itcon.2024.013
submitted:June 2023
revised:February 2024
published:April 2024
editor(s):Obonyo E
authors:Chi Tian, Ph.D. Candidate
School of Construction Management Technology, Purdue University, West Lafayette, IN, 47907, United States
tian154@purdue.edu

Yunfeng Chen, Associate Professor
School of Construction Management Technology, Purdue University, West Lafayette, IN, 47907, United States
chen428@purdue.edu

Jiansong Zhang, Associate Professor
School of Construction Management Technology, Purdue University, West Lafayette, IN, 47907, United States
zhan3062@purdue.edu

Yiheng Feng, Assistant Professor
Lyles School of Civil Engineering, Purdue University, West Lafayette, IN, 47907, United States
feng333@purdue.edu (*corresponding author)
summary:Accurate classification of workers’ activity is critical to ensure the safety and productivity of construction projects. Previous studies in this area are mostly focused on building construction environments. Worker activity identification and classification in mobile work zone operations is more challenging, due to more dynamic operating environments (e.g., more movements, weather, and light conditions) than building construction activities. In this study, we propose a deep learning (DL) based classification model to classify workers’ activities in mobile work zones. Sensor locations are optimized for various mobile work zone operations, which helps to collect the training data more effectively and save cost. Furthermore, different from existing models, we innovatively integrate transportation and construction domain knowledge to improve classification accuracy. Three mobile work zone operations (trash pickup, crack sealing, and pothole patching) are investigated in this study. Results show that although using all sensors has the highest performance, utilizing two sensors at optimized locations achieves similar accuracy. After integrating the domain knowledge, the accuracy of the DL model is improved. The DL model trained using two sensors integrated with domain knowledge outperforms the DL model trained using three sensors without integrating domain knowledge.
keywords:Activity Classification, Mobile Work Zone, Wearable Sensors, Sensor Location Optimization, Domain Knowledge, Deep Learning
full text: (PDF file, 1.369 MB)
citation:Tian C, Chen Y, Zhang J, Feng Y (2024). Integrating Domain Knowledge with Deep Learning Model for Automated Worker Activity Classification in mobile work zone, ITcon Vol. 29, pg. 264-280, https://doi.org/10.36680/j.itcon.2024.013
statistics: