Lightweight Real-time Detection of Components via a Micro Aerial Vehicle with Domain Randomization Towards Structural Health Monitoring

Authors

  • Isaac Osei Agyemang
    Affiliation

    School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China

  • Xiaoling Zhang
    Affiliation

    School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China

  • Isaac Adjei-Mensah
    Affiliation

    School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China

  • Joseph Roger Arhin
    Affiliation

    School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China

  • Emmanuel Agyei
    Affiliation

    School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China

https://doi.org/10.3311/PPci.18689

Abstract

Civil structural component detection plays an integral role in Structural Health Monitoring (SHM) pre and post-construction. Challenges including but not limited to labor-intensiveness, cost, and time constraints associated with traditional methods make it a less opti-mal approach in SHM. Despite the success of deep convolutional neural networks in diverse detection problems, the required computational resources are a challenge. This has led to rendering a chunk of resource-constrained edge nodes less applicable with deep convolutional neural networks. In this paper, a computational-efficient deep convolutional neural network is presented based on Gabor filters and a color Canny edge detector. Generic Gabor filters are generated and used as initializers in the computational-efficient deep convolutional neural network presented, afterward trained on building components data. Next, extensive offline and online experimentation with a resource-constrained edge node is conducted and evaluated using diverse metrics. The computational-efficient detection model demonstrates to be effective in detection and via NVIDIA GPU profiler, we observe conservation of around 30% of computational resources during training. The computational-efficient detection model adduces almost a 3% mean average precision higher than two state-of-the-art detectors and records a promising frame processing rate during the online experimentation.

Keywords:

Gabor filters, color Canny edge detector, micro aerial vehicle, structural health monitoring, deep convolutional neural network

Published Online

2022-03-30

How to Cite

Agyemang, I. O., Zhang, X., Adjei-Mensah, I., Arhin, J. R., Agyei, E. “Lightweight Real-time Detection of Components via a Micro Aerial Vehicle with Domain Randomization Towards Structural Health Monitoring”, Periodica Polytechnica Civil Engineering, 66(2), pp. 516–531, 2022. https://doi.org/10.3311/PPci.18689

Issue

Section

Research Article