Trustworthy AI for Structural Health Monitoring: Governance, Reliability, and Human Oversight in Sensor-Based Maintenance Systems
DOI:
https://doi.org/10.63646/SUOB1001Keywords:
Structural Health Monitoring; Trustworthy AI; Explainability; Human Oversight; Sensor Networks; Governance; Deep Learning; Anomaly DetectionAbstract
The integration of artificial intelligence (AI) into structural health monitoring (SHM) systems has accelerated considerably in recent years, offering unprecedented capabilities in real-time damage detection, predictive maintenance, and anomaly identification from large-scale sensor networks deployed across civil and industrial infrastructure. However, the deployment of AI-driven SHM in safety-critical applications raises fundamental questions about trustworthiness: whether these systems can be relied upon to produce accurate, interpretable, and governed outputs under real-world operational conditions. This paper presents a comprehensive framework for trustworthy AI in sensor-based structural health monitoring, addressing four interlocking dimensions: model reliability and uncertainty quantification, explainability and interpretability of AI predictions, governance mechanisms for system accountability, and human oversight integration in the maintenance decision pipeline. Drawing on a multi-sensor testbed comprising 247 sensing nodes deployed across a prestressed concrete bridge and an industrial steel frame structure, we evaluate six deep learning architectures—LSTM, 1D-CNN, ResNet, XGBoost, autoencoder, and a proposed hybrid model—against standardized benchmarks for detection accuracy, false alarm rate, and anomaly localization precision. Our proposed hybrid model achieves a classification accuracy of 96.7%, an F1-score of 0.961, and an average detection delay of 1.4 seconds, outperforming baseline methods by 2.6 to 8.4 percentage points in accuracy. Explainability analysis via SHAP values reveals that sensor channels associated with mid-span deflection and modal frequency shift contribute most significantly to model decisions. A three-tier governance architecture encompassing data audit trails, model versioning, and human-in-the-loop validation protocols is proposed and evaluated through structured expert review. Our findings demonstrate that trustworthy AI frameworks can substantially improve both the technical performance and institutional accountability of AI-based SHM systems, making them viable for deployment in high-stakes infrastructure management contexts.
How to Cite
References
Abdeljaber, O., Avci, O., Kirstein, S., Gabbouj, M., & Inman, D. J. (2017). Real-time vibration-based structural damage detection using one- dimensional convolutional neural networks. Journal of Sound and Vibration, 388, 154–170. https://doi.org/10.1016/j.jsv.2016.10.043
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., ... & Nahavandi, S. (2021). A review of uncertainty quantification in deep learning. Information Fusion, 76, 243–297. https://doi.org/10.1016/j.inffus.2021.05.008
Akyildiz, I. F., Su, W., Sankarasubramaniam, Y., & Cayirci, E. (2002). Wireless sensor networks: A survey. Computer Networks, 38(4), 393–422. https://doi.org/10.1016/S1389-1286(01)00302-4
Arrieta, A. B., Diaz-Rodriguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., ... & Herrera, F. (2020). Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82–115. https://doi.org/10.1016/j.inffus.2019.12.012
Avci, O., Abdeljaber, O., Kiranyaz, S., Hussein, M., Gabbouj, M., & Inman, D. J. (2021). A review of vibration-based damage detection in civil structures: From traditional methods to machine learning and deep learning applications. Mechanical Systems and Signal Processing, 147, 107077. https://doi.org/10.1016/j.ymssp.2020.107077
Balsamo, L., & Betti, R. (2015). Data-based structural health monitoring using small training data sets. Structural Control and Health Monitoring, 22(10), 1240–1264. https://doi.org/10.1002/stc.1742
Bao, Y., Li, H., Sun, X., Yu, Y., & Ou, J. (2013). Compressive sampling-based data loss recovery for wireless sensor networks used in civil structural health monitoring. Structural Health Monitoring, 12(1), 78–95. https://doi.org/10.1177/1475921712462936
Bao, Y., Tang, Z., Li, H., & Zhang, Y. (2019). Computer vision and deep learning-based data anomaly detection method for structural health monitoring. Structural Health Monitoring, 18(2), 401–421. https://doi.org/10.1177/1475921718757405
Carden, E. P., & Fanning, P. (2004). Vibration based condition monitoring: A review. Structural Health Monitoring, 3(4), 355–377. https://doi.org/10.1177/1475921704047500
Cha, Y. J., Choi, W., & Buyukozturk, O. (2017). Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering, 32(5), 361–378. https://doi.org/10.1111/mice.12263
Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly detection: A survey. ACM Computing Surveys, 41(3), 15. https://doi.org/10.1145/1541880.1541882
Chen, Y., Lu, Y., Bulysheva, L., & Kataev, M. Y. (2024). Applications of blockchain in Industry 4.0: Areview. Information Systems Frontiers, 26(5), 1715–1729. https://doi.org/10.1007/s10796-022-10248-7
Das, S., Saha, P., & Patro, S. K. (2016). Vibration-based damage detection techniques used for health monitoring of structures: A review. Journal of Civil Structural Health Monitoring, 6(3), 477–507. https://doi.org/10.1007/s13349-016-0168-5
Doshi-Velez, F., & Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv:1702.08608. https://doi.org/10.48550/arXiv.1702.08608
Endsley, M. R. (2017). From here to autonomy: Lessons learned from human-automation research. Human Factors, 59(1), 5–27. https://doi.org/10.1177/0018720816681350
Farrar, C. R., Doebling, S. W., & Nix, D. A. (2001). Vibration-based structural damage identification. Philosophical Transactions of the Royal Society of London A, 359(1778), 131–149. https://doi.org/10.1098/rsta.2000.0717
Farrar, C. R., & Worden, K. (2007). An introduction to structural health monitoring. Philosophical Transactions of the Royal Society A, 365(1851), 303–315. https://doi.org/10.1098/rsta.2006.1928
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., ... & Vayena, E. (2018). AI4People—An ethical framework for a good AI society. Minds and Machines, 28(4), 689–707. https://doi.org/10.1007/s11023-018-9482-5
Gal, Y., & Ghahramani, Z. (2016). Dropout as a Bayesian approximation: Representing model uncertainty in deep learning. In International Conference on Machine Learning (pp. 1050–1059). PMLR. https://doi.org/10.48550/arXiv.1506.02142
Goodfellow, I., McDaniel, P., & Papernot, N. (2018). Making machine learning robust against adversarial inputs. Communications of the ACM, 61(7), 56–66. https://doi.org/10.1145/3134599
Grigorie, T. L., & Botez, R. M. (2023). Structural health monitoring in aerospace: Challenges and perspectives. Aerospace Science and
Technology, 140, 108461. https://doi.org/10.1016/j.ast.2023.108461
Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., & Yang, G. Z. (2019). XAI—Explainable artificial intelligence. Science Robotics, 4(37), eaay7120. https://doi.org/10.1126/scirobotics.aay7120
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y., De Visser, E. J., & Parasuraman, R. (2011). A meta-analysis offactors affecting trust in human-robot interaction. Human Factors, 53(5), 517–527. https://doi.org/10.1177/0018720811417254
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 770–778). https://doi.org/10.1109/CVPR.2016.90
Hester, D., & Gonzalez, A. (2012). A wavelet-based damage detection algorithm based on bridge acceleration response to a vehicle. Mechanical Systems and Signal Processing, 28, 145–166. https://doi.org/10.1016/j.ymssp.2011.06.007
Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
Hu, W. H., Moutinho, C., Caetano, E., Magalhaes, F., & Cunha, A. (2012). Continuous dynamic monitoring of a lively footbridge for serviceability assessment and damage detection. Mechanical Systems and Signal Processing, 33, 38–55. https://doi.org/10.1016/j.ymssp.2012.05.012
Hullermeier, E., & Waegeman, W. (2021). Aleatoric and epistemic uncertainty in machine learning. Machine Learning, 110(3), 457–506. https://doi.org/10.1007/s10994-021-05946-3
Jaimes, L. G., Calderon, J. M., & Guzman, C. M. (2022). A survey of wireless sensor networks for structural health monitoring: Recent trends and challenges. Information, 13(6), 277. https://doi.org/10.3390/info13060277
Jardine, A. K. S., Lin, D., & Banjevic, D. (2006). A review on machinery diagnostics and prognostics implementing condition-based maintenance. Mechanical Systems and Signal Processing, 20(7), 1483–1510. https://doi.org/10.1016/j.ymssp.2005.09.012
Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389–399. https://doi.org/10.1038/s42256-019-0088-2
Kaur, N., & Bhalla, S. (2015). Combined energy harvesting and structural health monitoring potential of embedded piezo-concrete vibration sensors. Journal of Energy Engineering, 141(4), D4014001. https://doi.org/10.1061/(ASCE)EY.1943-7897.0000224
Kim, S., Pakzad, S., Culler, D., Demmel, J., Fenves, G., Glaser, S., & Turon, M. (2007). Health monitoring of civil infrastructures using wireless sensor networks. In Proceedings of the 6th ACM/IEEE International Conference on Information Processing in Sensor Networks (pp. 254–263). https://doi.org/10.1145/1236360.1236395
Ko, J. M., & Ni, Y. Q. (2005). Technology developments in structural health monitoring of large-scale bridges. Engineering Structures, 27(12), 1715–1725. https://doi.org/10.1016/j.engstruct.2005.02.021
LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539
Lee, J., Wu, F., Zhao, W., Ghaffari, M., Liao, L., & Siegel, D. (2014). Prognostics and health management design for rotary machinery systems. Mechanical Systems and Signal Processing, 42(1–2), 314–334. https://doi.org/10.1016/j.ymssp.2013.06.004
Lei, Y., Liu, C., Jiang, Y. Q., & Mao, Y. K. (2013). Substructure based structural damage detection with limited input and output measurements. Smart Materials and Structures, 21(3), 035034. https://doi.org/10.1088/0964-1726/21/3/035034
Li, H., Li, S., Ou, J., & Li, H. (2010). Modal identification of bridges under varying environmental conditions: Temperature and wind effects. Structural Control and Health Monitoring, 17(5), 495–512. https://doi.org/10.1002/stc.319
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020). Federated learning: Challenges, methods, and future directions. IEEE Signal Processing Magazine, 37(3), 50–60. https://doi.org/10.1109/MSP.2020.2975749
Liu, Y., Yuen, K. V., & Kuok, S. C. (2013). Bayesian real-time structural safety assessment of instrumented buildings. Engineering Structures, 51, 1–12. https://doi.org/10.1016/j.engstruct.2013.01.020
Lu, Y. (2017). Cyber physical system (CPS)-based Industry 4.0: A survey. Journal of Industrial Integration and Management, 2(3), 1750014. https://doi.org/10.1142/S2424862217500142
Lu, Y. (2017). Industry 4.0: A survey on technologies, applications and open research issues. Journal of Industrial Information Integration, 6, 1–10. https://doi.org/10.1016/j.jii.2017.04.005
Lu, Y. (2019). Artificial intelligence: A survey on evolution, models, applications and future trends. Journal of Management Analytics, 6(1), 1–29. https://doi.org/10.1080/23270012.2019.1570365
Lu, Y., & Xu, L. D. (2019). Internet of Things (IoT) cybersecurity research: A review of current research topics. IEEE Internet of Things Journal, 6(2), 2103–2115. https://doi.org/10.1109/JIOT.2018.2869847
Lundberg, S. M., & Lee, S. I. (2017). A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, 30, 4765–4774. https://doi.org/10.48550/arXiv.1705.07874
Lynch, J. P., & Loh, K. J. (2006). A summary review of wireless sensors and sensor networks for structural health monitoring. Shock and Vibration Digest, 38(2), 91–128. https://doi.org/10.1177/0583102406061499
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016). The ethics of algorithms: Mapping the debate. Big Data & Society, 3(2). https://doi.org/10.1177/2053951716679679
Moughty, J. J., & Casas, J. R. (2017). A state ofthe art review of modal-based damage detection in bridges: Development, challenges, and solutions. Applied Sciences, 7(5), 510. https://doi.org/10.3390/app7050510
Ni, Y. Q., Hua, X. G., Fan, K. Q., & Ko, J. M. (2005). Correlating modal properties with temperature using long-term monitoring data and support vector machine technique. Engineering Structures, 27(12), 1762–1773. https://doi.org/10.1016/j.engstruct.2005.02.020
Olimpo, M., Gentile, C., Mulas, M., Anzioso, L., & Ruggieri, G. (2023). Operational modal analysis of a historic church: Structural identification and damage assessment. Engineering Structures, 275, 115249. https://doi.org/10.1016/j.engstruct.2022.115249
Pan, S. J., & Yang, Q. (2009). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10), 1345–1359. https://doi.org/10.1109/TKDE.2009.191
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics, 30(3), 286–297. https://doi.org/10.1109/3468.844354
Park, G., Cudney, H. H., & Inman, D. J. (2000). Impedance-based health monitoring of civil structural components. Journal of Infrastructure Systems, 6(4), 153–160. https://doi.org/10.1061/(ASCE)1076-0342(2000)6:4(153)
Peng, Z. K., & Chu, F. L. (2004). Application of the wavelet transform in machine condition monitoring and fault diagnostics. Mechanical Systems and Signal Processing, 18(2), 199–221. https://doi.org/10.1016/S0888-3275(03)00075-X
Pimentel, M. A., Clifton, D. A., Clifton, L., & Tarassenko, L. (2014). A review of novelty detection. Signal Processing, 99, 215–249. https://doi.org/10.1016/j.sigpro.2013.12.026
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., . .. & Barnes, P. (2020). Closing the AI accountability gap. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (pp. 33–44). https://doi.org/10.1145/3351095.3372873
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). "Why should I trust you?" Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining (pp. 1135–1144). https://doi.org/10.1145/2939672.2939778
Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206–215. https://doi.org/10.1038/s42256-019-0048-x
Salehi, H., & Burgueno, R. (2018). Emerging artificial intelligence methods in structural engineering. Engineering Structures, 171, 170–189. https://doi.org/10.1016/j.engstruct.2018.05.084
Sarmadi, H., Entezami, A., & Ghalehnovi, M. (2021). On model-based damage detection by an enhanced sensitivity matrix of modal data. Journal of Vibration and Control, 27(3–4), 526–541. https://doi.org/10.1177/1077546320938310
Seshia, S. A., Sadigh, D., & Sastry, S. S. (2018). Formal specification for deep neural networks. In Proceedings of the International Symposium on Automated Technology for Verification and Analysis (pp. 20–34). https://doi.org/10.1007/978-3-030-01090-4_1
Sohn, H., Farrar, C. R., Hunter, N. F., & Worden, K. (2001). Structural health monitoring using statistical pattern recognition techniques. Journal of Dynamic Systems, Measurement, and Control, 123(4), 706–711. https://doi.org/10.1115/1.1410933
Sony, S., Laventure, S., & Sadhu, A. (2019). A literature review of next-generation smart sensing technology in structural health monitoring. Structural Control and Health Monitoring, 26(3), e2321. https://doi.org/10.1002/stc.2321
Tao, F., Qi, Q., Wang, L., & Nee, A. (2019). Digital twins and cyber-physical systems toward smart manufacturing and industry 4.0. Engineering, 5(4), 653–661. https://doi.org/10.1016/j.eng.2019.01.011
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. https://doi.org/10.48550/arXiv.1706.03762
Wang, Z., & Cha, Y. J. (2021). Unsupervised deep learning approach using a deep auto-encoder with a one-class support vector machine to detect structural damage. Structural Health Monitoring, 20(1), 406–425. https://doi.org/10.1177/1475921720934051
Whittlestone, J., Nyrup, R., Alexandrova, A. , & Cave, S. (2019). The role and limits of principles in AI ethics. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (pp. 195–200). https://doi.org/10.1145/3306618.3314289
Worden, K., Farrar, C. R., Manson, G., & Park, G. (2007). The fundamental axioms of structural health monitoring. Proceedings of the Royal Society A, 463(2082), 1639–1664. https://doi.org/10.1098/rspa.2007.1834
Xu, L. D., Lu, Y., & Li, L. (2021). Embedding blockchain technology into IoT for security: A survey. IEEE Internet of Things Journal, 8(13), 10452–10473. https://doi.org/10.1109/JIOT.2021.3060508
Xu, Y. L., & Xia, Y. (2012). Structural Health Monitoring of Long-Span Suspension Bridges. Spon Press. https://doi.org/10.1201/b11964
Ye, X. W., Jin, T., & Yam, C. (2019). A review on deep learning-based structural health monitoring of civil infrastructures. Smart Structures and Systems, 24(5), 567–585. https://doi.org/10.12989/sss.2019.24.5.567
Yi, T. H., Li, H. N., & Gu, M. (2013). Experimental assessment of high-rate GPS receivers for deformation monitoring of bridge. Measurement, 46(1), 420–432. https://doi.org/10.1016/j.measurement.2012.07.018
Yuen, K. V., & Mu, H. Q. (2015). Real-time system identification: An algorithm for simultaneous model class selection and parametric identification. Computer-Aided Civil and Infrastructure Engineering, 30(10), 785–801. https://doi.org/10.1111/mice.12146
Zhang, C., & Lu, Y. (2021). Study on artificial intelligence: The state of the art and future prospects. Journal of Industrial Information
Integration, 23, 100224. https://doi.org/10.1016/j.jii.2021.100224
Zhang, L., Wu, H., Bao, Y., & Li, H. (2022). Label-efficient time series learning for structural health monitoring with semi-supervised learning. Structural Health Monitoring, 21(6), 2710–2728. https://doi.org/10.1177/14759217221075552
Zhang, Q. W. (2007). Statistical damage identification for bridges using ambient vibration data. Computers & Structures, 85(7–8), 476–485. https://doi.org/10.1016/j.compstruc.2006.08.071
Zhang, W., Zhao, P., Li, A., & Ding, W. (2019). Automated pixel-level pavement crack detection on 3D asphalt surfaces with a recurrent neural network. Computer-Aided Civil and Infrastructure Engineering, 34(3), 213–229. https://doi.org/10.1111/mice.12409
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019). Deep learning and its applications to machine health monitoring. Mechanical Systems and Signal Processing, 115, 213–237. https://doi.org/10.1016/j.ymssp.2018.05.050
Zhou, X. Q., Xia, Y., & Weng, S. (2015). L1 regularization approach to structural damage detection using frequency data. Structural Health Monitoring, 14(6), 571–582. https://doi.org/10.1177/1475921715604386
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., ... & He, Q. (2021). A comprehensive study of transfer learning. Proceedings of the IEEE, 109(1), 43–76. https://doi.org/10.1109/JPROC.2020.3004555
Zimmerman, A. T., Shiraishi, M., Swartz, R. A., & Lynch, J. P. (2008). Automated modal parameter estimation by parallel processing within wireless monitoring systems. Journal of Infrastructure Systems, 14(1), 102–113. https://doi.org/10.1061/(ASCE)1076- 0342(2008)14:1(102)