Evaluation of Different Methods of Machine Vision in Health Monitoring and Damage Detection of Structures

Document Type : Regular Paper

Authors

1 PhD., Faculty of Civil Engineering, Semnan University, Semnan, Iran

2 Associate Professor, Faculty of Civil Engineering, Semnan University, Semnan, Iran

3 Professor, Faculty of Civil Engineering, Semnan University, Semnan, Iran

4 Associate Professor, Faculty of Electronic Engineering and Robotic, Shahrood University of Technology, Shahrood, Iran

Abstract

The application of Digital Image Processing (DIP) and computer vision is increasing in civil engineering branches nowadays. By implementing DIP methods, analyzation, and detection of intended objects and elements on the images will be done. So, these methods can be used for automatic inspection and decreasing manpower's direct controls on structures and infrastructures. This paper will study the application of DIP such as health monitoring and damage detection in structures. After reviewing various researches in this field, a classification including five classes was done. These classes including 1-identification and evaluation of the crack, 2-identification and evaluation of defects in steel structures, 3-identification and evaluation of other imperfections and defects, 4-deflection, deformation, and vibration assessment, and 5-identification of texture, dimensions, elements, and components. The researches also are classified based on various aspects such as the implemented methods, specification of images, the performance of the method, and so on. Finally, after investigating the shortage of researches, the future suggestion for researchers was made.

Highlights

  • The study of researches in the field of digital image processing indicated that this science will increasingly find its place in monitoring and controlling the structures and infrastructures.
  • Research in this area can be classified into five categories as 1- identification and evaluation of crack; 2- identification and evaluation of defects in steel structures; 3- identification and evaluation of other imperfections and defects; 4- evaluation of deflection, deformation, and vibration; 5- identification of texture, dimensions, elements, and components.
  • From the review of various papers, it was concluded that image processing can be performed in two dimensional or three-dimensional model, which parameters such as cracks and surface damage in 3D models can be identified with high precision.
  • In all studies that calculated the deflection and displacement of an elements such as beams; this was done in cases where the images of that element before and after applying the load, exist and the discrepancy was determined by comparing the images in these two stages.

Keywords

Main Subjects


[1] Shahrokhinasab E, Hosseinzadeh N, Monirabbasi A, Torkaman S. Performance of image-based crack detection systems in concrete structures. Journal of Soft Computing In Civil Engineering. 2020;4:127-39.
[2] Koch C, Georgieva K, Kasireddy V, Akinci B, Fieguth P. A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Advanced Engineering Informatics. 2015;29:196-210.
[3] Liu Y-F, Cho S, Spencer BF, Fan J-S. Concrete crack assessment using digital image processing and 3d scene reconstruction. Journal of Computing in Civil Engineering. 2016;30:04014124.
[4] Anagnostopoulos I, Pătrăucean V, Brilakis I, Vela P. Detection of walls, floors, and ceilings in point cloud data, Construction Research Congress. 2016.
[5] Torok Matthew M, Golparvar-Fard M, Kochersberger Kevin B. Image-based automated 3d crack detection for post-disaster building assessment. Journal of Computing in Civil Engineering. 2014;28:A4014004.
[6] Khaloo A, Lattanzi D. Robust outlier detection and normal estimation in noisy infrastructure 3d point clouds. ASCE International Workshop on Computing in Civil Engineering. 2017.
[7] Powers D. What the f-measure doesn't measure. ArXiv:1503.06410. 2014.
[8] David Olson DD. Advanced data mining techniques. Springer. 2008.
[9] Blair DC. Information retrieval, 2nd ed. C.J. Van Rijsbergen. London: Butterworths; 1979: 208 pp. Journal of the American Society for Information Science. 1979;30:374-5.
[10] Bishop C. Pattern recognition and machine learning: Springer-Verlag New York.
[11] Fan Z, Wu Y, Lu J, Li W. Automatic pavement crack detection based on structured prediction with the convolutional neural network. ArXiv. 2018.
[12] Mathavan S, Rahman M, Kamal K. Use of a Self-organizing map for crack detection in highly textured pavement images. Journal of Infrastructure Systems. 2015;21:04014052.
[13] Li L, Lijun S, Guobao N, Shengguang T. Automatic pavement crack recognition based on BP neural network. Traffic & Transportation. 2014;26(1):11-2.
[14] Salman M, Mathavan S, Kamal K, Rahman M. Pavement crack detection using the Gabor filter. 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013)2013. p. 2039-44.
[15] Oliveira H, Correia PL. Automatic road crack detection and characterization. IEEE Transactions on Intelligent Transportation Systems. 2013;14:155-68.
[16] Prateek P, Kristin D, Nenad G, Basily B. Computer-vision based crack detection and analysis. Proc. SPIE 8345, Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems. 2012.
[17] Amarasiri S, Gunaratne M, Sarkar S. Modeling of crack depths in digital images of concrete pavements using optical reflection properties. Journal of Transportation Engineering. 2010;136:489-99.
[18] Saar T, Talvik O. Automatic asphalt pavement crack detection and classification using neural networks. 12th Biennial Baltic Electronics Conference 2010. p. 345-8.
[19] Bray J, Verma B, Xue L, He W. A neural network based technique for automatic classification of road cracks. The 2006 IEEE International Joint Conference on Neural Network Proceedings2006. p. 907-12.
[20] Hoang N-D, Nguyen Q-L, Bui DT. Image processing based classification of asphalt pavement cracks using support vector machine optimized by artificial bee colony. Journal of Computing in Civil Engineering. 2018;32:04018037.
[21] Qiu S, Wang W, Wang S, Wang KCP. Methodology for accurate AASHTO PP67-10-based cracking quantification using 1-mm 3D pavement images. Journal of Computing in Civil Engineering. 2017;31:04016056.
[22] Zhang L, Yang F, Zhang YD, Zhu YJ. Road crack detection using deep convolutional neural network. 2016 IEEE International Conference on Image Processing (ICIP)2016. p. 3708-12.
[23] Zhang A, Wang KCP, Li B, Yang E, Dai X, Peng Y, et al. Automated pixel-level pavement crack detection on 3d asphalt surfaces using a deep-learning network. Computer-Aided Civil and Infrastructure Engineering. 2017;32:805-19.
[24] Shahabian Moghaddam R, Mohammadzadeh Moghaddam A, Sahaf SA, Pourreza Hr. Second-order statistical texture representation of asphalt pavement distress images based on local binary pattern in spatial and wavelet domain. Journal of Rehabilitation in Civil Engineering. 2019;7:48-67.
[25] Zakeri H, Nejad FM, Fahimifar A. Image based techniques for crack detection, classification and quantification in asphalt pavement: a review. Archives of Computational Methods in Engineering. 2017;24:935-77.
[26] Yang Y-S, Yang C-M, Huang C-W. Thin crack observation in a reinforced concrete bridge pier test using image processing and analysis. Advances in Engineering Software. 2015;83:99-108.
[27] Adhikari RS, Moselhi O, Bagchi A. Image-based retrieval of concrete crack properties for bridge inspection. Automation in Construction. 2014;39:180-94.
[28] Yu Y-b, Li W-h, Zhang J-q, Nie J-g. Bridge crack extraction method based on image-connected domain. Journal of Highway and Transportation Research and Development (English Edition).7:34-7.
[29] Oh J-K, Jang G, Oh S, Lee JH, Yi B-J, Moon YS, et al. Bridge inspection robot system with machine vision. Automation in Construction. 2009;18:929-41.
[30] Abdel-Qader I, Abudayyeh O, Kelly Michael E. Analysis of edge-detection techniques for crack identification in bridges. Journal of Computing in Civil Engineering. 2003;17:255-63.
[31] German S, Jeon J-S, Zhu Z, Bearman C, Brilakis I, DesRoches R, et al. Machine vision-enhanced postearthquake inspection. Journal of Computing in Civil Engineering. 2013;27:622-34.
[32] Jahanshahi MR, Masri SF. Adaptive vision-based crack detection using 3D scene reconstruction for condition assessment of structures. Automation in Construction. 2012;22:567-76.
[33] Talab AMA, Huang Z, Xi F, HaiMing L. Detection crack in image using Otsu method and multiple filtering in image processing techniques. Optik. 2016;127:1030-3.
[34] Lattanzi D, Miller Gregory R. Robust automated concrete damage detection algorithms for field applications. Journal of Computing in Civil Engineering. 2014;28:253-62.
[35] Alam SY, Loukili A, Grondin F, Rozière E. Use of the digital image correlation and acoustic emission technique to study the effect of structural size on cracking of reinforced concrete. Engineering Fracture Mechanics. 2015;143:17-31.
[36] Yiyang Z. The design of glass crack detection system based on image preprocessing technology. 2014 IEEE 7th Joint International Information Technology and Artificial Intelligence Conference2014. p. 39-42.
[37] Fujita Y, Hamamoto Y. A robust automatic crack detection method from noisy concrete surfaces. Machine Vision and Applications. 2011; 22, 245–254.
[38] Wang P, Huang H. Comparison analysis on present image-based crack detection methods in concrete structures. 2010 3rd International Congress on Image and Signal Processing2010. p. 2530-3.
[39] Lins RG, Givigi SN. Automatic crack detection and measurement based on image analysis. IEEE Transactions on Instrumentation and Measurement. 2016;65:583-90.
[40] Jahanshahi M, Masri S, W. Padgett C, S. Sukhatme G. An innovative methodology for detection and quantification of cracks through incorporation of depth perception. Machine Vision and Applications. 2013; 24, 227–241.
[41] Hamrat M, Boulekbache B, Chemrouk M, Amziane S. Flexural cracking behavior of normal strength, high strength and high strength fiber concrete beams, using Digital Image Correlation technique. Construction and Building Materials. 2016;106:678-92.
[42] H. Peters W, F. Ranson W. Digital imaging techniques in experiment stress analysis. Optical Engineering. 1982; 21(3), 213427.
[43] Sutton M, J. Wolters W, Iii Peters WH, F. Ranson W, R. McNeill S. Determination of displacements using an improved digital image correlation method. Image and Vision Computing. 1983; 1(3), 133-139.
[44] Shan B, Zheng S, Ou J. A stereovision-based crack width detection approach for concrete surface assessment. KSCE J Civ Eng. 2015; 20, 803–812.
[45] Valença J, Dias-da-Costa D, Júlio E, Araújo H, Costa H. Automatic crack monitoring using photogrammetry and image processing. Measurement. 2013;46:433-41.
[46] Valença J, Dias-da-Costa D, Júlio ENBS. Characterisation of concrete cracking during laboratorial tests using image processing. Construction and Building Materials. 2012;28:607-15.
[47] Sinha SK, Fieguth PW. Automated detection of cracks in buried concrete pipe images. Automation in Construction. 2006;15:58-72.
[48] Iyer S, Sinha SK. A robust approach for automatic detection and segmentation of cracks in underground pipeline images. Image and Vision Computing. 2005;23:921-33.
[49] Nghiem H-L, Al Heib M, Emeriault F. Method based on digital image correlation for damage assessment in masonry structures. Engineering Structures. 2015;86:1-15.
[50] Jalili Ghazizade M, Abduli MA, Safari E, Gatmiri B. Development of a simplified image processing technique for determining crack intensity factor of compacted clayey soils. jeg. 2011;5:1137-58.
[51] Li S, Zhao X. Image-based concrete crack detection using convolutional neural network and exhaustive search technique. Advances in Civil Engineering. 2019;2019:6520620.
[52] Cha Y-J, Choi W, Büyüköztürk O. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering. 2017;32:361-78.
[53] Kim H, Ahn E, Shin M, Sim S-H. Crack and noncrack classification from concrete surface images using machine learning. Structural Health Monitoring. 2018;18:725-38.
[54] Hoskere V, Narazaki Y, Hoang TA, Spencer BF. Vision-based structural inspection using multiscale deep convolutional neural networks. ArXiv. 2018;abs/1805.01055.
[55] Kim H, Ahn E, Cho S, Shin M, Sim S-H. Comparative analysis of image binarization methods for crack identification in concrete structures. Cement and Concrete Research. 2017;99:53-61.
[56] Prasanna P, Dana KJ, Gucunski N, Basily BB, La HM, Lim RS, et al. Automated crack detection on concrete bridges. IEEE Transactions on Automation Science and Engineering. 2016;13:591-9.
[57] Zhang W, Zhang Z, Qi D, Liu Y. Automatic crack detection and classification method for subway tunnel safety monitoring. Sensors (Basel, Switzerland). 2014;14:19307-28.
[58] Ranjan R, Khan AR, Parikh C, Jain R, Mahto RP, Pal S, et al. Classification and identification of surface defects in friction stir welding: An image processing approach. Journal of Manufacturing Processes. 2016;22:237-53.
[59] Bhat NN, Kumari K, Dutta S, Pal SK, Pal S. Friction stir weld classification by applying wavelet analysis and support vector machine on weld surface images. Journal of Manufacturing Processes. 2015;20:274-81.
[60] Saranath KM, Sharma A, Ramji M. Zone wise local characterization of welds using digital image correlation technique. Optics and Lasers in Engineering. 2014;63:30-42.
[61] Rajashekar R, Rajaprakash BM, Upadhya S. Assessment of friction stir weld quality by analyzing the weld bead surface using both digital image processing and acoustic emission techniques. In: Mishra R.S., Mahoney M.W., Sato Y., Hovanski Y. (eds) Friction Stir Welding and Processing VIII. Springer, Cham.2015.
[62] You D, Gao X, Katayama S. Monitoring of high-power laser welding using high-speed photographing and image processing. Mechanical Systems and Signal Processing. 2014;49:39-52.
[63] Ghosh A, Chattopadhyaya S, Das R, Sarkar P. Assessment of heat affected zone of submerged arc welding process through digital image processing. Procedia Engineering. 2011; 10, 2782-2785.
[64] Zapata J, Vilar R, Ruiz R. Performance evaluation of an automatic inspection system of weld defects in radiographic images based on neuro-classifiers. Expert Systems with Applications. 2011;38:8812-24.
[65] Anouncia SM, Saravanan R. A knowledge model for gray scale image interpretation with emphasis on welding defect classification—An ontology based approach. Computers in Industry. 2010;61:742-9.
[66] Shafeek HI, Gadelmawla ES, Abdel-Shafy AA, Elewa IM. Assessment of welding defects for gas pipeline radiographs using computer vision. NDT & E International. 2004;37:291-9.
[67] Murthy V, Ullegaddi K, Mahesh B, Rajaprakash BM. Application of image processing and acoustic emission technique in monitoring of friction stir welding process. Materials Today: Proceedings. 2017;4:9186-95.
[68] Yeum CM, Dyke SJ. Vision-based automated crack detection for bridge inspection. Computer-Aided Civil and Infrastructure Engineering. 2015;30:759-70.
[69] Jahanshahi MR, Masri SF. Parametric performance evaluation of wavelet-based corrosion detection algorithms for condition assessment of civil infrastructure systems. Journal of Computing in Civil Engineering. 2013;27:345-57.
[70] Son H, Hwang N, Kim C, Kim C. Rapid and automated determination of rusted surface areas of a steel bridge for robotic maintenance systems. Automation in Construction. 2014;42:13-24.
[71] Xu Y, Bao Y, Chen J, Zuo W, Li H. Surface fatigue crack identification in steel box girder of bridges by a deep fusion convolutional neural network based on consumer-grade camera images. Structural Health Monitoring. 2018;18:653-74.
[72] Xu Y, Li S, Zhang D, Jin Y, Zhang F, Li N, et al. Identification framework for cracks on a steel structure surface by a restricted Boltzmann machines algorithm based on consumer-grade camera images. Structural Control and Health Monitoring. 2018;25:e2075.
[73] Valeti B, Pakzad S. Automated detection of corrosion damage in power transmission lattice towers using image processing. Structural Congress. 2017.
[74] Zhu Z, Brilakis I. Machine vision-based concrete surface quality assessment. Journal of Construction Engineering and Management. 2010;136:210-8.
[75] Dawood T, Zhu Z, Zayed T. Computer vision–based model for moisture marks detection and recognition in subway networks. Journal of Computing in Civil Engineering. 2018;32:04017079.
[76] Adhikari RS, Moselhi O, Bagchi A, Rahmatian A. Tracking of defects in reinforced concrete bridges using digital images. Journal of Computing in Civil Engineering. 2016;30:04016004.
[77] Karaşahin M, Saltan M, Çetin S. Determination of seal coat deterioration using image processing methods. Construction and Building Materials. 2014;53:273-83.
[78] Kabir S. Imaging-based detection of AAR induced map-crack damage in concrete structure. NDT & E International. 2010;43:461-9.
[79] Saeediyeh P, Arezoomand S, Sebt MH, Golroo A. Manage patches in maintaining and repairing road pavement using image processing. 3rd International Conference on sustainable development in road construction. Shiraz: Shiraz University; 2017.
[80] Firoozi Yeganeh S, Mahmoudzadeh A, Golroo A, Jahanshahi M. Using 3D reconstruction of pavement surface to detect pavement distresses via Kinect. Amirkabir Journal of Civil Engineering. 2018.
[81] Naderi H, Zakaee Ashtiyani M. Automatic evaluation of asphalt pavement crash by image processing. 3rd International Conference Application Research in Civil Engineering, Architecture and Urban Management. Tehran: 2015.
[82] Paal S, Jeon J-S, Brilakis I, Desroches R. Automated damage index estimation of reinforced concrete columns for post-earthquake evaluations. Journal of Structural Engineering. 2015;141:04014228.
[83] Fukuda Y, Feng MQ, Narita Y, Kaneko S, Tanaka T. Vision-based displacement sensor for monitoring dynamic response using robust object search algorithm. IEEE Sensors Journal. 2013;13:4725-32.
[84] Bridge J, Mechitov K, Sim S-H, Nagayama T, Jang S, Kim R, et al. Flexible smart sensor framework for autonomous structural health monitoring. Smart Structures and Systems. 2010;6.
[85] Cho S, Giles RK, Spencer Jr BF. System identification of a historic swing truss bridge using a wireless sensor network employing orientation correction. Structural Control and Health Monitoring. 2015;22:255-72.
[86] Lattanzi D, Miller Gregory R, Eberhard Marc O, Haraldsson Olafur S. Bridge column maximum drift estimation via computer vision. Journal of Computing in Civil Engineering. 2016;30:04015051.
[87] Spencer BF, Hoskere V, Narazaki Y. Advances in computer vision-based civil infrastructure inspection and monitoring. Engineering. 2019;5:199-222.
[88] Ye XW, Dong CZ, Liu T. A Review of machine vision-based structural health monitoring: methodologies and applications. Journal of Sensors. 2016;2016:7103039.
[89] Feng D, Feng MQ. Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection – A review. Engineering Structures. 2018;156:105-17.
[90] Hoult NA, Andy Take W, Lee C, Dutton M. Experimental accuracy of two dimensional strain measurements using Digital Image Correlation. Engineering Structures. 2013;46:718-26.
[91] Dutton M, Take WA, Hoult NA. Curvature monitoring of beams using digital image correlation. Journal of Bridge Engineering. 2014;19:05013001.
[92] Sutton M, Orteu J-J, Schreier H. Image correlation for shape, motion and deformation measurements. Basic Concepts, Theory and Applications2009.
[93] Pan B, Qian K, Xie H, Asundi A. Topical review: Two-dimensional digital image correlation for in-plane displacement and strain measurement: a review. Measurement Science & Technology - Meas sci technol. 2009;20.
[94] Yang Y, Dorn C, Mancini T, Talken Z, Kenyon G, Farrar C, et al. Blind identification of full-field vibration modes from video measurements with phase-based video motion magnification. Mechanical Systems and Signal Processing. 2017;85:567-90.
[95] Yoon H, Elanwar H, Choi H, Golparvar-Fard M, Spencer Jr BF. Target-free approach for vision-based structural system identification using consumer-grade cameras. Structural Control and Health Monitoring. 2016;23:1405-16.
[96] Furukawa Y, Curless B, Seitz SM, Szeliski R. Towards Internet-scale multi-view stereo. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition2010. p. 1434-41.
[97] Pan B, Tian L, Song X. Real-time, non-contact and targetless measurement of vertical deflection of bridges using off-axis digital image correlation. NDT & E International. 2016;79:73-80.
[98] Lee JJ, Shinozuka M. A vision-based system for remote sensing of bridge displacement. NDT & E International. 2006;39:425-31.
[99] Banks J, Marimon Giovannetti L, Soubeyran X, Wright AM, Turnock SR, Boyd SW. Assessment of digital image correlation as a method of obtaining deformations of a structure under fluid load. Journal of Fluids and Structures. 2015;58:173-87.
[100] Ferrer B, Acevedo P, Espinosa J, Mas D. Targetless image-based method for measuring displacements and strains on concrete surfaces with a consumer camera. Construction and Building Materials. 2015;75:213-9.
[101] Li G, Tan Q, Sun Q, Hou Y. Normal strain measurement by machine vision. Measurement. 2014;50:106-14.
[102] Henke K, Pawlowski R, Schregle P, Winter S. Use of digital image processing in the monitoring of deformations of building Structures2014.
[103] Uhl T, Kohut P, Holak K, Krupinski K. Vision based condition assessment of structures. Journal of Physics Conference Series (Online). 2011; 305(1), 10.
[104] Majidi A, Amir Hosseini M. The method of image processing in the laboratory study of the behavior of concrete specimens enclosed with steel and FRP. Contemporary Iranian Civil, Architectural and Urban Planning Conference. Tehran: Shahid beheshti university; 2017.
[105] Tarighat A, Dadar E. Application of the new method for image and video processing to determine the mechanical properties of bending members. 6th National Congress on Civil Engineering. Semnam: Semnan University; 2011.
[106] Dong CZ, Ye XW, Jin T. Identification of structural dynamic characteristics based on machine vision technology. Measurement. 2018;126:405-16.
[107] Lee J, Lee K-C, Cho S, Sim S-H. Computer vision-based structural displacement measurement robust to light-induced image degradation for in-service bridges. Sensors. 2017;17:2317.
[108] Park J-W, Moon D-S, Yoon H, Gomez F, Spencer Jr. BF, Kim JR. Visual–inertial displacement sensing using data fusion of vision-based displacement with acceleration. Structural Control and Health Monitoring. 2018;25:e2122.
[109] Abdelbarr M, Chen Y, Jahanshahi M, Masri S, Shen W, Qidwai U. 3D dynamic displacement-field measurement for structural health monitoring using inexpensive rgb-d based sensor. Smart Materials and Structures. 2017;26.
[110] Ye XW, Yi T-H, Dong CZ, Liu T. Vision-based structural displacement measurement: System performance evaluation and influence factor analysis. Measurement. 2016;88:372-84.
[111] Feng D, Feng MQ. Vision-based multipoint displacement measurement for structural health monitoring. Structural Control and Health Monitoring. 2016;23:876-90.
[112] Xu Y, Brownjohn J, Kong D. A non-contact vision-based system for multipoint displacement monitoring in a cable-stayed footbridge. Structural Control and Health Monitoring. 2018:e2155.
[113] Mas D, Ferrer B, Acevedo P, Espinosa J. Methods and algorithms for video-based multi-point frequency measuring and mapping. Measurement. 2016;85:164-74.
[114] Chen Z, Li H, Bao Y, Li N, Jin Y. Identification of spatio-temporal distribution of vehicle loads on long-span bridges using computer vision technology. Structural Control and Health Monitoring. 2016;23:517-34.
[115] Hoskere V, Park J-W, Yoon H, Spencer Billie F. Vision-based modal survey of civil infrastructure using unmanned aerial vehicles. Journal of Structural Engineering. 2019;145:04019062.
[116] Helfrick MN, Niezrecki C, Avitabile P, Schmidt T. 3D digital image correlation methods for full-field vibration measurement. Mechanical Systems and Signal Processing. 2011;25:917-27.
[117] Mahal M, Blanksvärd T, Täljsten B, Sas G. Using digital image correlation to evaluate fatigue behavior of strengthened reinforced concrete beams. Engineering Structures. 2015;105:277-88.
[118] Ghorbani R, Matta F, Sutton MA. Full-field deformation measurement and crack mapping on confined masonry walls using digital image correlation. Experimental Mechanics. 2015;55:227-43.
[119] Zhou Z, Gong J, Guo M. Image-based 3d reconstruction for posthurricane residential building damage assessment. Journal of Computing in Civil Engineering. 2016;30:04015015.
[120] Yoneyama S, Ueda H. Bridge deflection measurement using digital image correlation with camera movement correction. Materials transactions. 2012;53:285-90.
[121] Farhang SH, Rezayfar O, Sharbatdar Mk, Ahmadyfard A. Rapid estimation method for vertical deflection measurement of building components based on image processing techniques. Journal of Performance of Constructed Facilities. 2020;35.
[122] Zhu Z, Brilakis I. Concrete column recognition in images and videos. Journal of Computing in Civil Engineering. 2010;24:478-87.
[123] Rashidi A, Sigari M-H, Maghiar M, Citrin Ds. An analogy between various machine-learning techniques for detecting construction materials in digital images. KSCE J Civ Eng. 2015; 20, 1178–1188.
[124] Cha Y-J, Choi W, Suh G, Mahmoudkhani S, Büyüköztürk O. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Computer-Aided Civil and Infrastructure Engineering. 2018;33:731-47.
[125] Hoskere V, Narazaki Y, Hoang T, Spencer, Jr. Towards automated post-earthquake inspections with deep learning-based condition-aware models. ArXiv:1809.09195. 2018.
[126] Lu R, Brilakis I, Middleton CR. Detection of structural components in point clouds of existing RC bridges. Computer-Aided Civil and Infrastructure Engineering. 2019;34:191-212.
[127] Gao Y, Mosalam KM. Deep transfer learning for image-based structural damage recognition. Computer-Aided Civil and Infrastructure Engineering. 2018;33:748-68.
[128] Liang X. Image-based post-disaster inspection of reinforced concrete bridge systems using deep learning with Bayesian optimization. Computer-Aided Civil and Infrastructure Engineering. 2019;34:415-30.
[129] Narazaki Y, Hoskere V, Hoang TA, Fujino Y, Sakurai A, Spencer Jr. BF. Vision-based automated bridge component recognition with high-level scene consistency. Computer-Aided Civil and Infrastructure Engineering. 2020;35:465-82.
[130] Oliveira A, Jr LR. Evaluation of the superficial texture of concrete pavers using digital image processing. Journal of Construction Engineering and Management. 2015;141:04015034.
[131] Uslu B, Golparvar-Fard M, de la Garza Jesus M. Image-Based 3D reconstruction and recognition for enhanced highway condition assessment. International Workshop on Computing in Civil Engineering. 2011.
[132] Shirvani GR. Analysis and determination of the parameters of hot stone asphalt aggregates with image processing. 3rd Scientific Congress of the New Horizons in Civil Engineering, Architecture, Culture and Urban Management of Iran. Tehran: 2016.
[133] Moghadas Nejad F, Karimi N, Zakeri H. Providing a new criterion to evaluate the skid resistance of asphalt pavement. Amirkabir J Civil Eng. 2017;49:389-402.
[134] Moghadas Nejad F, Makhmalbaf MM, Zakeri H. Improving the result of asphalt mixtures density derived from CT images using fuzzy thresholding. Amirkabir Journal of Civil Engineering. 2018;49:779-90.
[135] Moghaddas Nejad F, Zare Motekhases F, Mehrabi A, Zakeri H. Achieve the properties of asphalt concrete mixtures using image processing techniques. 7th Iran Bitumen and Asphalt Workshop: Tehran, 2015.
[136] Nili M, Aslani M. Using image processing to evaluate the static separation of self-compacting concrete. 5th national conference of Iran concrete, Iran concrete institute, Tehran, 2013.
[137] Keymanesh MR, Nasrollahtabar A, Shahryari N. Internal structure features of asphalt mixture for field samples. Journal of Rehabilitation in Civil Engineering. 2018;6:10-20.
[138] González-Aguilera D, Gómez-Lahoz J. Dimensional analysis of bridges from a single image. Journal of Computing in Civil Engineering. 2009;23:319-29.
[139] Tsai Y, Hu Z, Wang Z. Vision-based roadway geometry computation. Journal of Transportation Engineering. 2010;136:223-33.
[140] Payesteh M, Lashkar-Ara B, Fathi Moghadam M. An Estimation of the particle-size Distribution in gravel bed river Using Image Processing. Irrigation Sciences and Engineering. 2018;40:125-39.
[141] Li L, Lijun S, Guobao N, Shengguang T. Automatic pavement crack recognition based on BP neural network. Promet - Traffic & Transportation. 2014; 1;26(1):11-2.
[142] Liu Y, Cho S, Spencer B, Fan J. Automated assessment of cracks on concrete surfaces using adaptive digital image processing. Smart Structures and Systems. 2014;14:719-41.
[143] Nishikawa T, Yoshida J, Sugiyama T, Fujino Y. Concrete crack detection by multiple sequential image filtering. Computer-Aided Civil and Infrastructure Engineering. 2012;27:29-47.
[144] Talebi kojidi M, Rezayfar O. Simulation of the effects of axial load on the shape of the panel system mode with free support conditions using the idea of image processing. 2nd International Congress on Structure, Architecture and Urban Development2014.
[145] Farhang SH, Rezayfar O, Sharbatdar MK, Ahmadifard A. Identification and evaluation of existing crack using image processing method. Third International Congress of Contemporary Civil Engineering, Architecture and Urban Planning, Maragheh, 2019.
[146] Hu Y, Zhao C-x. A novel LBP based methods for pavement crack detection. Journal of Pattern Recognition Research. 2010;5:140-7.
[147] Koch C, Brilakis I. Pothole detection in asphalt pavement images. Advanced Engineering Informatics. 2011;25:507-15.
[148] Li L, Sun L-j, Tan S-g, Ning G-b. An efficient way in image preprocessing for pavement crack images. CICTP 2012. p. 3095-103.
[149] Zou Q, Cao Y, Li Q, Mao Q, Wang S. CrackTree: Automatic crack detection from pavement images. Pattern Recognition Letters. 2012;33:227-38.
[150] Ahmad NFA, Kaamin M, Razali S. The application of micro UAV in construction project. AIP Conference Proceedings. 2017; 020070.
[151] Ellenberg A, Branco L, Krick A, Bartoli I, Kontsos A. Use of unmanned aerial vehicle for quantitative infrastructure evaluation. Journal of Infrastructure Systems. 2015;21:04014054.
[152] Gheisari M, Rashidi A, Esmaeili B. Using unmanned aerial systems for automated fall hazard monitoring. Construction Research Congress. 2018.
[153] Morgenthal G, Hallermann N. Quality Assessment of unmanned aerial vehicle (UAV) based visual inspection of structures. Advances in Structural Engineering. 2014;17:289-302.
[154] Sankarasrinivasan S, Balasubramanian E, Karthik K, Chandrasekar U, Gupta R. Health monitoring of civil structures with integrated UAV and image processing system. Procedia Computer Science. 2015;54:508-15.
[155] Yoon H, Hoskere V, Park J-W, Spencer B. Cross-correlation-based structural system identification using unmanned aerial vehicles. Sensors. 2017;17:2075.
[156] Kim B, Cho S. Automated vision-based detection of cracks on concrete surfaces using a deep learning technique. Sensors (Basel). 2018;18.
[157] Chen F, Jahanshahi MR. NB-CNN: Deep learning-based crack detection using convolutional neural network and Naïve bayes data fusion. IEEE Transactions on Industrial Electronics. 2018;65:4392-400.
[158] Khormani M, Kalat jari V, Aghayan I, Ahmadifard A. Finite element modeling of meso-scale concrete cube specimens using CT scan image processing. 2nd National Conference on Applied Researches in Structural Engineering and Construction Management: Sharif University; 2017.
[159] Khaloo A, Lattanzi D. Automatic detection of structural deficiencies using 4d hue-assisted analysis of color point clouds. In: Pakzad S, editor. Dynamics of Civil Structures, Volume 2. Cham: Springer International Publishing; 2019. p. 197-205.
[160] Stent S, Gherardi R, Stenger B, Soga K, Cipolla R. Visual change detection on tunnel linings. machine vision and applications. Machine Vision and Applications. 2016; 27, 319–330.
[161] DeGol J, Golparvar-Fard M, Hoiem D. Geometry-informed material recognition. ArXiv:1607.05338. 2016.
[162] Atha DJ, Jahanshahi MR. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection. Structural Health Monitoring. 2017;17:1110-28.
[163] de Oliveira Alexandre L, Prudêncio Luiz R. Evaluation of the superficial texture of concrete pavers using digital image processing. Journal of Construction Engineering and Management. 2015;141:04015034.
[164] Schumacher T, Shariati A. Monitoring of structures and mechanical systems using virtual visual sensors for video analysis: Fundamental concept and proof of feasibility. Sensors (Basel, Switzerland). 2013;13:16551-64.
[165] Ye XW, Yi T-H, Dong C-Z, Liu T, Bai H. Multi-point displacement monitoring of bridges using a vision-based approach. Wind and Structures. 2015;20:315-26.
[166] Celik O, Dong C-Z, Catbas FN. Measurement of human loads using computer vision. In: Pakzad S, editor. Dynamics of Civil Structures, Volume 2. Cham: Springer International Publishing; 2019. p. 191-5.
[167] Dai F, Rashidi A, Brilakis I, Vela P. Generating the sparse point cloud of a civil infrastructure scene using a single video camera under practical constraints2011.
[168] Dai F, Rashidi A, Brilakis I, Vela P. Comparison of image-based and time-of-flight-based technologies for three-dimensional reconstruction of infrastructure. Journal of Construction Engineering and Management. 2013;139:69-79.
[169] Rashidi A, Brilakis I, Vela P. Generating absolute-scale point cloud data of built infrastructure scenes using a monocular camera setting. Journal of Computing in Civil Engineering. 2015;29:04014089.
[170] Rashidi A, Brilakis I, Vela PA. Monocular videogrammetry for generating absolute-scale 3d point cloud data of civil and infrastructure scenes. ASCE International Workshop on Computing in Civil Engineering. 2013.
[171] Golparvar-Fard M, Bohn J, Teizer J, Savarese S, Peña-Mora F. Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring techniques. Automation in Construction. 2011;20:1143-55.
[172] Guldur Erkal B, Hajjar JF. Laser-based surface damage detection and quantification using predicted surface properties. Automation in Construction. 2017;83:285-302.
[173] Lague D, Brodu N, Leroux J. Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z). ISPRS Journal of Photogrammetry and Remote Sensing. 2013;82:10-26.
[174] Xiong X, Adan A, Akinci B, Huber D. Automatic creation of semantically rich 3D building models from laser scanner data. Automation in Construction. 2013;31:325-37.
[175] Bügler M, Borrmann A, Ogunmakin G, Vela PA, Teizer J. Fusion of photogrammetry and video analysis for productivity assessment of earthwork processes. Computer-Aided Civil and Infrastructure Engineering. 2017;32:107-23.
[176] Ordóñez C, Arias P, Herráez J, Rodríguez J, Martín MT. Two photogrammetric methods for measuring flat elements in buildings under construction. Automation in Construction. 2008;17:517-25.
[177] Ghanta S, Tanja K, Lee S. Wavelet domain detection of rust in steel bridge images. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2011; 1033-1036.
[178] Lord J, McCormick N. Digital image correlation for structural measurements. Proceedings of the ICE - Civil Engineering. 2012;165:185-90.
[179] Malesa M, Kujawinska M. Deformation measurements by digital image correlation with automatic merging of data distributed in time. Applied optics. 2013;52:4681-92.
[180] Rezapour A, Saghravani S.F, Ahmadifard A. Study of saltwater intrusion in the coastal aquifers under transient condition using image processing and numerical modelling. Journal of Hydraulics. 2018;13:14.
[181] Shen H-K, Chen P-H, Chang L-M. Automated steel bridge coating rust defect recognition method based on color and texture feature. Automation in Construction. 2013;31:338-56.
[182] Mataei b, Moghaddasnezhad F, Zakeri H. Presentation of a new surface drainage assessment method based on image processing. Amirkabir Journal of Civil Engineering. 2019:-.
[183] Hajiali m, Moghaddasnezhad F, Zakeri H. Providing a new index for automatic evaluation of the uniform distribution of tack coat and prime coat pavement roads. Amirkabir Journal of Civil Engineering. 2020:-.
[184] Younesi A, Rezaeifar O, Gholhaki M, Esfandiari A. Damage detection in concrete filled tube columns based on experimental modal data and wavelet technique. Mechanics of Advanced Composite Structures‎. 2020;7:245-54.
[185] Hanteh M, Rezaifar O, Gholhaki M. Selecting the appropriate wavelet function in the damage detection of precast panel building based on experimental results and numerical method. Sharif Journal of Civil Engineering. 2021:-.
[186] Hanteh M, Rezaifar O. Damage detection in precast full panel building by continuous wavelet analysis analytical method. Structures. 2021;29:701-13.
[187] Khanahmadi M, Rezayfar O, Gholhaki M. Comparative study on steel beams damage detection based on continuous and discrete wavelet transforms of static and dynamic responses. Journal of Structural and Construction Engineering. 2020:-.
[188] Khanahmadi M, Rezayfar O, Gholhaki m. Damage detection in steel plates based on comparing analytical results of the discrete 2-D wavelet transform of primary and secondary modes shape. Journal of Structural and Construction Engineering. 2019:-.
[189] Naderpour H, Fakharian P. A synthesis of peak picking method and wavelet packet transform for structural modal identification. KSCE Journal of Civil Engineering. 2016;20:2859-67.
[190] Heidari A, Raeisi J, Pahlavan Sadegh S. A New Method for calculating earthquake characteristics and nonlinear spectra using wavelet theory. Journal of Rehabilitation in Civil Engineering. 2020;8:50-62.
[191] Jahangir H, Esfahani MR. Structural damage identification based on modal data and wavelet analysis. 3rd National Conference of Earthquake and Structure, 2012.
[192] Seyedi S, Keyhani A, Jahangir H. An energy-based damage detection algorithm based on modal data. 7th International Conference on Seismology & Earthquake Engineering. 2015.
[193] Nadjafi S, Ghodrati Amiri G, Zare Hosseinzadeh A, Seyed Razzaghi SA. An effective approach for damage identification in beam-like structures based on modal flexibility curvature and particle swarm optimization. Journal of Rehabilitation in Civil Engineering. 2020;8:109-20.
[194] Daneshvar MH, Gharighoran A, Zareei SA, Karamodin A. Damage detection of bridge by rayleigh-ritz method. Journal of Rehabilitation in Civil Engineering. 2020;8:149-62.
[195] Kavousi M, Khatibinia M, Jahangir H. Use of contourlet transform to indentify damages in prestressed concrete slabs. International Conference on Civil Engineering, Architecture & Urban Management In Iran, Tehran. 2018.