Survey of Inspection Technology of Overhead Transmission Line Robot Based on Computer Vision

doi:10.11930/j.issn.1004-9649.201801094

Abstract

Abstract: Overhead transmission lines are the key to safe operation of power grid and reliable transmission of electric power, and it is very important to carry out regular inspection. The computer vision system has the characteristics of high integration, good interactivity, high degree of automation and fast processing speed, it can play an important role in the accurate identification and fault judgment of all kinds of equipment during the inspection process of overhead transmission lines, therefore, the computer vision system has a wide range of applications in the overhead transmission line robot inspection and fault diagnosis. In this paper, the robot computer vision inspection technology and its research status are summarized from the aspects of wire identification, tower identification and insulator string identification, the corresponding image processing methods are analyzed, on this basis, the overhead transmission line robot visual inspection key technology has been summarized and foreseen.

Key words: computer vision, overhead transmission line, robot inspection technology, machine learning, image processing, device identification

CLC Number:

TM755

LI Zhenyu, GUO Rui, LAI Qiupin, YANG Jun, YONG Min, WANG Liang, FU Siyao. Survey of Inspection Technology of Overhead Transmission Line Robot Based on Computer Vision[J]. Electric Power, 2018, 51(11): 139-146.

Add to citation manager EndNote|Ris|BibTeX

URL: https://www.electricpower.com.cn/EN/10.11930/j.issn.1004-9649.201801094

https://www.electricpower.com.cn/EN/Y2018/V51/I11/139

References

[1] 梁立凯. 架空输电线路输电能力的研究[D]. 济南:山东大学, 2013.
[2] 叶远波, 孙月琴, 黄太贵, 等. 智能变电站继电保护二次回路在线监测与故障诊断技术[J]. 电力系统保护与控制, 2016, 44(20):148-153. YE Yuanbo, SUN Yueqin, HUANG Taigui, et al. Online state detection and fault diagnosis technology of relay protection secondary circuits in smart substation[J]. Power System Protection and Control, 2016, 44(20):148-153.
[3] 秦红霞, 武芳瑛, 彭世宽, 等. 智能电网二次设备运维新技术研讨[J]. 电力系统保护与控制, 2015, 43(22):35-40. QIN Hongxia, WU Fangying, PENG Shikuan, et al. New technology research on secondary equipment operation maintenance for smart grid[J]. Power System Protection and Control, 2015, 43(22):35-40.
[4] 曾友林. 配电网架空线中无人机巡视应用探究[J]. 科技风, 2017(12):10. ZENG Youlin. Exploration of UAV navigation application on overhead transmission line[J]. Technology Wind, 2017(12):10.
[5] 耿欣, 周延泽. 巡线机器人的爬行方案设计[J]. 机器人技术与应用, 2002(4):19-21. GENG Xin, ZHOU Yanze. Crawler robot crawling program design[J]. Robot Technique and Application, 2002(4):19-21.
[6] 彭向阳, 吴功平, 金亮. 架空输电线路智能机器人全自主巡检技术及应用[J]. 南方电网技术, 2017, 11(4):14-22. PENG Xiangyang, WU Gongping, JIN Liang. Full-automatic inspection technology of intelligent robot for overhead transmission lines and its application[J]. Southern Power System Technology, 2017, 11(4):14-22.
[7] 姜臻, 苗世洪, 刘沛. 基于故障可观性的输电线路故障定位方法[J]. 电力系统保护与控制, 2016, 44(15):1-9. JIANG Zhen, MIAO Shihong, LIU Pei. Fault observability model based fault location technique for transmission grids[J]. Power System Protection and Control, 2016, 44(15):1-9.
[8] 李正. 高压输电线路自主巡检机器人的研究[D]. 上海:上海大学, 2013.
[9] 童祖兵. 巡线机器人视觉导航研究[D]. 合肥:安徽工业大学, 2016.
[10] FU S, LI W, ZHANG Y, et al. Structure-constrained obstacles recognition for power transmission line inspection robot[C]//International Conference on Intelligent Robots and Systems. IEEE Xplore, 2006:3363–3368.
[11] LI Z, LIU Y, HAYWARD R, et al. Knowledge-based power line detection for UAV surveillance and inspection systems[C]//Image and Vision Computing New Zealand, Ivcnz 2008, International Conference. IEEE, 2009:1–6.
[12] SHARMA H, DUTTA T. Image analysis-based automatic utility pole detection for remote surveillance[C]//International Conference on Digital Image Computing:Techniques and Applications. IEEE, 2015:1–7.
[13] YAN S, JIN L, DUAN S, et al. Power line image segmentation and extra matter recognition based on improved Otsu algorithm[C]//International Conference on Electric Power Equipment-Switching Technology. IEEE, 2014:1–4.
[14] TONG W G, LI B S, YUAN J S, et al. Transmission line extraction and recognition from natural complex background[C]//International Conference on Machine Learning and Cybernetics. IEEE, 2009:2473–2477.
[15] YAO N, HONG G, GUO Y, et al. The detection of extra matters on the transmission lines based on the filter response and appearance[C]//International Symposium on Computational Intelligence & Design. IEEE, 2015:542–545.
[16] MURTHY V S, GUPTA S, MOHANTA D K. Digital image processing approach using combined wavelet hidden markov model for well-being analysis of insulators[J]. Iet Image Processing, 2011, 5(2):171-183.
[17] LI B, WU D, YANG C, et al. A method of insulator detection from video sequence[C]//20124th International Symposium on Information Science and Engineering. ISISE, Shanghai, China, 2012:386–389.
[18] ZHANG X, AN J, CHEN F. A simple method of tempered glass insulator recognition from airborne image[C]//International Conference on Optoelectronics and Image Processing. IEEE, 2011:127–130.
[19] HE S Y, WANG L, XIA Y, et al. Insulator recognition based on moments invariant features and cascade adaboost classifier[C]//20132nd International Conference on Mechatronics and Control Engineering. ICMCE 2013, Dalian, China, 2013:362–367.
[20] LI W, YE G, HUANG F, et al. Recognition of insulator based on developed MPEG-7 texture feature[C]//International Congress on Image and Signal Processing. IEEE, 2010:265–268.
[21] YAO C Y, JIN L J, YAN S J. Recognition of insulator string in power grid patrol images[J]. Journal of System Simulation, 2012(9):1-6.
[22] GOLIGHTLY I, JONES D. Corner detection and matching for visual tracking during power line inspection[J]. Image & Vision Computing, 2003, 21(9):827-840.
[23] SONG Z. Power pole detection based on graph cut[C]//Proc of lmage and Signal Processing, Los Alamitos, IEEE Computer soc, 2008:720–724.
[24] WU Q, AN J. An active contour model based on texture distribution for extracting inhomogeneous insulators from aerial images[J]. IEEE Transactions on Geoscience & Remote Sensing, 2014, 52(6):3613-3626.
[25] CETIN B, BIKDASH M, MCINERNEY M. Automated electric utility pole detection from aerial images Southeastcon[J]. IEEE, 2009:44–49.
[26] YAO X, GUO L, ZHAO T. Power Line Detection Based on Region Growing and Ridge-Based Line Detector[C]//Proceedings of 2013 Chinese Intelligent Automation Conference. Springer Berlin Heidelberg, 2013:431–437.
[27] BHUJADE R M, ADITHYA V, HRISHIKESH S, et al. Detection of Power-Lines in Complex Natural Surroundings[C]//International Conference on Information Technology Convergence and Services. 2014:101–108.
[28] SONG B, LI X. Power line detection from optical images[J]. Neurocomputing, 2014, 129(SI):350-361.
[29] MARTINEZ C, SAMPEDRO C, CHAUHAN A, et al. Towards autonomous detection and tracking of electric towers for aerial power line inspection[C]//International Conference on Unmanned Aircraft Systems. IEEE, 2014:284–295.
[30] CERÓN A, MONDRAGÓN I, PRIETO F. Real-time transmission tower detection from video based on a feature descriptor[J]. Iet Computer Vision, 2017, 11(1):33-42.
[31] GUO B, LI Q, HUANG X, et al. An improved method for power-line reconstruction from point cloud data[J]. Remote Sensing, 2016, 8(1):36.
[32] ZHANG Y, YUAN X, FANG Y, et al. UAV low altitude photogrammetry for power line inspection[J]. ISPRS International Journal of Geo-Information, 2017, 6(1):14.
[33] 柳长安, 叶文, 吴华, 等. 融合地理位置信息的电力杆塔检测[J]. 华中科技大学学报(自然科学版), 2013, 41(S1):208-210, 214. LIU Changan, YE Wen, WU Hua, et al. Detection of power poles based on fusion of geographical location information[J]. Huazhong University of Sci. & Tech.(Natural Science Edition), 2013, 41(S1):208-210, 214.
[34] 朱珠. 图像处理技术在架空线路绝缘子破损检测系统中的应用研究[D]. 镇江:江苏大学, 2008.
[35] LI Z, YAO J, YANG Y, et al. Complex wavelet-domain local adaptive denoising method for insulator infrared thermal image based on MAP estimation[J]. Chinese Journal of Scientific Instrument, 2009, 30(10):2070-2075.
[36] LIN J, HAN J, CHEN F, et al. Defects detection of glass insulator based on color image[J]. Power System Technology, 2011, 35(1):127-133.
[37] PRASAD S. Review on machine vision based insulator inspection systems for power distribution system[J]. Journal of Engineering Science & Technology Review, 2016, 9(5):135-141.
[38] ZHAO J, LIU X, SUN J, et al. Detecting insulators in the image of overhead transmission lines[C]//Intelligent Computing Technology. Springer Berlin Heidelberg, 2012:442–450.
[39] ZHANG X, AN J, WU Q. Method for recognizing insulator from airborne image[C]//Fifth International Conference on Intelligent Computation Technology and Automation. IEEE Computer Society, 2012:604–607.