基于EfficientDet和双目摄像头的绝缘子缺陷检测

doi:10.11930/j.issn.1004-9649.202006315

中国电力 ›› 2021, Vol. 54 ›› Issue (2): 156-163,196.DOI: 10.11930/j.issn.1004-9649.202006315

基于EfficientDet和双目摄像头的绝缘子缺陷检测

刘逸凡¹, 王淑青¹, 庆毅辉¹, 王晨曦¹, 兰天泽¹, 要若天²

1. 湖北工业大学电气与电子工程学院，湖北武汉 430068;
2. 武汉大学电气与自动化学院，湖北武汉 430072

收稿日期:2020-07-07 修回日期:2020-08-12 发布日期:2021-02-06
作者简介:刘逸凡(1996-),男,通信作者,硕士研究生,从事电气工程、绝缘子检测研究,E-mail:embalming@foxmail.com;王淑青(1969-),女,博士,教授,从事计算机控制、人工智能研究,E-mail:254831618@qq.com
基金资助:
国家自然科学基金资助项目(基于多自主体的复杂智能电网随机博弈与优化研究，51407063)

Insulator Defect Detection Based on EfficientDet and Binocular Camera

LIU Yifan¹, WANG Shuqing¹, QING Yihui¹, WANG Chenxi¹, LAN Tianze¹, YAO Ruotian²

1. School of Electrical and Electronic Engineering, Hubei University of Technology, Wuhan 430068, China;
2. School of Electrical Engineering and Automation, Wuhan University, Wuhan 430072, China

Received:2020-07-07 Revised:2020-08-12 Published:2021-02-06
Supported by:
This work is supported by National Natural Science Foundation of China (Research on Stochastic Game and Optimization of Complex Smart Grid Based on Multi Agent, No.51407063)

摘要/Abstract

摘要： 绝缘子是输电线路重要的组成部件，带有缺陷的绝缘子会对线路造成隐患，通过图像检测技术可以提高绝缘子缺陷检测的效率，大大减小维护成本。但现有的绝缘子缺陷检测技术有精度不高和检测时间过长等缺点，针对这一问题，提出了基于EfficientDet和双目摄像头的绝缘子缺陷检测方法，首先通过双目摄像头设计了一种数据集采集的方法，解决了目前开源数据集不充分的问题；其次通过前置一个带标签的分类先行算法解决了EfficientDet占用资源过多的问题；最后将提出的算法与3种传统绝缘子缺陷检测算法进行比较，发现提出算法的mAP（平均精度均值）为50.04，优于其他3种算法，绝缘子识别定位准确率达95%以上，缺陷识别定位准确率达90%以上，具有较好的效率与实用性。

关键词: 神经网络, 双目摄像头, 绝缘子, 缺陷检测, 机器视觉

Abstract: Insulator is an important component of transmission lines. The defective insulator will cause hidden dangers to the lines. Image detection technology can improve the efficiency of insulator defect detection and greatly reduce the maintenance cost. However, the existing insulator defect detection technology has the disadvantages of low accuracy and long detection time. Aiming at this problem, an insulator defect detection method is proposed based on EfficientDet and binocular camera. Firstly, a data collection method is designed for binocular camera to solve the problem of insufficient open source data set; Secondly, the problem of excessive resources occupied by EfficientDet is solved by a labeled classification first algorithm; Finally, the proposed algorithm is compared with three conventional algorithms. It is found that the mAP of the proposed algorithm is 50.04, which is superior to other three algorithms. The accuracy rate of insulator and defect identification and positioning is more than 95% and 90%, respectively, which shows the proposed algorithm’s good efficiency and practicability.

Key words: neural network, binocular camera, insulator, defect detection, machine vision

刘逸凡, 王淑青, 庆毅辉, 王晨曦, 兰天泽, 要若天. 基于EfficientDet和双目摄像头的绝缘子缺陷检测[J]. 中国电力, 2021, 54(2): 156-163,196.

LIU Yifan, WANG Shuqing, QING Yihui, WANG Chenxi, LAN Tianze, YAO Ruotian. Insulator Defect Detection Based on EfficientDet and Binocular Camera[J]. Electric Power, 2021, 54(2): 156-163,196.

导出引用管理器 EndNote|Ris|BibTeX

链接本文: https://www.electricpower.com.cn/CN/10.11930/j.issn.1004-9649.202006315

https://www.electricpower.com.cn/CN/Y2021/V54/I2/156

参考文献

[1] 王淼, 杜毅, 张忠瑞. 无人机辅助巡视及绝缘子缺陷图像识别研究[J]. 电子测量与仪器学报, 2015, 29(12): 1862-1869
WANG Miao, DU Yi, ZHANG Zhongrui. Study on power transmission lines inspection using unmanned aerial vehicle and image recognition of insulator defect[J]. Journal of Electronic Measurement and Instrumentation, 2015, 29(12): 1862-1869
[2] 单成, 吴洪潭, 石成龙, 等. 图像处理中的绝缘子缺陷检测方法[J]. 中国计量学院学报, 2010, 21(4): 297-300, 304
SHAN Cheng, WU Hongtan, SHI Chenglong, et al. Defect detection method on insulators by image processing[J]. Journal of China University of Metrology, 2010, 21(4): 297-300, 304
[3] 唐波, 覃乔, 黄力. 基于色彩模型和纹理特征的输电线路绝缘子串航拍图像识别[J]. 电力科学与技术学报, 2020, 35(4): 13-19
TANG Bo, QIN Qiao, HUANG Li. Transmission line aerial image recognition of insulator strings based on color model and texture features[J]. Journal of Electric Power Science and Technology, 2020, 35(4): 13-19
[4] ZHAO Z B, XU G Z, QI Y C, et al. Multi-patch deep features for power line insulator status classification from aerial images[C]//2016 International Joint Conference on Neural Networks (IJCNN). Vancouver, BC, Canada. IEEE, 2016: 3187-3194.
[5] 虢韬, 杨恒, 时磊, 等. 基于Faster RCNN的绝缘子自爆缺陷识别[J]. 电瓷避雷器, 2019(3): 183-189
GUO Tao, YANG Heng, SHI Lei, et al. Self-explosion defect identification of insulator based on faster rcnn[J]. Insulators and Surge Arresters, 2019(3): 183-189
[6] 颜宏文, 陈金鑫. 基于改进YOLOv3的绝缘子串定位与状态识别方法[J]. 高电压技术, 2020, 46(2): 423-432
YAN Hongwen, CHEN Jinxin. Insulator string positioning and state recognition method based on improved YOLOv3 algorithm[J]. High Voltage Engineering, 2020, 46(2): 423-432
[7] 高金峰, 吕易航. 航拍图像中绝缘子串的识别与分割方法研究[J]. 郑州大学学报(理学版), 2019, 51(4): 16-22
GAO Jinfeng, LV Yihang. Research on recognition and segmentation of insulator strings in aerial images[J]. Journal of Zhengzhou University (Natural Science Edition), 2019, 51(4): 16-22
[8] 吴涛, 王伟斌, 于力, 等. 轻量级YOLOV3的绝缘子缺陷检测方法[J]. 计算机工程, 2019, 45(8): 275-280
WU Tao, WANG Weibin, YU Li, et al. Insulator defect detection method for lightweight YOLOV₃[J]. Computer Engineering, 2019, 45(8): 275-280
[9] TAO X, ZHANG D P, WANG Z H, et al. Detection of power line insulator defects using aerial images analyzed with convolutional neural networks[J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020, 50(4): 1486-1498.
[10] 姜云土, 韩军, 丁建, 等. 基于多特征融合的玻璃绝缘子识别及自爆缺陷的诊断[J]. 中国电力, 2017, 50(5): 52-58, 64
JIANG Yuntu, HAN Jun, DING Jian, et al. The identification and diagnosis of self-blast defects of glass insulators based on multi-feature fusion[J]. Electric Power, 2017, 50(5): 52-58, 64
[11] 张焕坤, 李军毅, 张斌. 基于改进型YOLO v3的绝缘子异物检测方法[J]. 中国电力, 2020, 53(2): 49-55
ZHANG Huankun, LI Junyi, ZHANG Bin. Foreign object detection on insulators based on improved YOLO v3[J]. Electric Power, 2020, 53(2): 49-55
[12] JIANG H, QIU X J, CHEN J, et al. Insulator fault detection in aerial images based on ensemble learning with multi-level perception[J]. IEEE Access, 2019(7): 61797-61810.
[13] RUSSAKOVSKY O, DENG J, SU H, et al. ImageNet large scale visual recognition challenge[J]. International Journal of Computer Vision, 2015, 115(3): 211-252.
[14] KRASIN I, DUERIG T, ALLDRIN N, et al. Openimages: a public dataset for large-scale multi-label and multi-class image classification[J]. Dataset available from https://github.com/openimages, 2017, 2(3): 2-3.
[15] LIN T Y, MAIRE M, BELONGIE S, et al. Microsoft COCO: common objects in context[J]. Computer Vision - ECCV 2014, 2014: 740-755.
[16] PRATES R M, CRUZ R, MAROTTA A P, et al. Insulator visual non-conformity detection in overhead power distribution lines using deep learning[J]. Computers & Electrical Engineering, 2019, 78: 343-355.
[17] LIU W, ANGUELOV D, ERHAN D, et al. SSD: single shot MultiBox detector[J]. Computer Vision - ECCV 2016, 2016: 21-37.
[18] HE K M, GKIOXARI G, DOLLÁR P, et al. Mask r-cnn[C]//2017 IEEE International Conference on Computer Vision (ICCV). Venice, Italy. IEEE, 2017: 2980-2988.
[19] TAN M X, LE Q V. EfficientNet: rethinking model scaling for convolutional neural networks[EB/OL]. 2019: arXiv: 1905.11946[cs.LG]. https://arxiv.org/abs/1905.11946.
[20] ZOPH B, CUBUK E D, GHIASI G, et al. Learning data augmentation strategies for object detection[EB/OL]. 2019: arXiv: 1906.11172[cs.CV]. https://arxiv.org/abs/1906.11172.

基于EfficientDet和双目摄像头的绝缘子缺陷检测

Insulator Defect Detection Based on EfficientDet and Binocular Camera

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	吴小忠, 肖立华, 童超, 夏向阳, 袁翎, 甘星, 江志文, 黄湘源. 基于传递熵与JS-BP神经网络的锂离子电池容量预测模型[J]. 中国电力, 2025, 58(2): 186-192, 215.
[2]	任明, 李乾宇, 夏昌杰, 董明. 基于稀疏光谱成像的线路复合绝缘子积污状态可视化评估[J]. 中国电力, 2025, 58(2): 203-215.
[3]	程洋, 夏令志, 牛雷, 阮巍, 孙昊, 曹轩赫, 张世珉. 500 kV双联耐张瓷绝缘子串的串间放电现象[J]. 中国电力, 2024, 57(9): 231-237.
[4]	王宇飞, 杜桐, 边伟国, 张钊, 刘慧婷, 杨丽君. 基于DTW K-medoids与VMD-多分支神经网络的多用户短期负荷预测[J]. 中国电力, 2024, 57(6): 121-130.
[5]	吴军英, 路欣, 刘宏, 张彬, 柴守亮, 刘蕴春, 王佳楠. 基于Spearman-GCN-GRU模型的超短期多区域电力负荷预测[J]. 中国电力, 2024, 57(6): 131-140.
[6]	邵必林, 纪丹阳. 基于VMD-SE的电力负荷分量的多特征短期预测[J]. 中国电力, 2024, 57(4): 162-170.
[7]	陈巳阳, 韩利, 方济中, 丁五行, 成诚, 李文, 张源, 钱勇. 基于不确定参数的变电站碳储量预估方法[J]. 中国电力, 2024, 57(4): 200-210.
[8]	娄奇鹤, 李荣盛, 谭捷, 袁铁江. 基于卷积神经网络的暂稳极限功率计算[J]. 中国电力, 2024, 57(4): 211-219.
[9]	马汝括, 董杰, 王雅湉, 伊国鑫, 丁祥浩, 马乐. 基于神经网络的高寒地区CF₄和SF₆/CF₄检测[J]. 中国电力, 2024, 57(3): 103-112.
[10]	阎洁, 杨佳琳, 王航宇, 卢姣阳, 刘永前, 张磊. 基于风况预测误差自适应的海上风电场尾流偏转控制方法[J]. 中国电力, 2024, 57(3): 190-196.
[11]	李卓, 王胤喆, 叶林, 罗雅迪, 宋旭日, 张振宇. 从感知-预测-优化综述图神经网络在电力系统中的应用[J]. 中国电力, 2024, 57(12): 2-16.
[12]	陈庆斌, 杨耿煌, 耿丽清, 苏娟, 孙京生. 基于相似日选取和数据重构的短期光伏功率组合预测方法[J]. 中国电力, 2024, 57(12): 71-81.
[13]	陈来恩, 曾小勇, 曾子豪, 成采辰, 孙耀科. 基于物理信息与深度神经网络的锂离子电池温度预测[J]. 中国电力, 2024, 57(11): 18-25.
[14]	薛松萍, 高德荃, 赵子岩, 林彧茜, 广泽晶, 张大卫. 基于业务差异化传输需求下的电力通信网路由算法[J]. 中国电力, 2024, 57(11): 183-190.
[15]	周颖, 白雪峰, 王阳, 邱敏, 孙冲, 武亚杰, 李彬. 面向虚拟电厂运营的温度敏感负荷分析与演变趋势研判[J]. 中国电力, 2024, 57(1): 9-17.

模态框（Modal）标题

基于EfficientDet和双目摄像头的绝缘子缺陷检测

Insulator Defect Detection Based on EfficientDet and Binocular Camera

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics