OPTICAL DEEP LEARNING LANDMINE DETECTION BASED ON LIMITED DATASET OF AERIAL IMAGERY
DOI:
https://doi.org/10.18372/2310-5461.62.18708Keywords:
landmine detection, unmanned aerial vehicles, deep learning, YOLOAbstract
Landmine detection is one of the most innovative applications of unmanned aerial vehicles that became possible due to rapid development of both aerial vehicles equipped by different optical cameras and sensors using different physical principles, and object classification and detection methods, including machine learning and especially deep learning. Optical detection is an essential part of the overall landmine detection process that can be performed either separately or in combination with data processing from other types of cameras or sensors. The development of deep convolutional neural networks has dramatically changed the landscape of optical detection by making them de-facto choice number one for the majority of object classification, detection and segmentation tasks. However, the deterrent factor in the case of landmine detection is limited availability of appropriate data for training that different researchers try to overcome in different ways. The assessment of necessary amount of training data for any particular object detection problem still remains an experimental task. Despite several years of development in this area, still there is a shortage of research based on real landmine imagery obtained from unmanned aerial vehicles, so currently any public effort in this direction is valuable and works as an inspiration for new researchers. This paper describes such a study, namely its first iteration in which popular open-source tools are used to build detection pipeline and estimation of their efficiency is done using limited amount of data. It is shown that the problem of limited amount of training data can be effectively overcome by data augmentation and iterational process of training optical landmine detector is demonstrated. The effectiveness of open-source tools and libraries for neural networks training, object detection and dataset preparation is also demonstrated.
References
Osco, L.P., Junior, J.M., Ramos, A.P.M., Jorge, L.A.C., Fatholahi, S.N., Silva, J.A., … Li, J. (2021) A review on deep learning in UAV remote sensing. International Journal of Applied Earth Observations and Geoinformation, 102 (2021)102456. https://doi.org/10.1016/j.jag.2021.102456
Popov, M.O., Stankevich, S.A., Mosov, S.P., Titarenko, O.V., Dugin, S.S., Golubov, S.I., Andreiev, A.A. (2022) Method for minefields mapping by imagery from unmanned aerial vehicle, Advances in Military Technology, 17(2), 211-229. https://doi.org/10.3849/aimt.01722
Baur, J., Steinberg, G., Nikulin, A., Chiu, K., Smet, T. (2020). Applying Deep Learning to Automate UAV-Based Detection of Scatterable Landmines. Remote Sensing. 12(859) https://doi.org/10.3390/rs12050859
Harvey, A., LeBrun, E. (2023) Computer vision detection of explosive ordnance: a high-performance 9N235/9N210 cluster submunition detector. The Journal of Conventional Weapons Destruction. 27(2).
Kunichik, O., Tereshchenko V. (2023) Improving the accuracy of landmine detection using data augmentation: a comprehensive study. Artificial Intelligence, 2023(2). https://doi.org/10.15407/jai2023.02.042
Cho S., Ma J., Yakimenko O.A. (2023) Aerial multi-spectral AI-based detection system for unexploded ordnance, Defence Technology, 27, 24-37, ISSN 2214-9147. https://doi.org/10.1016/j.dt.2022.12.002
Qiu, Z.; Guo, H.; Hu, J.; Jiang, H.; Luo, C. (2023) Joint Fusion and Detection via Deep Learning in UAV-Borne Multispectral Sensing of Scatterable Landmine. Sensors, 23(5693). https://doi.org/10.3390/s23125693
Vivoli, E., Bertini, M., Capineri, L. (2024) Deep Learning-Based Real-Time Detection of Surface Landmines Using Optical Imaging. Remote Sensing. 16(4):677. https://doi.org/10.3390/rs16040677
Redmon, J., Divvala, S., Girshick, R., Farhadi, A. (2016) YOLO: You Only Look Once: Unified, Real-Time Object Detection. arXiv 2016, arXiv:1506.02640. https://doi.org/10.48550/arXiv.1506.02640
Terven, J.R., Cordova-Esparza, D.M. A comprehensive review of YOLO architectures in computer vision: from YOLOv1 to YOLOv8 and YOLO-NAS. arXiv 2023, arXiv:2304.00501. https://doi.org/10.48550/arXiv.2304.00501
Ultralytics (2023) Ultralytics YOLOv8 - State-of-the-art Vision AI. Retrieved from https://www.ultralytics.com/yolo (access data 20.05.2024)
Durai, P. (2023) Exploring SAHI: Slicing Aided Hyper Inference for Small Object Detection, Learn OpenCV, Retrieved from https://learnopencv.com/slicing-aided-hyper-inference/ (access data 20.05.2024)
Akyon, F.C., Altinuc, S.O., Temizel, A. (2022) Slicing Aided Hyper Inference and Fine-Tuning for Small Object Detection. IEEE International Conference on Image Processing Proceedings, 2022, https://doi.org/10.1109/ICIP46576.2022.9897990 (access data 20.05.2024)
Label Studio. Open Source Data Labeling Platform. https://labelstud.io/ (access data 21.05.2024)
Albumentations: fast and flexible image augmentations. https://albumentations.ai/ (access data 21.05.2024)
Earth Sciences Faculty Scholarship |Earth Siences | Bindhamton University https://orb.binghamton.edu/geology_fac/ (access data 21.05.2024)
Roboflow Universe: Open Source Computer Vision Community https://universe.roboflow.com/ (access data 21.05.2024.