UAV-Based Multispectral Imaging for Surface Oil and Water Leak Detection Using Deep Learning

Dimple Bhuta, Anand Siyote, Sanket Bhegde, Rohit Kushwaha, Saptajit Banerjee, Hemendra Arya

UAV-Based Multispectral Imaging for Surface Oil and Water Leak Detection Using Deep Learning

Abstract

Pipeline leakages involving oil and water pose significant environmental and economic risks, motivating the need for timely and reliable surface leak detection techniques. This paper presents a proof-of-concept study that investigates the use of UAV-based multispectral imagery and deep learning for detecting and distinguishing surface oil and water leaks over soil backgrounds. Multispectral data were acquired using a UAV-mounted camera under controlled experimental conditions and processed through a multispectral processing pipeline. Spectral analysis was performed to assess band-wise separability, highlighting the effectiveness of red and red-edge bands for oil–water discrimination. Multiple deep learning object detection models, including YOLOv11, RT-DETR, Faster R-CNN, and a fusion-based YOLOv11-RGBT variant, were evaluated using red and red-edge inputs. Experimental results demonstrate that single-band models achieve robust detection performance, with YOLOv11 attaining detection accuracies of 92.8% for oil and 98.1% for water, while RT-DETR and Faster R-CNN demonstrated comparable accuracy. The fusion-based YOLOv11-RGBT model exhibited lower performance, reflecting the challenges of multispectral fusion under limited data conditions. Overall, the findings indicate that UAV-based multispectral sensing combined with deep learning provides a practical and efficient solution for localized surface leakage monitoring.

Test Setup 2: Controlled Oil–Water–Soil Patch Experiment

Test Setup 2 experimental layout
Figure: Experimental layout of Test Setup 2 showing a 40 m × 40 m controlled field with twelve spatially separated 1 m × 1 m patches designed to evaluate oil, water, soil, and vegetation interactions using UAV-based multispectral imagery.

Patch-wise configuration:

  • Patch 1: Five small oil patches, total oil volume 5 ml.
  • Patch 2: Two oil patches, total oil volume 10 ml.
  • Patch 3: Two oil patches, total oil volume 20 ml.
  • Patch 4: Two oil patches, total oil volume 50 ml.
  • Patch 5: One oil patch (10 ml) and one water patch (400 ml).
  • Patch 6: One oil patch (25 ml) and one water patch (400 ml).
  • Patch 7: One oil patch (50 ml) and one water patch (150 ml).
  • Patch 8: Two oil patches (20 ml total) and two water patches (100 ml total).
  • Patch 9: Soil and water covering a 1 m patch with dry soil boundaries. Spectral differentiation between oil and water was not feasible; hence this configuration was excluded from labeling.
  • Patch 10: Soil layered with oil, with grass patches covering approximately 60% of the area sprinkled over the oil.
  • Patch 11: Soil layered with grass patches covering approximately 60% of the area, with oil sprinkled on top.
  • Patch 12: Soil and water covering a 1 m patch with dry soil boundaries and an oil patch of 25 ml.

Test Images

IMG_0084_1_3_Red.jpg
IMG_0084_1_5_Red edge.jpg
IMG_0086_1_3_Red.jpg
IMG_0086_1_5_Red edge.jpg
IMG_0125_1_3_Red.jpg
IMG_0125_1_5_Red edge.jpg
IMG_0144_1_3_Red.jpg
IMG_0144_1_5_Red edge.jpg
IMG_0294_1_3_Red.jpg
IMG_0294_1_5_Red edge.jpg
IMG_0316_1_3_Red.jpg
IMG_0316_1_5_Red edge.jpg
IMG_0416_1_3_Red.jpg
IMG_0416_1_5_Red edge.jpg
IMG_0501_1_3_Red.jpg
IMG_0501_1_5_Red edge.jpg

Model Performance - YOLOv11

The model achieved an accuracy of 92.8% for Oil and 98.1% for Water.

ClassmAP@50mAP@50:95PrecisionRecallF1-score
Oil0.9840.7140.960.9140.937
Water0.9940.8990.9830.9870.985
Overall0.9890.8060.9720.9510.961

Training Loss

Training Loss - YOLOv11

Validation mAP

Validation mAP - YOlOv11

Confusion Matrix

Confusion Matrix - YOLOv11

Test Results (YOLOv11)

IMG_0084_1_3_Red_pred.jpg
IMG_0084_1_5_Red edge_pred.jpg
IMG_0086_1_3_Red_pred.jpg
IMG_0086_1_5_Red edge_pred.jpg
IMG_0125_1_3_Red_pred.jpg
IMG_0125_1_5_Red edge_pred.jpg
IMG_0144_1_3_Red_pred.jpg
IMG_0144_1_5_Red edge_pred.jpg
IMG_0294_1_3_Red_pred.jpg
IMG_0294_1_5_Red edge_pred.jpg
IMG_0316_1_3_Red_pred.jpg
IMG_0316_1_5_Red edge_pred.jpg
IMG_0416_1_3_Red_pred.jpg
IMG_0416_1_5_Red edge_pred.jpg
IMG_0501_1_3_Red_pred.jpg
IMG_0501_1_5_Red edge_pred.jpg

Model Performance - Faster-RCNN

The model achieved an accuracy of 93.1% for Oil and 97.0% for Water.

ClassmAP@50mAP@50:95PrecisionRecallF1-score
Oil0.9330.4270.9330.9570.945
Water0.9930.6930.9931.0000.997
Overall0.9630.5600.9630.9790.971

Training Loss

Training Loss - Faster-RCNN

Validation mAP

Validation mAP - Faster-RCNN

Confusion Matrix

Confusion Matrix - Faster-RCNN

Test Results (Faster-RCNN)

IMG_0084_1_3_Red_pred.jpg
IMG_0084_1_5_Red edge_pred.jpg
IMG_0086_1_3_Red_pred.jpg
IMG_0086_1_5_Red edge_pred.jpg
IMG_0125_1_3_Red_pred.jpg
IMG_0125_1_5_Red edge_pred.jpg
IMG_0144_1_3_Red_pred.jpg
IMG_0144_1_5_Red edge_pred.jpg
IMG_0294_1_3_Red_pred.jpg
IMG_0294_1_5_Red edge_pred.jpg
IMG_0316_1_3_Red_pred.jpg
IMG_0316_1_5_Red edge_pred.jpg
IMG_0416_1_3_Red_pred.jpg
IMG_0416_1_5_Red edge_pred.jpg
IMG_0501_1_3_Red_pred.jpg
IMG_0501_1_5_Red edge_pred.jpg

Model Performance - RT-DETR

The model achieved an accuracy of 94.7% for Oil and 97.6% for Water.

ClassmAP@50mAP@50:95PrecisionRecallF1-score
Oil0.9910.7190.9780.9890.983
Water0.9940.8770.9880.9920.990
Overall0.9920.7980.9830.9900.987

Training Loss

Training Loss - RT-DETR

Validation mAP

Validation mAP - RT-DETR

Confusion Matrix

Confusion Matrix - RT-DETR

Test Results (RT-DETR)

IMG_0084_1_3_Red_pred.jpg
IMG_0084_1_5_Red edge_pred.jpg
IMG_0086_1_3_Red_pred.jpg
IMG_0086_1_5_Red edge_pred.jpg
IMG_0125_1_3_Red_pred.jpg
IMG_0125_1_5_Red edge_pred.jpg
IMG_0144_1_3_Red_pred.jpg
IMG_0144_1_5_Red edge_pred.jpg
IMG_0294_1_3_Red_pred.jpg
IMG_0294_1_5_Red edge_pred.jpg
IMG_0316_1_3_Red_pred.jpg
IMG_0316_1_5_Red edge_pred.jpg
IMG_0416_1_3_Red_pred.jpg
IMG_0416_1_5_Red edge_pred.jpg
IMG_0501_1_3_Red_pred.jpg
IMG_0501_1_5_Red edge_pred.jpg

Model Performance - YOLOv11-RGBT (fusion)

The model achieved an accuracy of 75.9% for Oil and 81.3% for Water.

ClassmAP@50mAP@50:95PrecisionRecallF1-score
Oil0.7510.3970.82080.66490.7347
Water0.8870.6630.93400.82670.8771
Overall0.8190.5120.83210.73690.7816

Training Loss

Training Loss - Yolo-fusion

Validation mAP

Validation mAP - Yolo-fusion

Confusion Matrix

Confusion Matrix - Yolo-fusion

Test Results (YOLO-Fusion)

IMG_0084_pred.jpg
IMG_0086_pred.jpg
IMG_0125_pred.jpg
IMG_0144_pred.jpg
IMG_0294_pred.jpg
IMG_0316_pred.jpg
IMG_0416_pred.jpg
IMG_0501_pred.jpg

Comparison of Models on Key Processing Metrics for a Single Image (Image pair for YOLOFusion)

MetricYOLOv11YOLO-FusionRT-DETRFaster R-CNN
Warp Matrix Generation38.0 s
Alignment & Saving Rate72.73 µs
Processing Time 0.0161 s 0.10912 s 0.0418 s 0.0274 s
Total Time38.0171 s38.1091 s38.0422 s38.0275 s

Setup 3: Dynamic Oil Drip Testbed

The experimental testbed designed to replicate realistic surface oil leakage scenarios is displayed in this section. In this setup, oil is continuously released using a controlled drip mechanism at a rate of 5 drops per second. Multispectral data are collected at fixed intervals of 15 minutes, with the UAV hovering directly above the test area at altitudes of 15 m and 25 m. This experimental configuration enables time-resolved monitoring of oil spread dynamics and facilitates evaluation of model robustness under progressively evolving surface conditions.

Test Results on Unseen Data (YOLOv11)

The following figures illustrate the detection performance of the YOLOv11 model on previously unseen data acquired from Setup 3. These results demonstrate the model’s ability to generalize to dynamic oil release scenarios and varying spatial extents of surface contamination.

IMG_0003_band5_Red edge_pred.jpg
IMG_0005_band5_Red edge_pred.jpg
IMG_0008_band5_Red edge_pred.jpg
IMG_0010_band5_Red edge_pred.jpg
IMG_0012_band3_Red_pred.jpg
IMG_0013_band5_Red edge_pred.jpg

Citation

    @misc{ovsw2025,
    title={UAV-Based Multispectral Imaging for Surface Oil and Water Leak Detection Using Deep Learning},
    author={},
    year={2025},
    journal={}
    }