Gap Filling Cloudy Sentinel-2 NDVI and NDWI Pixels with Multi-Frequency Denoised C-Band and L-Band Synthetic Aperture Radar (SAR), Texture, and Shallow Learning Techniques

Abstract

Multispectral imagery provides unprecedented information on Earth system processes: however, data gaps due to clouds and shadows are a major limitation. Normalized-Difference Vegetation Index (NDVI) and Normalized-Difference Water Index (NDWI) are two spectral indexes employed for monitoring vegetation phenology, land-cover change and more. Synthetic Aperture Radar (SAR) with its cloud-penetrating abilities can fill data gaps using coincident imagery. In this study, we evaluated C-band Sentinel-1, L-band Uninhabited Aerial Vehicle SAR (UAVSAR) and texture for gap filling using efficient machine learning regression algorithms across three seasons. Multiple models were evaluated including Support Vector Machine, Random Forest, Gradient Boosted Trees and an ensemble of models. The Gap filling ability of SAR was evaluated with Sentinel-2 imagery from the same date, 3 days and 8 days later than both SAR sensors in September. Sentinel-1 and Sentinel-2 imagery from winter and spring seasons were also evaluated. Because SAR imagery contains noise, we compared two robust de-noising methods and evaluated performance against a refined lee speckle filter. Mean Absolute Error (MAE) rates of the cloud gap-filling model were assessed across different dataset combinations and land covers. The results indicated de-noised Sentinel-1 SAR and UAVSAR with GLCM texture provided the highest predictive abilities with random forest R2 = 0.91 (±0.014), MAE = 0.078 (±0.003) (NDWI) and R2 = 0.868 (±0.015), MAE = 0.094 (±0.003) (NDVI) during September. The highest errors were observed across bare ground and forest, while the lowest errors were on herbaceous and woody wetland. Results on January and June imagery without UAVSAR were less strong at R2 = 0.60 (±0.036), MAE = 0.211 (±0.005) (NDVI), R2 = 0.61 (±0.043), MAE = 0.209 (±0.005) (NDWI) for January and R2 = 0.72 (±0.018), MAE = 0.142 (±0.004) (NDVI), R2 = 0.77 (±0.022), MAE = 0.125 (±0.004) (NDWI) for June. Ultimately, the results suggest de-noised C-band SAR with texture metrics can accurately predict NDVI and NDWI for gap-filling clouds during most seasons. These shallow machine learning models are rapidly trained and applied faster than intensive deep learning or time series methods.