Dam Reservoir Extraction From Remote Sensing Imagery Using Tailored Metric Learning Strategies

Dam reservoirs play an important role in meeting sustainable development goals (SDGs) and global climate targets. However, particularly for small dam reservoirs, there is a lack of consistent data on their geographical location. To address this data gap, a promising approach is to perform automated dam reservoir extraction based on globally available remote sensing imagery. It can be considered as a fine-grained task of water body extraction, which involves extracting water areas in images and then separating dam reservoirs from natural water bodies. A straightforward solution is to extend the commonly used binary-class segmentation in water body extraction to multiclass. This, however, does not work well as there exists not much pixel-level difference of water areas between dam reservoirs and natural water bodies. We propose a novel deep neural network (DNN)-based pipeline that decomposes dam reservoir extraction into water body segmentation and dam reservoir recognition. Water bodies are first separated from background lands in a segmentation model and each individual water body is then predicted as either dam reservoir or natural water body in a classification model. For the former step, point-level metric learning (PLML) with triplets across images is injected into the segmentation model to address contour ambiguities between water areas and land regions. For the latter step, prior-guided metric learning (PGML) with triplets from clusters is injected into the classification model to optimize the image embedding space in a fine-grained level based on reservoir clusters. To facilitate future research, we establish a benchmark dataset with Earth imagery data and human-labeled reservoirs from river basins in West Africa and India. Extensive experiments were conducted on this benchmark in the water body segmentation task, dam reservoir recognition task, and the joint dam reservoir extraction task. Superior performance has been observed in the respective tasks when comparing our method with state-of-the-art approaches. The codes and datasets are available at https://github.com/c8241998/Dam-Reservoir-Extraction .