GeoAI Reproducibility and Replicability: a computational and spatial perspective

  • 2024-04-22 18:53:08
  • Wenwen Li, Chia-Yu Hsu, Sizhe Wang, Peter Kedron
  • 0

Abstract

GeoAI has emerged as an exciting interdisciplinary research area thatcombines spatial theories and data with cutting-edge AI models to addressgeospatial problems in a novel, data-driven manner. While GeoAI research hasflourished in the GIScience literature, its reproducibility and replicability(R&R), fundamental principles that determine the reusability, reliability, andscientific rigor of research findings, have rarely been discussed. This paperaims to provide an in-depth analysis of this topic from both computational andspatial perspectives. We first categorize the major goals for reproducing GeoAIresearch, namely, validation (repeatability), learning and adapting the methodfor solving a similar or new problem (reproducibility), and examining thegeneralizability of the research findings (replicability). Each of these goalsrequires different levels of understanding of GeoAI, as well as differentmethods to ensure its success. We then discuss the factors that may cause thelack of R&R in GeoAI research, with an emphasis on (1) the selection and use oftraining data; (2) the uncertainty that resides in the GeoAI model design,training, deployment, and inference processes; and more importantly (3) theinherent spatial heterogeneity of geospatial data and processes. We use a deeplearning-based image analysis task as an example to demonstrate the results'uncertainty and spatial variance caused by different factors. The findingsreiterate the importance of knowledge sharing, as well as the generation of a"replicability map" that incorporates spatial autocorrelation and spatialheterogeneity into consideration in quantifying the spatial replicability ofGeoAI research.

 

Quick Read (beta)

loading the full paper ...