Can we rely only on satellite? How accurate are these results?
It is standard practice in classification studies (particularly academic ones) to assess accuracy from behind a computer. Analysts traditionally pick a random selection of points and visually inspect the classified output with the raw imagery. However, these maps are meant to be left in the hands of local governments, and not published in academic journals.
So, it’s important to learn how well the resulting maps reflect the reality on the ground.
Having used the algorithm to classify land cover in 10 secondary cities in Central America, we were determined to learn if the buildings identified by the algorithm were in fact ‘industrial’ or ‘residential’. So the team packed their bags for San Isidro, Costa Rica and Santa Ana, El Salvador.
Upon arrival, each city was divided up into 100x100 meter blocks. Focusing primarily on the built-up environment, roughly 50 of those blocks were picked for validation. The image below shows the city of San Isidro with a 2km buffer circling around its central business district. The black boxes represent the validation sites the team visited.
|Land Cover validation: A sample of 100m blocks that were picked to visit in San Isidro, Costa Rica. At each site, the semi-automated land cover classification map was compared to what the team observed on the ground using laptops and the Waypoint mobile app (available for Android and iOS).|