Developed for UNICEF

Methodology

The large scale model inference

We applied our model to 52 million zoom 18 tiles of DigitalGlobe Vivid Basemap, representing all of Colombia and eleven Eastern Caribbean nations: Anguilla, Antigua, Barbuda, British Virgin islands, Dominica, Grenada, The Grenadines, Montserrat, St Kitts and Nevis, St Lucia, St Vincent.

To run the inference at a country-wide scale on high-resolution imagery, we developed an open source library called chip-n-scale-queue-arranger. It is composed of a configuration code for Amazon Web Services (AWS CloudFormation) as well as small scripts for automating the necessary tasks associated with the satellite imagery and machine learning predictions.

ML model inference
chip-n-scale-queue-arranger helps you run machine learning models over satellite imagery at scale. It is a collection of AWS CloudFormation templates deployed by kes, lambda functions, and utility scripts for monitoring and managing the project.

A high-level overview of the process looks like this:

  • A user sends x/y/z tile indices to an AWS SQS queue in the form of '{ "x": 1, "y": 2, "z": 3}'. These indicate which geographic region to run our model over.

  • Each SQS message triggers the Lambda function DownloadAndPredict which downloads images, posts to a prediction cluster (via a Load Balancer endpoint), and saves the result to an RDS database.

  • The prediction cluster on ECS runs the TensorFlow Serving image to predict each tile. All instances are behind an Application Load Balancer which will dynamically register new instances that appear on the cluster and allocate jobs to them evenly.

  • A user manually downloads predictions from RDS after the full inference process is complete.

The prediction from RDS was converted to a shapefile so that our expert mappers can upload a map editor for validation. In the editor, the mappers can overlay the predicted school tiles only and focus their attention on confident predictions, avoiding the tedious task of reviewing the entire area for Colombia and the eastern Caribbean islands.