Automated update system (Auto - Update)

This article provides a description of the Autoupdate feature that is available for customers on
MapTiler Server and Data.

Global Vector Dataset Updates

MapTiler Data subscription package allows downloading of data for an unlimited amount of times, which means that every time, there is a new global vector dataset available, (every week) you can download it and replace the dataset manually to keep the data updated.

By subscribing to MapTiler Business or Partner subscription tiers, you are eligible for the Autoupdate feature which saves you time and effort to keep the data as fresh as possible at all times.

About Autoupdate

Autoupdate enables you to automatically apply updated planet to global vector datasets.

The whole automated process is done by running a script on your machine. This is a console-based script, which needs to be run from the Terminal or Command prompt or as a service (crontab, Windows service, etc).

The script will update the “planet.mbtiles” file to the latest version visible on the OSM Dataset download page. In other words, the script will attempt to download the newest available planet. This could cause temporary congestion. The auto-update script is designed to run continuously on the customer’s machine without any longer interruption. After the update is finished, the old planet file will be named “planet-old.mbtiles” and stored in the temporary directory.

Once you have the latest planet, you can run the auto-update script to make sure you have the newest version of a planet. We recommend running the script once a week (WE/TH) when the new planet files are usually released.

Note: Autoupdate is available only for OpenStreetMap vector tiles of planet dataset.

Update Process

  1. Run the script on your server with a planet package
  2. The script will download a new planet file
  3. The script will rename and move the original planet file - the web server will still read this old planet file
  4. The script will replace old planet file with planet
  5. It will automatically update to the latest planet version possible
  6. Restart your web server to finish the process and serve a new planet package

Your maps are available through the whole update process without interruption, except for a short timeout during the restart of your web server.

Here is a short real-life example:

\# ls \-lh /var/www/html/map/\*.mbtiles  
\-rw\-r\-\-r\-\-. 1 root root 105G Jan  5 20:49 /var/.../map/maptiler\-osm\-2022\-11\-28\-v3\.14\-planet.mbtiles  
\-rw\-r\-\-r\-\-. 1 root root  100G Jan  5 19:04 /var/.../map/planet\-old.mbtiles

When you copy the downloaded mbtiles into the right directory and click "RE-SCAN", you might occasionally face an issue that reads: "CANNOT BE SERVED" with the following reason:

Screenshot_2023-01-20_at_14.32.22.png

This happens because the file is corrupted - this could happen due to limited space during the auto-update operation. To verify the file, you can run the following command: maptiler_autoupdate --info file.mbtiles

If the file is corrupted, it cannot be repaired (hence there are backups of the old planet before merging), but has to be downloaded freshly from the website. You can verify that the file was fully downloaded using MD5 hash sum. md5sum file.mbtiles

Technical Specification

  • 2+ CPU cores processor
  • 8+ GB RAM memory
  • 300+ GB locally attached SSD
    • 150 GB for temporary workdir
    • 150 GB for production directory
  • Time estimate relies solely on the download speed

Useful articles

How to download data from MapTiler website