Currently we run the data builds on a external CI platform. We could as easily just run them as docker containers inside the current mesos environment.
The builds are basically bash scripts that fetch and process data and as an end result they push a docker image with fresh data to docker hub. It should be possible to run the same inside docker container inside out existing mesos environment.
-Mesos Jobs allows to trigger data builds on a schedule.
-Logging? how to make that accessible so that it is easy to debug data build problems
-Notifications? We could integrate to slack and post notifications there about the status of data builds