Disclosure: I work for Google. Google Cloud does this with Dataflow and ML Engine in a fairly simple way, and the internals are open sourced as Apache Beam and TensorFlow so you can migrate to other platforms if you want.