Serious number crunching on Amazon Web Services

March 14, 2017 — March 16, 2017

computers are awful
concurrency hell
premature optimization

I want to do cloud machine learning.

Let’s try this on Amazon Web Services and see what’s awful.

1 Run through

See How is machine learning on AWS awful this week?, based on my wistful belief in the Keras run-through.

2 Amazon Machine Images

AWS has launched modern DL VMs at last:

The AWS Deep Learning AMI, now available on AWS Marketplace, lets you run deep learning in the Cloud, at any scale. Launch instances of pre-installed, open source deep learning frameworks, including Apache MXNet, to train sophisticated, custom AI models, experiment with new algorithms, and learn new deep learning skills and techniques. The AWS Deep Learning AMI lets you create managed, auto-scaling clusters of GPUs for large-scale training, or run inference on trained models using the latest versions of MXNet, TensorFlow, Caffe, Theano, Torch, and Keras. With the addition of an Ubuntu version, you have the choice to run on the operating system of your choice. There is no additional charge for the AWS Deep Learning AMI — you pay only for the AWS resources needed to store and run your applications.

Find more unsatisfying compromise choices at the “marketplace”.

3 Docker+Amazon

Docker deployment I could not be arsed working out how to do the GPU stuff.

4 Incoming