Mandolin is ML library providing a flexible and general method of specifying and training deep neural network models with a variety of loss functions. Fast stochastic optimization is achieved using asynchronous learning on each worker node, with model averaging across worker nodes achieved with Apache Spark. A wide variety of stochastic solvers, regularizers and distributed optimization settings can be easily configured through a rich configuration system.