Feel free to spin up an instance of your own and follow along.īy the time you’re finished this tutorial, you’ll have a brand new system ready for deep learning. Specifically, I’ll be using an Amazon EC2 g2.2xlarge machine running Ubuntu 14.04. In the remainder of this blog post, I’ll demonstrate how to install both the NVIDIA CUDA Toolkit and the cuDNN library for deep learning. Using the cuDNN package, you can increase training speeds by upwards of 44%, with over 6x speedups in Torch and Caffe.
This toolkit includes a compiler specifically designed for NVIDIA GPUs and associated math libraries + optimization routines. If you already have an NVIDIA supported GPU, then the next logical step is to install two important libraries: And the more GPUs you have, the better off you are. If you’re serious about doing any type of deep learning, you should be utilizing your GPU rather than your CPU. Click here to download the source code to this post