Adding GPUs to Goolge Clout VM

Installing GPU drivers

1. Follow the instructions on https://developer.nvidia.com/cuda-downloads, to install cuda10.1 (the deb local version works)
2. Install cudnn
   1. download cuDNN runtime library for Ubuntu18.04 online: https://developer.nvidia.com/rdp/cudnn-download
   2. sudo dpkg -i libcudnnXXX.deb
3. Setup library path

   
   export PATH=/usr/local/cuda/bin:$PATH
   export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda/lib64
   
   

Install Apex

NOTE: make sure pytorch and apex, and cudnn are compatible with cuda version (currently cuda10.1)

git clone https://github.com/NVIDIA/apex
cd apex
python setup.py install --cuda_ex