Installing CUDA is a hectic task but still if u r unsure whether your neuralNet is harnessing the power of gpu or not...run the above .py file..(Change gpu-->cpu for checking cpu integration.)
To install CUDNN (speedup neural network), do the following:
download and install cuDNN 7.0 for CUDA 9.1: https://developer.nvidia.com/cudnn
add Windows system variable cudnn with path to CUDNN: https://hsto.org/files/a49/3dc/fc4/a493dcfc4bd34a1295fd15e0e2e01f26.jpg
