Docker is a virtualization software that deploys docker containers. Due to easy handlin and reproducable environments it is a useful tool.
To use Nvidia GPUs with docker you need to install the nvidia-cuda-toolkit. There is a guide on marmelab that focusses on that topic.