On Windows, it is not possible to use CUDA over Remote Desktop on the primary video card. If you have more than one graphics card that is CUDA capable, you can execute the following command to set the driver mode of the secondary card as TCC (Tesla Compute Cluster) mode. For example, open a command prompt as an administrator, then:
cd C:\Program Files\NVIDIA Corporation\NVSMI
nvidia-smi -i 1 -dm 0
Where -i 1 should be the index of the card (0 is primary). -dm 0 sets the mode to be TCC.
See http://stackoverflow.com/q/12304082/724351.
