Theano 1.0.2 GpuArrayException: b'cuInit #575
Description
I am getting the below error with Theano backend on a cluster.
File "pygpu/gpuarray.pyx", line 658, in pygpu.gpuarray.init
File "pygpu/gpuarray.pyx", line 587, in pygpu.gpuarray.pygpu_init
pygpu.gpuarray.GpuArrayException: b'cuInit: H\x85\xc0H\x89\x05\xb76!: \x01'
I figured out that it is coming from actually pygpu (0.7.6), but i couldn't figure it out what is the issue. I have read online about similar issues, but none of them helped.
My GPU driver is 396.26 and cuda toolkit version 9.2. Any suggestions would be appreciated.