[AMBER] Fw: Process exclusive mode and GPU peer-to-peer communication

From: Matthew Harrigan <harrigan.stanford.edu>
Date: Thu, 26 Jan 2017 22:12:39 +0000

Hi all,


I'm trying to run a multi-gpu simulation. Our cluster's GPUs are set to process exclusive mode. Per http://archive.ambermd.org/201405/0145.html it is not surprising that this fails with the message


cudaDeviceEnablePeerAccess all CUDA-capable devices are busy or unavailable
cudaDeviceEnablePeerAccess all CUDA-capable devices are busy or unavailable


However, our cluster administrator doesn't want to set the compute mode to default *but also* points out that p2p works in general in process exclusive mode. Specifically, if I run p2pBandwidthLatencyTest from the CUDA SDK samples, it shows p2p is enabled


$ ./p2pBandwidthLatencyTest
[P2P (Peer-to-Peer) GPU Bandwidth Latency Test]
Device: 0, Tesla K80, pciBusID: 93, pciDeviceID: 0, pciDomainID:0
Device: 1, Tesla K80, pciBusID: 94, pciDeviceID: 0, pciDomainID:0
Device=0 CAN Access Peer Device=1
Device=1 CAN Access Peer Device=0
<snip>


Is there some way amber can be modified to use p2p in process exclusive mode?


Matt


_______________________________________________
AMBER mailing list
AMBER.ambermd.org
http://lists.ambermd.org/mailman/listinfo/amber
Received on Thu Jan 26 2017 - 14:30:02 PST
Custom Search