usatlas-hllhc-computing-l AT lists.bnl.gov

Subject: US ATLAS HL-LHC computing discussion

List archive

[Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization

From: Torre Wenaus <wenaus AT gmail.com>
To: atlas-adc-panda <atlas-adc-panda AT cern.ch>, <usatlas-hllhc-computing-l AT lists.bnl.gov>
Subject: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization
Date: Thu, 21 Mar 2019 11:12:15 -0400

Hi,

I had a chat with Miron here at JLab. He's interested to know how we can collaborate. I mentioned one area that came to mind, please comment on it and how we might get something going if you think it's reasonable. We want to co-schedule CPU and GPU payloads on big HPCs. We're currently thinking of doing that at the PanDA/pilot level. Condor doesn't even function at this point on HPCs without outbound connectivity from worker nodes. But as Miron mentioned and as we've heard here in the meeting, Condor is working on this, in particular at Barcelona, using the file system to communicate with workers via an edge service just as we do. So Condor is on its way in the door on these systems, and Miron is interested in the CPU/GPU co-scheduling use case.

Torre

[Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization, Torre Wenaus, 03/21/2019
- Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization, Pavlo Svirin, 03/21/2019
  - Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization, Torre Wenaus, 03/21/2019
- Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization, Kaushik De, 03/21/2019
  - Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization, Jha, Shantenu, 03/21/2019