Skip to Content.
Sympa Menu

usatlas-hllhc-computing-l - Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization

usatlas-hllhc-computing-l AT lists.bnl.gov

Subject: US ATLAS HL-LHC computing discussion

List archive

Chronological Thread  
  • From: "Jha, Shantenu" <shantenu AT bnl.gov>
  • To: Kaushik De <kaushik AT uta.edu>
  • Cc: "usatlas-hllhc-computing-l AT lists.bnl.gov" <usatlas-hllhc-computing-l AT lists.bnl.gov>, atlas-adc-panda <atlas-adc-panda AT cern.ch>
  • Subject: Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization
  • Date: Thu, 21 Mar 2019 16:06:48 +0000

Hi Torre, 

Please see slides about NGE / RADICAL-Pilot on Summit from the meeting last week. 

Thanks,
Shantenu

On Mar 21, 2019, at 11:34 AM, Kaushik De <kaushik AT uta.edu> wrote:

Hi Torre,

We discussed a plan to try co-scheduling with NGE at the last WFM meeting. I think Pavlo and Matteo are working on this. They have already made some progress. We should try this approach first, before we try future capabilities in Condor, IMHO. Cheers,

Kaushik



On Mar 21, 2019, at 11:12 AM, Torre Wenaus <wenaus AT gmail.com> wrote:

Hi,
I had a chat with Miron here at JLab. He's interested to know how we can collaborate. I mentioned one area that came to mind, please comment on it and how we might get something going if you think it's reasonable. We want to co-schedule CPU and GPU payloads on big HPCs. We're currently thinking of doing that at the PanDA/pilot level. Condor doesn't even function at this point on HPCs without outbound connectivity from worker nodes. But as Miron mentioned and as we've heard here in the meeting, Condor is working on this, in particular at Barcelona, using the file system to communicate with workers via an edge service just as we do. So Condor is on its way in the door on these systems, and Miron is interested in the CPU/GPU co-scheduling use case.
  Torre
_______________________________________________
Usatlas-hllhc-computing-l mailing list
Usatlas-hllhc-computing-l AT lists.bnl.gov
https://lists.bnl.gov/mailman/listinfo/usatlas-hllhc-computing-l

_______________________________________________
Usatlas-hllhc-computing-l mailing list
Usatlas-hllhc-computing-l AT lists.bnl.gov
https://lists.bnl.gov/mailman/listinfo/usatlas-hllhc-computing-l

Attachment: nge-harvester-integration_2.pdf
Description: nge-harvester-integration_2.pdf




Archive powered by MHonArc 2.6.24.

Top of Page