usatlas-hllhc-computing-l AT lists.bnl.gov
Subject: US ATLAS HL-LHC computing discussion
List archive
Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization
- From: "Jha, Shantenu" <shantenu AT bnl.gov>
- To: Kaushik De <kaushik AT uta.edu>
- Cc: "usatlas-hllhc-computing-l AT lists.bnl.gov" <usatlas-hllhc-computing-l AT lists.bnl.gov>, atlas-adc-panda <atlas-adc-panda AT cern.ch>
- Subject: Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization
- Date: Thu, 21 Mar 2019 16:06:48 +0000
Hi Torre,
Please see slides about NGE / RADICAL-Pilot on Summit from the meeting last week.
Thanks,
Shantenu
On Mar 21, 2019, at 11:34 AM, Kaushik De <kaushik AT uta.edu> wrote:
Hi Torre,_______________________________________________
We discussed a plan to try co-scheduling with NGE at the last WFM meeting. I think Pavlo and Matteo are working on this. They have already made some progress. We should try this approach first, before we try future capabilities in Condor, IMHO. Cheers,
Kaushik
On Mar 21, 2019, at 11:12 AM, Torre Wenaus <wenaus AT gmail.com> wrote:
Hi,_______________________________________________I had a chat with Miron here at JLab. He's interested to know how we can collaborate. I mentioned one area that came to mind, please comment on it and how we might get something going if you think it's reasonable. We want to co-schedule CPU and GPU payloads on big HPCs. We're currently thinking of doing that at the PanDA/pilot level. Condor doesn't even function at this point on HPCs without outbound connectivity from worker nodes. But as Miron mentioned and as we've heard here in the meeting, Condor is working on this, in particular at Barcelona, using the file system to communicate with workers via an edge service just as we do. So Condor is on its way in the door on these systems, and Miron is interested in the CPU/GPU co-scheduling use case.Torre
Usatlas-hllhc-computing-l mailing list
Usatlas-hllhc-computing-l AT lists.bnl.gov
https://lists.bnl.gov/mailman/listinfo/usatlas-hllhc-computing-l
Usatlas-hllhc-computing-l mailing list
Usatlas-hllhc-computing-l AT lists.bnl.gov
https://lists.bnl.gov/mailman/listinfo/usatlas-hllhc-computing-l
Attachment:
nge-harvester-integration_2.pdf
Description: nge-harvester-integration_2.pdf
-
[Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization,
Torre Wenaus, 03/21/2019
-
Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization,
Pavlo Svirin, 03/21/2019
- Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization, Torre Wenaus, 03/21/2019
-
Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization,
Kaushik De, 03/21/2019
- Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization, Jha, Shantenu, 03/21/2019
-
Re: [Usatlas-hllhc-computing-l] Collaboration with Condor on HPC utilization,
Pavlo Svirin, 03/21/2019
Archive powered by MHonArc 2.6.24.