sphenix-tracking-l AT lists.bnl.gov
Subject: sPHENIX tracking discussion
List archive
Re: [Sphenix-tracking-l] memory plots for 10k events
- From: Anthony Frawley <afrawley AT fsu.edu>
- To: sphenix-tracking <sphenix-tracking-l AT lists.bnl.gov>, pinkenburg <pinkenburg AT bnl.gov>
- Subject: Re: [Sphenix-tracking-l] memory plots for 10k events
- Date: Fri, 14 Jan 2022 16:16:00 +0000
Hello Chris,
Ouch. So even after the rapid rise to 8 GB resident memory, it doubles again. Do we have any memory profiling tools?
Tony
From: sPHENIX-tracking-l <sphenix-tracking-l-bounces AT lists.bnl.gov> on behalf of pinkenburg via sPHENIX-tracking-l <sphenix-tracking-l AT lists.bnl.gov>
Sent: Friday, January 14, 2022 10:46 AM
To: sphenix-tracking <sphenix-tracking-l AT lists.bnl.gov>
Subject: [Sphenix-tracking-l] memory plots for 10k events
Sent: Friday, January 14, 2022 10:46 AM
To: sphenix-tracking <sphenix-tracking-l AT lists.bnl.gov>
Subject: [Sphenix-tracking-l] memory plots for 10k events
Hi folks,
I ran over 10k events from the latest production under prmon with the
current tracking (Wednesday to be specific). The plots are attached. It
doesn't seem to make a difference if the tracks are written out or not
(with output/no output) . There goes my pet theory which was based on
https://urldefense.com/v3/__https://github.com/pinkenburg/rootmemory__;!!PhOWcWs!lzlLUxlIUvOP0PdItgdBME0jGja82Pe6D-1ppFUXDVVXJSXxpROhmlRu49EBIYPT$ , though those tests were done
without reading root objects which is what our tracking does.
Our resident memory grows by quite a bit, roughly a factor of 2 (rss
memory only in PrMon_wtime_vs_rss_with_output.png). If the vmem turns
out to be a feature we need to adjust the swap space of our nodes by
quite a bit.
Another observation is that asking for 10k events results in reading
10195 events - something in our chain is discarding events at a 2% level
(returning ABORT_EVENT).
Chris
--
*************************************************************
Christopher H. Pinkenburg ; pinkenburg AT bnl.gov
; https://urldefense.com/v3/__http://www.phenix.bnl.gov/*pinkenbu__;fg!!PhOWcWs!lzlLUxlIUvOP0PdItgdBME0jGja82Pe6D-1ppFUXDVVXJSXxpROhmlRu499iM7pX$
Brookhaven National Laboratory ; phone: (631) 344-5692
Physics Department Bldg 510 C ; fax: (631) 344-3253
Upton, NY 11973-5000
*************************************************************
I ran over 10k events from the latest production under prmon with the
current tracking (Wednesday to be specific). The plots are attached. It
doesn't seem to make a difference if the tracks are written out or not
(with output/no output) . There goes my pet theory which was based on
https://urldefense.com/v3/__https://github.com/pinkenburg/rootmemory__;!!PhOWcWs!lzlLUxlIUvOP0PdItgdBME0jGja82Pe6D-1ppFUXDVVXJSXxpROhmlRu49EBIYPT$ , though those tests were done
without reading root objects which is what our tracking does.
Our resident memory grows by quite a bit, roughly a factor of 2 (rss
memory only in PrMon_wtime_vs_rss_with_output.png). If the vmem turns
out to be a feature we need to adjust the swap space of our nodes by
quite a bit.
Another observation is that asking for 10k events results in reading
10195 events - something in our chain is discarding events at a 2% level
(returning ABORT_EVENT).
Chris
--
*************************************************************
Christopher H. Pinkenburg ; pinkenburg AT bnl.gov
; https://urldefense.com/v3/__http://www.phenix.bnl.gov/*pinkenbu__;fg!!PhOWcWs!lzlLUxlIUvOP0PdItgdBME0jGja82Pe6D-1ppFUXDVVXJSXxpROhmlRu499iM7pX$
Brookhaven National Laboratory ; phone: (631) 344-5692
Physics Department Bldg 510 C ; fax: (631) 344-3253
Upton, NY 11973-5000
*************************************************************
-
[Sphenix-tracking-l] memory plots for 10k events,
pinkenburg, 01/14/2022
- Re: [Sphenix-tracking-l] [EXTERNAL] memory plots for 10k events, Osborn, Joe, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
Anthony Frawley, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
pinkenburg, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
Hugo Pereira Da Costa, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
Anthony Frawley, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
Hugo Pereira Da Costa, 01/14/2022
-
Re: [Sphenix-tracking-l] [EXTERNAL] Re: memory plots for 10k events,
Osborn, Joe, 01/14/2022
- Re: [Sphenix-tracking-l] [EXTERNAL] Re: memory plots for 10k events, Hugo Pereira Da Costa, 01/14/2022
-
Re: [Sphenix-tracking-l] [EXTERNAL] Re: memory plots for 10k events,
Osborn, Joe, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
Hugo Pereira Da Costa, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
Anthony Frawley, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
Hugo Pereira Da Costa, 01/14/2022
- Re: [Sphenix-tracking-l] memory plots for 10k events, pinkenburg, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
Hugo Pereira Da Costa, 01/14/2022
-
Re: [Sphenix-tracking-l] memory plots for 10k events,
pinkenburg, 01/14/2022
Archive powered by MHonArc 2.6.24.