sPHENIX discussion of software

[pinkenburg <pinkenburg AT bnl.gov>]

    Hi Joe,
    
    good point, we should strip some of the nodes from that file. Looks
    like there is still a lot of tracking debugging info
    
    Chris

On 3/4/2022 4:53 PM, Osborn, Joe wrote:

Hi Chris,

 

Does the 2GB for tracks include clusters, or is this only the SvtxTrackMap information?

 

---------------------------   Joe Osborn, Ph.D. Associate Research Scientist Oak Ridge National Laboratory osbornjd AT ornl.gov (859)-433-8738

 

 

From: sPHENIX-software-l <sphenix-software-l-bounces AT lists.bnl.gov> on behalf of pinkenburg via sPHENIX-software-l <sphenix-software-l AT lists.bnl.gov>
Date: Friday, March 4, 2022 at 3:53 PM
To: sphenix-software-l AT lists.bnl.gov <sphenix-software-l AT lists.bnl.gov>
Subject: [EXTERNAL] [Sphenix-software-l] access speed to lustre

Hi folks,

looks like the 5 servers didn't make a dent - I see transfer rates of
500kB/s for a file. The size of the file I am looking at is 12GB which
means it'll take 4 hours give or take.

In the general meeting I mentioned that the truth info is our biggest
file and its content is a complete overkill for physics analysis. If we
ever want a chance to analyze the data the TG's need to come up with a
solution for their truth info needs - we cannot solve this by increasing
the number of servers by feasible amounts.

To illustrate this, analyzing this combination:
DST_TRUTH_pythia8_Jet04_3MHz-0000000003-00000.root
DST_TRACK_pythia8_Jet04_3MHz-0000000003-00000.root
DST_CALO_CLUSTER_pythia8_Jet04_3MHz-0000000003-00000.root

is

12GB for the truth file
  2GB for the tracks (not great either)
180MB for the calorimeter

The vast majority of the truth info is hits which nobody cares about in
analysis.

Chris

--
*************************************************************

Christopher H. Pinkenburg       ;    pinkenburg AT bnl.gov
                                ;    hxxp://www.phenix.bnl.gov/~pinkenbu

Brookhaven National Laboratory  ;    phone: (631) 344-5692
Physics Department Bldg 510 C   ;    fax:   (631) 344-3253
Upton, NY 11973-5000

*************************************************************

_______________________________________________
sPHENIX-software-l mailing list
sPHENIX-software-l AT lists.bnl.gov
hxxps://lists.bnl.gov/mailman/listinfo/sphenix-software-l

-- 
*************************************************************

Christopher H. Pinkenburg	;    pinkenburg AT bnl.gov
				;    http://www.phenix.bnl.gov/~pinkenbu

Brookhaven National Laboratory	;    phone: (631) 344-5692
Physics Department Bldg 510 C	;    fax:   (631) 344-3253
Upton, NY 11973-5000

*************************************************************

Attachment: Capture.PNG
Description: PNG image