US ATLAS HL-LHC computing discussion

["Dong, Zhihua" <zdong AT bnl.gov>]

I did get some permission denied message  related to /eos  by just run

https://gitlab.cern.ch/atlas-simulation-fastcalosim/FastCaloSimAnalyzer/blob/master/macro/runTFCSShapeValidation.cxx

Although it does not stop the program yet, no message after that for a while...

...

...

initialising FCS_dsid...

FCS_dsid ready

(int) 2

* Running on linux system

sh: /FCS_ls.696.list: Permission denied

Temporary file list for selection:/eos/atlas/atlascerngroupdisk/proj-simul/InputSamplesProdsysProduction/mc16_13TeV.431004.ParticleGun_pid22_E65536_disj_eta_m25_m20_20_25_zv_0.deriv.NTUP_FCS.*/NTUP_FCS.*.pool.root.* : /FCS_ls.696.list

Zhihua Dong

Computational Science Initiative

Brookhaven National Laboratory

Phone: 631-344-4141

---

From: Hasib Ahmed <a.hasib AT cern.ch>
Sent: Friday, September 7, 2018 11:15:56 AM
To: Dong, Zhihua
Cc: Heather Gray; usatlas-hllhc-computing-l AT lists.bnl.gov
Subject: Re: [Usatlas-hllhc-computing-l] Fast Simulation Working Group

 

Dear Zhihua, 

The relevant steering macro for your use case is the following:

https://gitlab.cern.ch/atlas-simulation-fastcalosim/FastCaloSimAnalyzer/blob/master/macro/runTFCSShapeValidation.cxx

which does not require any other external file apart from the parametrization file that was mentioned earlier. 

Cheers,

Hasib 

------------------------------------
Hasib Ahmed

Research Associate
University of Edinburgh
ATLAS Experiment
-------------------------------------

On Fri, Sep 7, 2018 at 4:05 PM Dong, Zhihua <zdong AT bnl.gov> wrote:

It seems code also depend on "/eos/atlas/...."

Does that directory need to be setup someway ?

[zdong@icsubmit01 macro]$ grep eos *.cxx *.C |grep -v "//"

MakeTFCSEventAnalyzer.cxx:    topDir   = "/eos/atlas/atlascerngroupdisk/proj-simul/";

MakeTFCSEventAnalyzer.cxx:    plotDir = "/eos/project/a/atlas-fastcalosim/www/";

MakeTFCSNtupleMaker.cxx:    topDir   = "/eos/atlas/atlascerngroupdisk/proj-simul/InputSamplesLocalProd2017/rel_21_0_42/Samples/";

runTFCSCreateParametrization.cxx:  TString EinterfileName = Form("%s/mc16_13TeV.pid%i.Einterpol.ver01.root", "/eos/atlas/user/a/ahasib/public/Simul-FastCalo/ParametrizationProductionVer02/", pdgid);

runTFCSCreateParametrization.cxx:  TFCSParametrizationBase* para_photon_simple=NewParametrizationSimple("/eos/atlas/atlascerngroupdisk/proj-simul/InputSamplesLocalProd2017/rel_21_0_62/energyPara/epara_photon_E65_eta02_21061.root","/eos/atlas/atlascerngroupdisk/proj-simul/InputSamplesLocalProd2017/rel_21_0_62/shapePara/mc16_13TeV.photon.E65536.eta020_025.merged_default_z0.shapepara.root",22,65536,0.2,0.25);

runTFCSCreateParametrization.cxx:  TFCSParametrizationBase* para_pion_simple=NewParametrizationSimple("/eos/atlas/atlascerngroupdisk/proj-simul/InputSamplesLocalProd2017/rel_21_0_62/energyPara/epara_pion_E65_eta02_21061.root","/eos/atlas/atlascerngroupdisk/proj-simul/InputSamplesLocalProd2017/rel_21_0_62/shapePara/mc16_13TeV.pion.E65536.eta020_025.merged_default_z0.shapepara.root",211,65536,0.2,0.25);

runTFCSShapeValidation.cxx:    TFile* wigglefile = TFile::Open("/eos/atlas/user/a/ahasib/public/Simul-FastCalo/ParametrizationProductionVer02/Wiggle/eta_020_025/wiggle_input_deriv_Sampling_2.ver02.root");

test_TFCS2DFunctionHistogram.cxx:  TFile* file=TFile::Open("/eos/atlas/atlascerngroupdisk/proj-simul/InputSamplesLocalProd2017/rel_21_0_62/shapePara/mc16_13TeV.pion.E65536.eta020_025.merged_default_z0.shapepara.root");

runTFCSEnergyInterpolationTGraph.C:void runTFCSEnergyInterpolationTGraph(int pid = 22, float etamin = 0., float etamax = 5., bool useFit = false, bool doSpline = true, std::string inputDir = "/eos/atlas/atlascerngroupdisk/proj-simul/InputSamplesSummer18Complete/", std::string plotDir = "plot_Einterpol", std::string ver = "ver03")

testMaxrz.C: std::string file = "/eos/atlas/atlascerngroupdisk/proj-simul/InputSamplesProdsysProduction/mc16_13TeV.431202.ParticleGun_pid22_E262144_disj_eta_m15_m10_10_15_zv_0.deriv.NTUP_FCS.e6556_e5984_s3259_r10283_p3449/NTUP_FCS.13289425._000001.pool.root.1";

[zdong@icsubmit01 macro]$

Zhihua Dong

Computational Science Initiative

Brookhaven National Laboratory

Phone: 631-344-4141

---

From: Hasib Ahmed <a.hasib AT cern.ch>
Sent: Friday, September 7, 2018 4:39:10 AM
To: Heather Gray
Cc: Dong, Zhihua; usatlas-hllhc-computing-l AT lists.bnl.gov
Subject: Re: [Usatlas-hllhc-computing-l] Fast Simulation Working Group

 

Hello, 

I just started received email from the mailing list. Yes, what Heather said is indeed correct. This is the parametrization file used for fast simulation which is essential. Just using a copy from your local disk should do the trick. 

Thanks,

Hasib 

------------------------------------
Hasib Ahmed

Research Associate
University of Edinburgh
ATLAS Experiment
-------------------------------------

On Thu, Sep 6, 2018 at 11:42 PM Heather Gray <heather.gray AT cern.ch> wrote:

Hi Zhihua,

Ah, I know what this is. This is the fill that contains the parametrisation used to describe the calorimeter response -- i.e. it's the meat for FCS. I think we'll need to copy it somewhere local at BNL and then edit the code so that it points at it instead of the afs location.

Cheers

Heather

On Thu, 6 Sep 2018 at 12:21, Dong, Zhihua <zdong AT bnl.gov> wrote:

Even with Xin's help setup relocated cvms . 

Still get the same error.

Maybe somewhere the code still depends on non-exiting /afs on IC

/afs/cern.ch/atlas/groups/Simulation/FastCaloSimV2/TFCSparam_v005.root 

Zhihua Dong

Computational Science Initiative

Brookhaven National Laboratory

Phone: 631-344-4141

---

From: Lancon, Eric
Sent: Thursday, September 6, 2018 1:17:01 PM
To: Dong, Zhihua; Lin, Meifeng; Snyder,Scott S
Cc: usatlas-hllhc-computing-l AT lists.bnl.gov
Subject: Re: [Usatlas-hllhc-computing-l] Fast Simulation Working Group

 

OK good!

Xin did something to overcome the cvmfs issue I believe, when he tested KNLs

Eric

 

From: "Dong, Zhihua" <zdong AT bnl.gov>
Date: Thursday, September 6, 2018 at 12:51 PM
To: "Lancon, Eric" <elancon AT bnl.gov>, "Lin, Meifeng" <mlin AT bnl.gov>, "Snyder,Scott S" <snyder AT bnl.gov>
Cc: "usatlas-hllhc-computing-l AT lists.bnl.gov" <usatlas-hllhc-computing-l AT lists.bnl.gov>
Subject: Re: [Usatlas-hllhc-computing-l] Fast Simulation Working Group

 

Dear Eric

 

I don't have CERN account.  Costin helped me downloaded it.

 

Also  we installed ROOT on IC.

 

But the code seems depends on /afs or /cvmfs  which does not exist on IC.

 

Maybe it's just setup issue . Current setup.sh :

 

[zdong@icsubmit01 FastCaloSimAnalyzer]$ pwd

/hpcgpfs01/scratch/zdong/FS/afs/usatlas.bnl.gov/software/downloads/DB/21.0/athena/Simulation/ISF/ISF_FastCaloSim/FastCaloSimAnalyzer

[zdong@icsubmit01 FastCaloSimAnalyzer]$ cat setup.sh

if [ -z $ATLAS_LOCAL_ASETUP_VERSION ];

then

   # do it only if it has not been done yet

   export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase

   alias setupATLAS='source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh'

   source $ATLAS_LOCAL_ROOT_BASE/user/atlasLocalSetup.sh

else

   echo "Atlas environment already configured."

fi

lsetup root

lsetup git

[zdong@icsubmit01 FastCaloSimAnalyzer]$

 

 

Ignore it , get errors  in   ".x  runTFCSShapeValidation.cxx"

...

...

hit_to_cell_mapping_23                        INFO   PDGID: all ; Ekin=all ; eta=all

hit_to_cell_mapping_23                        INFO   Ekin_bin=all ; calosample=23

hit_to_cell_mapping_23                        INFO   geo=0

Error in <TFile::TFile>: file /afs/cern.ch/atlas/groups/Simulation/FastCaloSimV2/TFCSparam_v005.root does not exist

...

 

 

 

Zhihua Dong

Computational Science Initiative

Brookhaven National Laboratory

Phone: 631-344-4141

 

---

From: Lancon, Eric
Sent: Thursday, September 6, 2018 12:27:49 PM
To: Dong, Zhihua; Lin, Meifeng; Snyder,Scott S
Cc: usatlas-hllhc-computing-l AT lists.bnl.gov
Subject: Re: [Usatlas-hllhc-computing-l] Fast Simulation Working Group

 

Hello Zhihua,

 

I tested with my google account, access does not work,

Do you have a CERN account?

 

Yes it needs ROOT

his package is standalone and thus does NOT require athena BUT only requires root 6.08 or later versions.

 

Eric

 

From: Usatlas-hllhc-computing-l <usatlas-hllhc-computing-l-bounces AT lists.bnl.gov> on behalf of "Dong, Zhihua" <zdong AT bnl.gov>
Date: Thursday, September 6, 2018 at 11:46 AM
To: "Lin, Meifeng" <mlin AT bnl.gov>, "Snyder,Scott S" <snyder AT bnl.gov>
Cc: "usatlas-hllhc-computing-l AT lists.bnl.gov" <usatlas-hllhc-computing-l AT lists.bnl.gov>
Subject: Re: [Usatlas-hllhc-computing-l] Fast Simulation Working Group

 

This might be a stupid question .

 Do I need CERN account to download the 

https://gitlab.cern.ch/atlas-simulation-fastcalosim/FastCaloSimAnalyzer

 

Trying login with Google or other public account does not work for me.

 

Also does it require ROOT to run the code ?

 

 

Best

 

 

 

Zhihua Dong

Computational Science Initiative

Brookhaven National Laboratory

Phone: 631-344-4141

 

---

From: Usatlas-hllhc-computing-l <usatlas-hllhc-computing-l-bounces AT lists.bnl.gov> on behalf of scott snyder <scott.snyder AT cern.ch>
Sent: Wednesday, September 5, 2018 2:40:35 PM
To: Lin, Meifeng
Cc: usatlas-hllhc-computing-l AT lists.bnl.gov
Subject: Re: [Usatlas-hllhc-computing-l] Fast Simulation Working Group

 

hi Meifeng -

>Which server at BNL did you put the files on? Most of us at CSI only have access to the BNL
>Institutional Cluster nodes (icsubmit or knlsubmit), and I couldn't seem to find the directories you
>referred to in your doc.

I copied the tree /afs/usatlas.bnl.gov/software/downloads/DB/21.0
to ~snyder/21.0.tar.bz2  --- i think you should be able to read that.
Let me know when you've copied it so i can remove it from there.
thanks,
sss

_______________________________________________
Usatlas-hllhc-computing-l mailing list
Usatlas-hllhc-computing-l AT lists.bnl.gov
https://lists.bnl.gov/mailman/listinfo/usatlas-hllhc-computing-l

_______________________________________________
Usatlas-hllhc-computing-l mailing list
Usatlas-hllhc-computing-l AT lists.bnl.gov
https://lists.bnl.gov/mailman/listinfo/usatlas-hllhc-computing-l

_______________________________________________
Usatlas-hllhc-computing-l mailing list
Usatlas-hllhc-computing-l AT lists.bnl.gov
https://lists.bnl.gov/mailman/listinfo/usatlas-hllhc-computing-l