Atlas-connect-l mailing list

[Sergei Chekanov <chekanov AT anl.gov>]

 Hi, Gordon

 Thanks. It looks like I do not have the permission to replicate the data:

voms-proxy-init -voms atlas
export STORAGEPREFIX=root://fax.mwt2.org/
lsetup rucio dq2

 for dataset in `rucio list-dids --short 
data16_13TeV.*.physics_Main.merge.DAOD_EXOT2.f698_m1594_p2667`; do echo 
$dataset ; rucio add-rule $dataset 1 MWT2_UC_LOCALGROUPDISK; done

data16_13TeV:data16_13TeV.00298773.physics_Main.merge.DAOD_EXOT2.f698_m1594_p2667
2016-09-15 17:01:10,620 ERROR [There is not enough quota left to fulfil 
the operation.
Details: There is insufficient quota on any of the target RSE's to 
fullfill the operation.]
data16_13TeV:data16_13TeV.00298609.physics_Main.merge.DAOD_EXOT2.f698_m1594_p2667
2016-09-15 17:01:11,506 ERROR [There is not enough quota left to fulfil 
the operation.
Details: There is insufficient quota on any of the target RSE's to 
fullfill the operation.]


best wishes, Sergei


On 09/15/2016 04:48 PM, Giordon Stark wrote:
> Hi all,
>
> Go ahead and replicate to the MWT2. I'm not entirely sure why there's a
> permission denied unless it's stored on some site that just does not
> have the necessary permissions...
>
> kratsg@tier3:~$ rucio list-file-replicas
> data16_13TeV:DAOD_EXOT2.09230919._000006.pool.root.1
> +--------------+-----------------------------------------+------------+-----------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
> | SCOPE        | NAME                                    | FILESIZE   |
> ADLER32   | RSE: REPLICA
>
>                                          |
> |--------------+-----------------------------------------+------------+-----------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
> | data16_13TeV | DAOD_EXOT2.09230919._000006.pool.root.1 | 3.7 GB     |
> 0997d614  | CERN-PROD_DATADISK:
> gsiftp://eosatlassftp.cern.ch:2811/eos/atlas/atlasdatadisk/rucio/data16_13TeV/37/c3/DAOD_EXOT2.09230919._000006.pool.root.1
> <http://eosatlassftp.cern.ch:2811/eos/atlas/atlasdatadisk/rucio/data16_13TeV/37/c3/DAOD_EXOT2.09230919._000006.pool.root.1>
>                               |
> | data16_13TeV | DAOD_EXOT2.09230919._000006.pool.root.1 | 3.7 GB     |
> 0997d614  | BNL-OSG2_DATADISK:
> https://dcgftp.usatlas.bnl.gov:443/pnfs/usatlas.bnl.gov/BNLT0D1/rucio/data16_13TeV/37/c3/DAOD_EXOT2.09230919._000006.pool.root.1
>                           |
> | data16_13TeV | DAOD_EXOT2.09230919._000006.pool.root.1 | 3.7 GB     |
> 0997d614  | NIKHEF-ELPROD_DATADISK:
> srm://tbn18.nikhef.nl:8446/srm/managerv2?SFN=/dpm/nikhef.nl/home/atlas/atlasdatadisk/rucio/data16_13TeV/37/c3/DAOD_EXOT2.09230919._000006.pool.root.1
> <http://tbn18.nikhef.nl:8446/srm/managerv2?SFN=/dpm/nikhef.nl/home/atlas/atlasdatadisk/rucio/data16_13TeV/37/c3/DAOD_EXOT2.09230919._000006.pool.root.1>
> |
> | data16_13TeV | DAOD_EXOT2.09230919._000006.pool.root.1 | 3.7 GB     |
> 0997d614  | TOKYO-LCG2_DATADISK:
> srm://lcg-se01.icepp.jp:8446/srm/managerv2?SFN=/dpm/icepp.jp/home/atlas/atlasdatadisk/rucio/data16_13TeV/37/c3/DAOD_EXOT2.09230919._000006.pool.root.1
> <http://lcg-se01.icepp.jp:8446/srm/managerv2?SFN=/dpm/icepp.jp/home/atlas/atlasdatadisk/rucio/data16_13TeV/37/c3/DAOD_EXOT2.09230919._000006.pool.root.1>
>   |
> +--------------+-----------------------------------------+------------+-----------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
>
> Looking at this, you should have access to either CERN or BNL's datadisk
> if you're just part of ATLAS. The fact that you don't will need to be
> taken up with DAST because something's odd with permissions.
>
> For the replicating part, if you have MWT2 permissions, you can run
> something like this:
>
> for dataset in `rucio list-dids --short
> data16_13TeV.*.physics_Main.merge.DAOD_EXOT2.f698_m1594_p2667`; do echo
> $dataset ; rucio add-rule $dataset 1 MWT2_UC_LOCALGROUPDISK; done
>
> for dataset in `rucio list-dids --short
> data16_13TeV.*.physics_Main.merge.DAOD_EXOT2.f705_m1606_p2667`; do echo
> $dataset ; rucio add-rule $dataset 1 MWT2_UC_LOCALGROUPDISK; done
>
> for dataset in `rucio list-dids
> --short data15_13TeV.*.physics_Main.merge.DAOD_EXOT2.r7562_p2521_p2667`;
> do echo $dataset ; rucio add-rule $dataset 1 MWT2_UC_LOCALGROUPDISK; done
>
> for each pattern you wish to replicate and this will add a rule for you
> and start the replication process. Do `lsetup rucio fax dq2` and
> `voms-proxy-init -voms atlas` before running the above 3 commands. The
> commands will output the name of the sample it replicates and the rule
> id for it, which you can look up the status for.
>
> On Thu, Sep 15, 2016 at 11:25 PM Sergei Chekanov <chekanov AT anl.gov
> <mailto:chekanov AT anl.gov>> wrote:
>
>
>       Hello (cc Rui),
>
>       We are trying to read data (from ANL) such as:
>
>       data16_13TeV.*.physics_Main.merge.DAOD_EXOT2.f698_m1594_p2667
>       data16_13TeV.*.physics_Main.merge.DAOD_EXOT2.f705_m1606_p2667
>       data15_13TeV.*.physics_Main.merge.DAOD_EXOT2.r7562_p2521_p2667
>
>     and we have noticed that some files are not available. Example:
>
>
>     
> root://fax.mwt2.org//atlas/rucio/data16_13TeV:DAOD_EXOT2.09230919._000006.pool.root.1
>     
> <http://fax.mwt2.org//atlas/rucio/data16_13TeV:DAOD_EXOT2.09230919._000006.pool.root.1>
>
>     The error:
>     TNetXNGFile::Open         ERROR   [ERROR] Server responded with an
>     error: [3010] Unable to open
>     /atlas/rucio/data16_13TeV:DAOD_EXOT2.09230919._000006.pool.root.1;
>     permission denied
>
>     Is it possible to keep "DAOD_EXOT2" data in MWT2?
>
>     best, Sergei
>
>     --
>            Sergei Chekanov           | http://www.hep.anl.gov/chekanov/
>            ===============           | Email: chekanov AT anl.gov
>     <mailto:chekanov AT anl.gov>
>           HEP Division, ANL          | Tel  : +01-630-252 6541
>     9700 S.Cass,Lemont, IL60439,USA | Fax  : +01-630-252-5782
>
>     _______________________________________________
>     Atlas-connect-l mailing list
>     Atlas-connect-l AT lists.bnl.gov <mailto:Atlas-connect-l AT lists.bnl.gov>
>     https://lists.bnl.gov/mailman/listinfo/atlas-connect-l