Skip to Content.
Sympa Menu

sphenix-production-l - [[Sphenix-production-l] ]

sphenix-production-l AT lists.bnl.gov

Subject: Sphenix-production-l mailing list

List archive

Chronological Thread  
  • From: Alex Lebedev <lebedev AT iastate.edu>
  • To: sphenix-production-l AT lists.bnl.gov
  • Subject: [[Sphenix-production-l] ]
  • Date: Wed, 31 Jul 2024 16:51:12 -0500

We have a lot of failed tracking jobs today. They are all TRKR_SEED and TRKR_TRACKS. HIT and CLUSTER jobs are fine. I've attached a thinned 
down list of failed jobs. I'm showing the first segment of the run only
(all other segments also failed) and I've excluded fast jobs for the failed runs.

Not all tracking runs fail, some complete tracking without problems.

Also, I think TRKR_TRACKS jobs failed because TRKR_SEED jobs failed.

Sasha.

P.S. Log files are in directories:
calo reco: /sphenix/data/data02/sphnxpro/caloy2test/new_2024p006
TRKR_SEED: /sphenix/data/data02/sphnxpro/trackinglogs
all other tracking: /sphenix/data/data02/sphnxpro/trackinglogs/new_2024p005
streaming event combining: /sphenix/data/data02/sphnxpro/streaminglogs
calo event combining: /sphenix/data/data02/sphnxpro/calologs


id | dstfile |
status | flags | condor | started
---------+------------------------------------------------------------+-----------+-------+-----------+---------------------
4102667 | DST_TRIGGERED_EVENT_run2pp_new_2024p003-00049694-00000 |
failed | | 29639.1 | 2024-07-31 07:57:12
4094077 | DST_MVTX_EVENT_run2pp_new_2024p002-00049736-00000 |
failed | 5 | 29604.15 | 2024-07-31 06:39:47
4094076 | DST_MVTX_EVENT_run2pp_new_2024p002-00049722-00000 |
failed | 5 | 29604.14 | 2024-07-31 06:39:47
4094069 | DST_MVTX_EVENT_run2pp_new_2024p002-00049715-00000 |
failed | | 29604.7 | 2024-07-31 06:39:46
4093960 | DST_STREAMING_EVENT_run2pp_new_2024p002-00049736-00000 |
failed | 5 | 29599.22 | 2024-07-31 06:31:23
4093952 | DST_STREAMING_EVENT_run2pp_new_2024p002-00049715-00000 |
failed | | 29599.14 | 2024-07-31 06:31:24
4093936 | DST_STREAMING_EVENT_run2ppfast_new_2024p002-00049736-00000 |
failed | 5 | 29598.9 | 2024-07-31 06:28:51
4093928 | DST_STREAMING_EVENT_run2ppfast_new_2024p002-00049715-00000 |
failed | | 29598.1 | 2024-07-31 06:28:51
4086060 | DST_MVTX_EVENT_run2pp_new_2024p002-00049707-00000 |
failed | 5 | 29576.10 | 2024-07-31 05:25:39
4086051 | DST_MVTX_EVENT_run2pp_new_2024p002-00049685-00000 |
failed | 5 | 29576.1 | 2024-07-31 05:25:38
4184256 | DST_TRKR_SEED_run2pp_new_2024p005-00049685-00000 | failed
| | 29907.726 | 2024-07-31 20:51:33
4167412 | DST_TRKR_SEED_run2pp_new_2024p005-00049722-00000 | failed
| | 29860.885 | 2024-07-31 18:16:24
4167411 | DST_TRKR_SEED_run2pp_new_2024p005-00049720-00000 | failed
| | 29860.884 | 2024-07-31 18:16:23
4167410 | DST_TRKR_SEED_run2pp_new_2024p005-00049715-00000 | failed
| | 29860.883 | 2024-07-31 18:16:23
4167409 | DST_TRKR_SEED_run2pp_new_2024p005-00049714-00000 | failed
| | 29860.882 | 2024-07-31 18:16:24
4167408 | DST_TRKR_SEED_run2pp_new_2024p005-00049713-00000 | failed
| | 29860.881 | 2024-07-31 18:16:23
4167407 | DST_TRKR_SEED_run2pp_new_2024p005-00049712-00000 | failed
| | 29860.880 | 2024-07-31 18:16:23
4167406 | DST_TRKR_SEED_run2pp_new_2024p005-00049708-00000 | failed
| | 29860.879 | 2024-07-31 18:16:23
4167405 | DST_TRKR_SEED_run2pp_new_2024p005-00049706-00000 | failed
| | 29860.878 | 2024-07-31 18:16:25
4163470 | DST_TRKR_SEED_run2pp_new_2024p005-00049721-00000 | failed
| | 29845.864 | 2024-07-31 17:28:05
4163469 | DST_TRKR_SEED_run2pp_new_2024p005-00049719-00000 | failed
| | 29845.863 | 2024-07-31 17:28:05
4159759 | DST_TRKR_SEED_run2pp_new_2024p005-00049718-00000 | failed
| | 29831.2796 | 2024-07-31 16:41:01
4159758 | DST_TRKR_SEED_run2pp_new_2024p005-00049717-00000 | failed
| | 29831.2795 | 2024-07-31 16:41:01
4159757 | DST_TRKR_SEED_run2pp_new_2024p005-00049716-00000 | failed
| | 29831.2794 | 2024-07-31 16:41:01
4159756 | DST_TRKR_SEED_run2pp_new_2024p005-00049711-00000 | failed
| | 29831.2793 | 2024-07-31 16:41:01
4159755 | DST_TRKR_SEED_run2pp_new_2024p005-00049710-00000 | failed
| | 29831.2792 | 2024-07-31 16:41:00
4159754 | DST_TRKR_SEED_run2pp_new_2024p005-00049709-00000 | failed
| | 29831.2791 | 2024-07-31 16:41:00
4159753 | DST_TRKR_SEED_run2pp_new_2024p005-00049707-00000 | failed
| | 29831.2790 | 2024-07-31 16:41:00
4159752 | DST_TRKR_SEED_run2pp_new_2024p005-00049705-00000 | failed
| | 29831.2789 | 2024-07-31 16:41:00
4159714 | DST_TRKR_SEED_run2pp_new_2024p005-00049690-00000 | failed
| | 29831.2751 | 2024-07-31 16:40:59
4159713 | DST_TRKR_SEED_run2pp_new_2024p005-00049688-00000 | failed
| | 29831.2750 | 2024-07-31 16:40:59
4177180 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049722-00000 | failed
| | 29880.883 | 2024-07-31 19:20:37
4177179 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049720-00000 | failed
| | 29880.882 | 2024-07-31 19:20:37
4177178 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049715-00000 | failed
| | 29880.881 | 2024-07-31 19:20:37
4177177 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049712-00000 | failed
| | 29880.880 | 2024-07-31 19:20:37
4177176 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049708-00000 | failed
| | 29880.879 | 2024-07-31 19:20:37
4177175 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049706-00000 | failed
| | 29880.878 | 2024-07-31 19:20:37
4171480 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049721-00000 | failed
| | 29864.3661 | 2024-07-31 18:31:37
4171479 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049719-00000 | failed
| | 29864.3660 | 2024-07-31 18:31:49
4171478 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049718-00000 | failed
| | 29864.3659 | 2024-07-31 18:31:37
4171477 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049717-00000 | failed
| | 29864.3658 | 2024-07-31 18:33:51
4171476 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049716-00000 | failed
| | 29864.3657 | 2024-07-31 18:31:39
4171475 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049711-00000 | failed
| | 29864.3656 | 2024-07-31 18:32:38
4171474 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049710-00000 | failed
| | 29864.3655 | 2024-07-31 18:34:05
4171473 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049709-00000 | failed
| | 29864.3654 | 2024-07-31 18:33:38
4171472 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049707-00000 | failed
| | 29864.3653 | 2024-07-31 18:32:39
4171471 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049705-00000 | failed
| | 29864.3652 | 2024-07-31 18:31:51
4171433 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049690-00000 | failed
| | 29864.3614 | 2024-07-31 18:33:42
4171432 | DST_TRKR_TRACKS_run2pp_new_2024p005-00049688-00000 | failed
| | 29864.3613 | 2024-07-31 18:32:19

  • [[Sphenix-production-l] ], Alex Lebedev, 07/31/2024

Archive powered by MHonArc 2.6.24.

Top of Page