sphenix-production-l AT lists.bnl.gov
Subject: Sphenix-production-l mailing list
List archive
- From: Alex Lebedev <lebedev AT iastate.edu>
- To: sphenix-production-l AT lists.bnl.gov
- Subject: [[Sphenix-production-l] ] Recently failed runs
- Date: Mon, 5 Aug 2024 11:27:25 -0500
Hi all,
I've attached a list of recently (over the weekend) failed runs.
There are three groups.
The first one (TRKR_HIT) seems to be "false negatives", at least the
one job I checked had valid output, but listed as failed in the database.
In the second group there are three calo reco jobs, which also seem
to be "false negatives".
Both groups are from Saturday.
The third group contains real failures, those are older calorimeter
reconstruction runs (43k-44k run range) which failed during re-processing
with ana430_2024p007 tags. Log files indicate that they all segfaulted
on event 1001, which seems to indicate some MBD calibration problems.
For this group I only listed zeroth segment, otherwise the list would be
too long.
Log files:
TRKR_HIT:
/sphenix/data/data02/sphnxpro/trackinglogs/new_2024p007/
calo dst production:
/sphenix/data/data02/sphnxpro/caloy2calib/ana430_2024p007/
for older one-step calo dst production:
/sphenix/data/data02/sphnxpro/caloy2test/new_2024p006/
Sasha.
status | flags | condor | started
---------+------------------------------------------------------------+-----------+-------+-----------+---------------------
4593061 | DST_TRKR_HIT_run2pp_new_2024p007-00049763-00997 | failed |
5 | 31053.30 | 2024-08-03 17:51:13
4593059 | DST_TRKR_HIT_run2pp_new_2024p007-00049762-00974 | failed |
5 | 31053.28 | 2024-08-03 17:51:13
4593058 | DST_TRKR_HIT_run2pp_new_2024p007-00049762-00973 | failed |
5 | 31053.27 | 2024-08-03 17:51:13
4593050 | DST_TRKR_HIT_run2pp_new_2024p007-00049760-00999 | failed |
5 | 31053.19 | 2024-08-03 17:51:13
4593049 | DST_TRKR_HIT_run2pp_new_2024p007-00049760-00998 | failed |
5 | 31053.18 | 2024-08-03 17:51:13
4593046 | DST_TRKR_HIT_run2pp_new_2024p007-00049758-03626 | failed |
5 | 31053.15 | 2024-08-03 17:51:13
4593042 | DST_TRKR_HIT_run2pp_new_2024p007-00049758-03622 | failed |
5 | 31053.11 | 2024-08-03 17:51:12
4593038 | DST_TRKR_HIT_run2pp_new_2024p007-00049752-01171 | failed |
5 | 31053.7 | 2024-08-03 17:51:11
4593035 | DST_TRKR_HIT_run2pp_new_2024p007-00049751-00991 | failed |
5 | 31053.4 | 2024-08-03 17:50:50
4593033 | DST_TRKR_HIT_run2pp_new_2024p007-00049749-00913 | failed |
5 | 31053.2 | 2024-08-03 17:50:48
4593031 | DST_TRKR_HIT_run2pp_new_2024p007-00049749-00911 | failed |
5 | 31053.0 | 2024-08-03 17:50:48
4591381 | DST_CALO_run2pp_new_2024p006-00049452-00707 | failed
| 5 | 31002.34 | 2024-08-03 15:20:32
4590744 | DST_CALO_run2pp_new_2024p006-00049742-00315 | failed
| 5 | 30986.5 | 2024-08-03 14:28:36
4589937 | DST_CALO_run2pp_new_2024p006-00049910-00230 | failed
| 5 | 30966.1 | 2024-08-03 13:23:37
4617908 | DST_CALO_run2pp_ana430_2024p007-00044478-00000 | failed
| | 31922.8088 | 2024-08-05 15:02:10
4617690 | DST_CALO_run2pp_ana430_2024p007-00044498-00000 | failed
| | 31922.7870 | 2024-08-05 15:02:04
4617293 | DST_CALO_run2pp_ana430_2024p007-00043671-00000 | failed
| | 31922.7473 | 2024-08-05 15:01:44
4617078 | DST_CALO_run2pp_ana430_2024p007-00043661-00000 | failed
| | 31922.7258 | 2024-08-05 15:01:35
4617063 | DST_CALO_run2pp_ana430_2024p007-00043664-00000 | failed
| | 31922.7243 | 2024-08-05 15:01:34
4617009 | DST_CALO_run2pp_ana430_2024p007-00043668-00000 | failed
| | 31922.7189 | 2024-08-05 15:01:32
4617002 | DST_CALO_run2pp_ana430_2024p007-00043669-00000 | failed
| | 31922.7182 | 2024-08-05 15:01:31
4616962 | DST_CALO_run2pp_ana430_2024p007-00043666-00000 | failed
| | 31922.7142 | 2024-08-05 15:01:30
4616959 | DST_CALO_run2pp_ana430_2024p007-00043657-00000 | failed
| | 31922.7139 | 2024-08-05 15:01:30
4616950 | DST_CALO_run2pp_ana430_2024p007-00043663-00000 | failed
| | 31922.7130 | 2024-08-05 15:01:30
4616942 | DST_CALO_run2pp_ana430_2024p007-00043654-00000 | failed
| | 31922.7122 | 2024-08-05 15:01:29
4616877 | DST_CALO_run2pp_ana430_2024p007-00043665-00000 | failed
| | 31922.7057 | 2024-08-05 15:01:25
4616868 | DST_CALO_run2pp_ana430_2024p007-00043673-00000 | failed
| | 31922.7048 | 2024-08-05 15:01:25
4616825 | DST_CALO_run2pp_ana430_2024p007-00043658-00000 | failed
| | 31922.7005 | 2024-08-05 15:01:23
4616823 | DST_CALO_run2pp_ana430_2024p007-00043645-00000 | failed
| | 31922.7003 | 2024-08-05 15:01:23
4615097 | DST_CALO_run2pp_ana430_2024p007-00044494-00000 | failed
| | 31922.5277 | 2024-08-05 14:59:51
4615079 | DST_CALO_run2pp_ana430_2024p007-00044495-00000 | failed
| | 31922.5259 | 2024-08-05 14:59:50
4614804 | DST_CALO_run2pp_ana430_2024p007-00043677-00000 | failed
| | 31922.4984 | 2024-08-05 14:59:38
4614723 | DST_CALO_run2pp_ana430_2024p007-00043682-00000 | failed
| | 31922.4903 | 2024-08-05 14:59:34
4614656 | DST_CALO_run2pp_ana430_2024p007-00043684-00000 | failed
| | 31922.4836 | 2024-08-05 14:59:31
4614553 | DST_CALO_run2pp_ana430_2024p007-00043681-00000 | failed
| | 31922.4733 | 2024-08-05 14:59:52
4614545 | DST_CALO_run2pp_ana430_2024p007-00043679-00000 | failed
| | 31922.4725 | 2024-08-05 14:59:26
4614537 | DST_CALO_run2pp_ana430_2024p007-00043686-00000 | failed
| | 31922.4717 | 2024-08-05 14:59:26
4614396 | DST_CALO_run2pp_ana430_2024p007-00043670-00000 | failed
| | 31922.4576 | 2024-08-05 14:59:20
4614345 | DST_CALO_run2pp_ana430_2024p007-00043659-00000 | failed
| | 31922.4525 | 2024-08-05 14:59:18
4614320 | DST_CALO_run2pp_ana430_2024p007-00043655-00000 | failed
| | 31922.4500 | 2024-08-05 14:59:17
4614293 | DST_CALO_run2pp_ana430_2024p007-00043674-00000 | failed
| | 31922.4473 | 2024-08-05 14:59:16
4614246 | DST_CALO_run2pp_ana430_2024p007-00043660-00000 | failed
| | 31922.4426 | 2024-08-05 14:59:14
4614175 | DST_CALO_run2pp_ana430_2024p007-00043653-00000 | failed
| | 31922.4355 | 2024-08-05 14:59:11
4614168 | DST_CALO_run2pp_ana430_2024p007-00043656-00000 | failed
| | 31922.4348 | 2024-08-05 14:59:11
4613286 | DST_CALO_run2pp_ana430_2024p007-00044482-00000 | failed
| | 31922.3466 | 2024-08-05 14:58:22
4613009 | DST_CALO_run2pp_ana430_2024p007-00044499-00000 | failed
| | 31922.3189 | 2024-08-05 14:58:11
4612852 | DST_CALO_run2pp_ana430_2024p007-00044479-00000 | failed
| | 31922.3032 | 2024-08-05 14:58:06
4612775 | DST_CALO_run2pp_ana430_2024p007-00044477-00000 | failed
| | 31922.2955 | 2024-08-05 14:58:02
4612514 | DST_CALO_run2pp_ana430_2024p007-00043685-00000 | failed
| | 31922.2694 | 2024-08-05 14:57:50
4612427 | DST_CALO_run2pp_ana430_2024p007-00043680-00000 | failed
| | 31922.2607 | 2024-08-05 14:57:47
4612424 | DST_CALO_run2pp_ana430_2024p007-00043678-00000 | failed
| | 31922.2604 | 2024-08-05 14:57:47
4612421 | DST_CALO_run2pp_ana430_2024p007-00043683-00000 | failed
| | 31922.2601 | 2024-08-05 14:57:47
4612405 | DST_CALO_run2pp_ana430_2024p007-00043676-00000 | failed
| | 31922.2585 | 2024-08-05 14:57:46
4612306 | DST_CALO_run2pp_ana430_2024p007-00043675-00000 | failed
| | 31922.2486 | 2024-08-05 14:57:41
4610999 | DST_CALO_run2pp_ana430_2024p007-00044483-00000 | failed
| | 31922.1179 | 2024-08-05 14:56:48
-
[[Sphenix-production-l] ] recently failed runs,
Alex Lebedev, 08/02/2024
- <Possible follow-up(s)>
- [[Sphenix-production-l] ] Recently failed runs, Alex Lebedev, 08/05/2024
Archive powered by MHonArc 2.6.24.