Commissioning and running of sPHENIX

[Stefan Bathe <stefan.bathe AT baruch.cuny.edu>]

Minutes shift change 2023-04-29

evening:  Genki
- no problems
- INTT work
- remote HCal work (Hanpu)

night:  David
- no problems
- some more ongoing remote work

day:  Zhaozhong
- at 8:45am TPC NE cooling was forced tripped by accidental click , 
immediately turned back on
- IR exhaust fan came on multiple times, called MCR, false alarm? —> follow 
up with Lee on Monday
- 11:00am alarm for water leak at labyrinth entrance:  not audible!! —> 
follow up with Lee and Joel
  - entered AH, found water near entrance, traced back to chiller platform B
  - got in touch with Peter, Peter instructed to turn off TPC LV and close 
valves for both supply and return, which stopped leak
  - Cameron and Frank came in, fixed pipe connection (loose hose clamp)
  - in the process chiller was switched off, Cameron did drain as display 
suggested, but it turns out this is not advised
  - all fixed now, Rob confirmed that it is save to turn TPC LV back on
  - still drying out area with pads
- Cameron finished cabling work for Joel

MBD (Mickey)
- nothing interesting

HCal (Hanpu)
- yesterday evening lots of problems trying to take cosmics
  - every try there was a high chance to to crash seb17 or 16 or rc_control, 
needed to recover every few minutes, got got 2 h of cosmics out of 5 h or 
work!  —> follow up with Martin
- today Emma saw message "seb16 2W2 rack trigger not functioning” 
  - this is the same problem as a few days ago,  which was solved by swapping 
out crate controller -> follow up with Martin, Dan Lis
- event number stuck, no blue light in TP fan out board, suggests GTM problem 
 —> follow up with Martin

EMCal
- no report

TPOT (Hugo by email)
- took noise data yesterday and Thursday with the pole tip doors closed. No 
increase in noise was observed.

TPC (Jin)
- heroic effort from 1008 crew to fix the TPC ECW leak on the Chiller 
Platform B
- status summarized in an interactive snapshot on the TPC FEE status:
https://urldefense.com/v3/__https://snapshots.raintank.io/dashboard/snapshot/dfBFK6d7Lx9tsytp1NkgmSDuH1kAmsLR__;!!P4SdNyxKAPE!GbdO0crxL87I9mk4rZKf8n60abu_IsZYrEIfnRKdnM8_pvyUuxO1kyVxx9-sW3MnT3KGyuoh4Sf6Bmfya06Ve7127ead7_QDgk_eSUYi$
 
    • Takao got 622 out of 624 TPC FEEs to link and readout telemetry around 
end of Friday
    • Most links have been stable since then other than few transient 
instability
    • Around 9AM, north LV was accidentally cycled which lead to quite a few 
link loss : https://sphenix-intra.sdcc.bnl.gov/WWW/elog/Run+2023+Log/438
    • All FEEs off since noon with the ECW fix : 
https://sphenix-intra.sdcc.bnl.gov/WWW/elog/Run+2023+Log/442
 Note to shift crew is any cooling or LV operation (including of the 9AM 
quick reset) should make an entry in the TPC Elog. (And not for now and only 
later during serious operation, any cooling or LV interruption need
 call TPC expert on shift to properly recover electronics)

INTT (Genki)
- LV GUI will be updated for shift crew
- this evening Raul will do work
- tomorrow will do noise data measurement

MVTX (Zhaozhong)
- yesterday ECW connected to chiller for daq system
- managed to read out data for felix 4 and felix 5, got prdf file, were able 
to decode

sEPD
- no report

DAQ
- no report

Magnet (from elog)
- Martin did work on GTM

Plan of the day
- DAQ development
- subsystem testing

- 
---------------------------------------------------------------------------------
Stefan Bathe
Professor of Physics
Baruch College, CUNY
and RIKEN Visiting Scientist

Baruch:                                     BNL:
17 Lexington Ave                      Bldg. 510
office 940                                  office 2-229
phone 646-660-6272                phone 631-344-8490
----------------------------------------------------------------------------------