atlas-connect-l AT lists.bnl.gov

Subject: Atlas-connect-l mailing list

List archive

Re: [Atlas-connect-l] Faxbox unreachable.

From: Lincoln Bryant <lincolnb AT uchicago.edu>
To: Giordon Stark <gstark AT cern.ch>, Rohin T Narayan <rohin.tn AT gmail.com>
Cc: Gregory Farr <gfarr AT uchicago.edu>, atlas-connect-l <atlas-connect-l AT lists.bnl.gov>
Subject: Re: [Atlas-connect-l] Faxbox unreachable.
Date: Mon, 22 Jan 2018 09:49:45 -0600

Hi,

Indeed it looks like XRootD is hung. We're restarting the machine now.

Apologies for the inconvenience

--Lincoln
On 1/22/2018 2:44 AM, Giordon Stark wrote:

There's seems to be some issue, I'm also unable to access files. Here's the dump:

kratsg:~$ xrdcp -d 3 root://faxbox.usatlas.org//faxbox2/user/kratsg/main.rb main.rb

[2018-01-22 09:43:19.275363 +0100][Dump ][App ] Chunk size: 16777216, parallel chunks 4, streams: 1

[2018-01-22 09:43:19.275643 +0100][Dump ][App ] Processing source entry: root://faxbox.usatlas.org//faxbox2/user/kratsg/main.rb, type xroot, target file: file://main.rb

[2018-01-22 09:43:19.275671 +0100][Dump ][Utility ] URL: root://faxbox.usatlas.org//faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.275671 +0100][Dump ][Utility ] Protocol: root

[2018-01-22 09:43:19.275671 +0100][Dump ][Utility ] User Name:

[2018-01-22 09:43:19.275671 +0100][Dump ][Utility ] Password:

[2018-01-22 09:43:19.275671 +0100][Dump ][Utility ] Host Name: faxbox.usatlas.org

[2018-01-22 09:43:19.275671 +0100][Dump ][Utility ] Port: 1094

[2018-01-22 09:43:19.275671 +0100][Dump ][Utility ] Path: /faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.275748 +0100][Dump ][Utility ] Adding job with properties: 'checkSumMode' = 'none', 'checkSumPreset' = '', 'checkSumType' = '', 'chunkSize' = '16777216', 'coerce' = '0', 'dynamicSource' = '0', 'force' = '0', 'initTimeout' = '600', 'makeDir' = '0', 'parallelChunks' = '4', 'posc' = '0', 'source' = 'root://faxbox.usatlas.org//faxbox2/user/kratsg/main.rb', 'target' = 'file://main.rb', 'thirdParty' = 'none', 'tpcTimeout' = '1800', 'zipArchive' = '0'

[2018-01-22 09:43:19.275768 +0100][Debug ][Utility ] CopyProcess: 2 jobs to prepare

[2018-01-22 09:43:19.275780 +0100][Dump ][Utility ] URL: root://faxbox.usatlas.org//faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.275780 +0100][Dump ][Utility ] Protocol: root

[2018-01-22 09:43:19.275780 +0100][Dump ][Utility ] User Name:

[2018-01-22 09:43:19.275780 +0100][Dump ][Utility ] Password:

[2018-01-22 09:43:19.275780 +0100][Dump ][Utility ] Host Name: faxbox.usatlas.org

[2018-01-22 09:43:19.275780 +0100][Dump ][Utility ] Port: 1094

[2018-01-22 09:43:19.275780 +0100][Dump ][Utility ] Path: /faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.275898 +0100][Dump ][Utility ] URL: file://main.rb

[2018-01-22 09:43:19.275898 +0100][Dump ][Utility ] Protocol: file

[2018-01-22 09:43:19.275898 +0100][Dump ][Utility ] User Name:

[2018-01-22 09:43:19.275898 +0100][Dump ][Utility ] Password:

[2018-01-22 09:43:19.275898 +0100][Dump ][Utility ] Host Name:

[2018-01-22 09:43:19.275898 +0100][Dump ][Utility ] Port: 1094

[2018-01-22 09:43:19.275898 +0100][Dump ][Utility ] Path: main.rb

[2018-01-22 09:43:19.275939 +0100][Dump ][Utility ] URL: root://faxbox.usatlas.org//faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.275939 +0100][Dump ][Utility ] Protocol: root

[2018-01-22 09:43:19.275939 +0100][Dump ][Utility ] User Name:

[2018-01-22 09:43:19.275939 +0100][Dump ][Utility ] Password:

[2018-01-22 09:43:19.275939 +0100][Dump ][Utility ] Host Name: faxbox.usatlas.org

[2018-01-22 09:43:19.275939 +0100][Dump ][Utility ] Port: 1094

[2018-01-22 09:43:19.275939 +0100][Dump ][Utility ] Path: /faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.275955 +0100][Dump ][Utility ] URL: file://main.rb

[2018-01-22 09:43:19.275955 +0100][Dump ][Utility ] Protocol: file

[2018-01-22 09:43:19.275955 +0100][Dump ][Utility ] User Name:

[2018-01-22 09:43:19.275955 +0100][Dump ][Utility ] Password:

[2018-01-22 09:43:19.275955 +0100][Dump ][Utility ] Host Name:

[2018-01-22 09:43:19.275955 +0100][Dump ][Utility ] Port: 1094

[2018-01-22 09:43:19.275955 +0100][Dump ][Utility ] Path: main.rb

[2018-01-22 09:43:19.276068 +0100][Debug ][Utility ] Creating a classic copy job, from root://faxbox.usatlas.org:1094//faxbox2/user/kratsg/main.rb to file://main.rb

[2018-01-22 09:43:19.276104 +0100][Debug ][Utility ] Monitor library name not set. No monitoring

[2018-01-22 09:43:19.276145 +0100][Debug ][Utility ] Opening root://faxbox.usatlas.org:1094//faxbox2/user/kratsg/main.rb for reading

[2018-01-22 09:43:19.276172 +0100][Dump ][Utility ] URL: root://faxbox.usatlas.org:1094//faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.276172 +0100][Dump ][Utility ] Protocol: root

[2018-01-22 09:43:19.276172 +0100][Dump ][Utility ] User Name:

[2018-01-22 09:43:19.276172 +0100][Dump ][Utility ] Password:

[2018-01-22 09:43:19.276172 +0100][Dump ][Utility ] Host Name: faxbox.usatlas.org

[2018-01-22 09:43:19.276172 +0100][Dump ][Utility ] Port: 1094

[2018-01-22 09:43:19.276172 +0100][Dump ][Utility ] Path: /faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.276191 +0100][Dump ][Utility ] URL: root://faxbox.usatlas.org:1094//faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.276191 +0100][Dump ][Utility ] Protocol: root

[2018-01-22 09:43:19.276191 +0100][Dump ][Utility ] User Name:

[2018-01-22 09:43:19.276191 +0100][Dump ][Utility ] Password:

[2018-01-22 09:43:19.276191 +0100][Dump ][Utility ] Host Name: faxbox.usatlas.org

[2018-01-22 09:43:19.276191 +0100][Dump ][Utility ] Port: 1094

[2018-01-22 09:43:19.276191 +0100][Dump ][Utility ] Path: /faxbox2/user/kratsg/main.rb

[2018-01-22 09:43:19.276202 +0100][Debug ][File ] [0x80510b50@root://faxbox.usatlas.org:1094//faxbox2/user/kratsg/main.rb] Sending an open command

[2018-01-22 09:43:19.276232 +0100][Debug ][Poller ] Available pollers: built-in

[2018-01-22 09:43:19.276237 +0100][Debug ][Poller ] Attempting to create a poller according to preference: built-in

[2018-01-22 09:43:19.276242 +0100][Debug ][Poller ] Creating poller: built-in

[2018-01-22 09:43:19.276247 +0100][Debug ][Poller ] Creating and starting the built-in poller...

[2018-01-22 09:43:19.276396 +0100][Debug ][Poller ] Using 1 poller threads

[2018-01-22 09:43:19.276445 +0100][Debug ][TaskMgr ] Starting the task manager...

[2018-01-22 09:43:19.276488 +0100][Debug ][TaskMgr ] Task manager started

[2018-01-22 09:43:19.276498 +0100][Debug ][JobMgr ] Starting the job manager...

[2018-01-22 09:43:19.276537 +0100][Debug ][JobMgr ] Job manager started, 3 workers

[2018-01-22 09:43:19.276552 +0100][Debug ][TaskMgr ] Registering task: "FileTimer task" to be run at: [2018-01-22 09:43:19 +0100]

[2018-01-22 09:43:19.276557 +0100][Dump ][XRootD ] [faxbox.usatlas.org:1094] Sending message kXR_open (file: /faxbox2/user/kratsg/main.rb, mode: 00, flags: kXR_open_read kXR_async kXR_retstat )

[2018-01-22 09:43:19.276579 +0100][Dump ][Utility ] URL: faxbox.usatlas.org:1094

[2018-01-22 09:43:19.276579 +0100][Dump ][Utility ] Protocol: root

[2018-01-22 09:43:19.276579 +0100][Dump ][Utility ] User Name:

[2018-01-22 09:43:19.276579 +0100][Dump ][Utility ] Password:

[2018-01-22 09:43:19.276579 +0100][Dump ][Utility ] Host Name: faxbox.usatlas.org

[2018-01-22 09:43:19.276579 +0100][Dump ][Utility ] Port: 1094

[2018-01-22 09:43:19.276579 +0100][Dump ][Utility ] Path:

[2018-01-22 09:43:19.276597 +0100][Debug ][PostMaster ] Creating new channel to: faxbox.usatlas.org:1094 1 stream(s)

[2018-01-22 09:43:19.276610 +0100][Debug ][PostMaster ] [faxbox.usatlas.org:1094 #0] Stream parameters: Network Stack: IPAuto, Connection Window: 120, ConnectionRetry: 5, Stream Error Widnow: 1800

[2018-01-22 09:43:19.277454 +0100][Debug ][TaskMgr ] Registering task: "TickGeneratorTask for: faxbox.usatlas.org:1094" to be run at: [2018-01-22 09:43:34 +0100]

[2018-01-22 09:43:19.277487 +0100][Dump ][PostMaster ] [faxbox.usatlas.org:1094 #0] Sending message kXR_open (file: /faxbox2/user/kratsg/main.rb, mode: 00, flags: kXR_open_read kXR_async kXR_retstat ) (0x80510fa0) through substream 0 expecting answer at 0

[2018-01-22 09:43:19.278237 +0100][Debug ][PostMaster ] [faxbox.usatlas.org:1094] Found 1 address(es): [::ffff:192.170.227.120]:1094

[2018-01-22 09:43:19.278283 +0100][Debug ][AsyncSock ] [faxbox.usatlas.org:1094 #0.0] Attempting connection to [::ffff:192.170.227.120]:1094

[2018-01-22 09:43:19.278356 +0100][Debug ][Poller ] Adding socket 0x80602d60 to the poller

[2018-01-22 09:43:19.399609 +0100][Debug ][AsyncSock ] [faxbox.usatlas.org:1094 #0.0] Async connection call returned

[2018-01-22 09:43:19.399728 +0100][Debug ][XRootDTransport ] [faxbox.usatlas.org:1094 #0.0] Sending out the initial hand shake + kXR_protocol

[2018-01-22 09:43:19.399822 +0100][Dump ][AsyncSock ] [faxbox.usatlas.org:1094 #0.0] Wrote a message: (0x806038a0), 44 bytes

[2018-01-22 09:43:20.279322 +0100][Dump ][TaskMgr ] Running task: "FileTimer task"

[2018-01-22 09:43:20.279382 +0100][Dump ][TaskMgr ] Will rerun task "FileTimer task" at [2018-01-22 09:43:35 +0100]

[2018-01-22 09:43:34.326021 +0100][Dump ][TaskMgr ] Running task: "TickGeneratorTask for: faxbox.usatlas.org:1094"

[2018-01-22 09:43:34.326086 +0100][Dump ][TaskMgr ] Will rerun task "TickGeneratorTask for: faxbox.usatlas.org:1094" at [2018-01-22 09:43:49 +0100]

[2018-01-22 09:43:35.330880 +0100][Dump ][TaskMgr ] Running task: "FileTimer task"

[2018-01-22 09:43:35.330943 +0100][Dump ][TaskMgr ] Will rerun task "FileTimer task" at [2018-01-22 09:43:50 +0100]

On Mon, Jan 22, 2018 at 3:35 AM Rohin T Narayan <rohin.tn AT gmail.com> wrote:

Hi All

I can't access fax box through xrootd. Is there a network issue ?

Cheers

Rohin

_______________________________________________
Atlas-connect-l mailing list
Atlas-connect-l AT lists.bnl.gov
https://lists.bnl.gov/mailman/listinfo/atlas-connect-l

_______________________________________________
Atlas-connect-l mailing list
Atlas-connect-l AT lists.bnl.gov
https://lists.bnl.gov/mailman/listinfo/atlas-connect-l

[Atlas-connect-l] Faxbox unreachable., Rohin T Narayan, 01/21/2018
- Re: [Atlas-connect-l] Faxbox unreachable., Giordon Stark, 01/22/2018
  - Re: [Atlas-connect-l] Faxbox unreachable., Lincoln Bryant, 01/22/2018