ALICE ML Repos - All events http://alimonitor.cern.ch/ml2.jpg http://alimonitor.cern.ch/mona.jpg 2020-01-24T00:44:03.000Z Costin Grigoras Costin.Grigoras@cern.ch http://alimonitor.cern.ch/ All events recorded by MonALISA 235844 Site services : [ITEP] - MonALISA is down 2020-01-24T00:29:58.000Z 2020-01-24T00:29:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[ITEP]</b><br>MonALISA is down<br><br>Duration: Jan 24, 2020 01:29 - <b><font color=red>continues</font></b> (1h 6m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[ITEP]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 24, 2020 01:29 - <b><font color=red>continues</font></b> (1h 6m until now) 235843 Site services : [JINR] - Monitor is down 2020-01-23T23:48:53.000Z 2020-01-24T00:19:10.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[JINR]</b><br>Monitor is down<br><br>Duration: Jan 24, 2020 00:48 - Jan 24, 2020 01:19 (30 min) <b><i><font size=+1>Site services</font></i></b><br><b>[JINR]</b><br>lcgvob02.jinr.ruPinging service ClusterMonitor... The service is running at lcgvob02.jinr.ru:8084, uri ClusterMonitor Attempt 1 (Fri Jan 24 02:45:07 2020) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 2 (Fri Jan 24 02:45:12 2020) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 3 (Fri Jan 24 02:45:17 2020) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to lcgvob02.jinr.ru:8084 (connect: Connection refused) at (eval 103) line 1 ). Exit code 1<br><br><b>Duration</b>: Jan 24, 2020 00:48 - Jan 24, 2020 01:19 (30 min) 235842 Site services : [SPbSU] - MonALISA is down 2020-01-23T22:47:37.000Z 2020-01-23T22:47:37.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[SPbSU]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 23:47 - <b><font color=red>continues</font></b> (2h 48m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[SPbSU]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 23:47 - <b><font color=red>continues</font></b> (2h 48m until now) 235841 Site services : [GRIF_IRFU] - MonALISA is down 2020-01-23T22:15:51.000Z 2020-01-23T22:42:21.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 23:15 - Jan 23, 2020 23:42 (26 min) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 23:15 - Jan 23, 2020 23:42 (26 min) 235840 Site services : [ITEP] - MonALISA is down 2020-01-23T19:49:27.000Z 2020-01-23T22:04:15.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[ITEP]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 20:49 - Jan 23, 2020 23:04 (2h 14m) <b><i><font size=+1>Site services</font></i></b><br><b>[ITEP]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 20:49 - Jan 23, 2020 23:04 (2h 14m) 235839 Site services : [GRIF_IRFU] - MonALISA is down 2020-01-23T18:46:35.000Z 2020-01-23T19:37:48.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 19:46 - Jan 23, 2020 20:37 (51 min) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 19:46 - Jan 23, 2020 20:37 (51 min) 235838 Storages : [ALICE::ITEP::SE] - ADD test fails 2020-01-23T18:35:04.000Z 2020-01-23T19:36:00.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ITEP::SE]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 19:35 - Jan 23, 2020 20:36 (1h) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ITEP::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>19:31:40</b></font> CET 2020</b></font><br> Duration: 14s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] Unable to write file; eligible servers shunned.</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> fYoXxjV-GEYLvg1Ek7nlo+gnCGBTXziMMSgjp+hRnmBwLpg2WrEmntucFhfw3CiDz4ff4XOlsACd<br> NiSOaKsgeMj9-oWXRC8zSI2mGzXJ30Re8xO3dX21Ey3A5wQ-UckXKmldjUJ98GUAZvpzbxww6MZe<br> 5ZOGIcpLYQ2Idh0Jxw0=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgGggNlQ99t2Po4nx2xUk-n7caD8+sjzrbJa842OdtnxG6NZmQ2Cb3bCBfeCJfuGpa3EfkaZr<br> 59QPoWTxt+-l-CO7hgutxpfbX4dKzprbDptdEsw1epyAKFjj42n5Di1DDP8PPNHvdGgDf42J5Do0<br> 7Hr0VLbyU8GVkIBBUxhSBMsg2CbQoeVcx5Kcpblxw0lh6-N4l-2A6B3PT-tTgL7l7JpCH5QtbF9v<br> uZK2ZkChjuXy4RA0GZi3sMDCF4vanz00EKET4ThYLQB1vZA4xT3zm9Tp7KgUywr5Ox8BGkcm3pqS<br> 0oRSXnIS+p7HMfIqjSv3X9cVmJG26JvX6+Hx0QtJBY56fk9NdOwY1Yq+H1xvFCg684ZFKS5XhWUn<br> NSehKS8MrWEFl7EN5YHCqL4KKGHYWoyPRfY3hSR2U6wFRdpzzKoLAVein2NgVbWCETU1w97L47k-<br> gwyQTKwGCIDGGlzMTJIKZgcAhysFn5pUc+9fMIxe5lfl+yiTf01xGH9vrS3un9RJ5e6IkavNDJQg<br> JMpJwva-ju-YcW52pRbv6-j0BccKY4qwPb4hlh+7u6GeBjEWKsRDJjH63acJzXosy0aMClWFqAPN<br> UnHdvCoZ8wV9fWpQ3IE6xMer5DGbw1CPIKn0U-BJn-3jtW91iN3iyk-21OoIBAYGmmvOtbfzSyMF<br> 7Z61s4YG3BZe7u4ln4se-zL0ncnhF7gCjWUnaZQCgobeefMfPanFIDnYdxMar16jsreTmSQHVcmM<br> lBZwhw13Ci4+jgeqkIrM0RKj8bIll+1XoNbsRpSGWiGBmd9F5PyTa9Cb9juPdBcyTBeCXlQDEmPa<br> QM0r8FZrlPaiRDkiTCtr3gom6TyffP61WKPs10zD+XxgziNeFENb1undcWR3as8oRin3S67EPheH<br> 8Z0DNxSGOE9HK4TRvXdgxjbIbvcaMD6efQD3I0SxhRTDKDFMIp+Mw-tO83JJCvXBlr941YF0-RC+<br> dq9tp3taz2XHTZXuwV0I0P095jHtEtRQIVKL0dWRnlrEafqu2IxJ<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://senf04.itep.ru:1094//09/16924/90a26ed0-3e0e-11ea-be4c-0242790999e0'>root://<span title='194.85.69.126:xrootd'><b>senf04.itep.ru:1094</b></span>//09/16924/90a26ed0-3e0e-11ea-be4c-0242790999e0</a><br><br><br><b>Duration</b>: Jan 23, 2020 19:35 - Jan 23, 2020 20:36 (1h) 235837 Storages : [ALICE::SNIC::DCACHE] - ADD test fails 2020-01-23T17:43:55.000Z 2020-01-24T00:44:03.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SNIC::DCACHE]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 18:43 - Jan 24, 2020 01:44 (7h) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SNIC::DCACHE]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>18:42:11</b></font> CET 2020</b></font><br> Duration: 5s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 51: [FATAL] Connection error</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> RFoGyTidmRTnAE3WhiLY02Ogql9y+19Kloq8eLfYXdlN-wPmxwYHhHlhTMVwYAqyCvVKyc9Qwn9P<br> ostyo+9VbScXZkJcFTPWFlx9s6i++hUofaY+Gto8ATzJKZLpma2Fmv7NaFyb29RGUpAu5EOzDJcP<br> k01P0HeDDf-aRKYpDkI=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgCPvE0V4U3o8fIMu70bY3RNozefeowJ1tMpO0Jut4KDWnDqb6e9ZIWWSfzrCvxaVQwVKm+lb<br> ApstSRDJrZQt2-EG5y9iJIJGuQfQPltqIyvtA-4qZZLaqcVGCQ3iCL9wSDHNPtNPLMGuKpQT7uc5<br> rhdg-AxPbeIGTEas6XWG++jCzh3eAwWcqzUkHvCI3qJX6DPPgEylE9PPmO1vwOtDIFFjcEKhAIX+<br> 7GLio+xSANe+Dl1-SzcDkD4rkl5JY3EUWTPWt0Gs3pFrAGJDpK8AbEucuMTxrdN1VVW662iTt6FD<br> knSBivFMCOqJjBGU9PeO7rz+v2hcE8aHYnaqmQlCvJoMdHSHIqKLxjkjhvYRtvaYdAIHeKWITDXJ<br> YeR7RJ1hCTZj0Jj3YC6mx3aNh0xbqxDUTm+rFc4qSf-4HYcJP8YvtSurU2aRC62RnES3PAtvu3qn<br> xxcXOdxtBJ4K-bTsbkLnPsa7N55j7DH7rPAodcc3bPTfmT67J2n7bUWkWeTQBgqXlku+cmtiDseW<br> X2BEHjJw6TtExatjuEZUbfIyqwh9Mo-RMQ6KV1zUoG5ZAnvLck0XFRO1qoZK1gVPOu86cG37Z9D3<br> 6HsxmDUIsVjt-rLKT0gTTYJhOSkHcnIa+qVTLqzzrGPJaRMX01jSc6ehLRswtyN61GjcZgMdYojC<br> oBpBEdz5okV6iXvy-eeN3lbgiDnk2lLvk49kBRtSfnrAd+bRrJSEpmQnkxPE7bjAdjg1TrouAnDE<br> 643PwRSf2k15nNFnpRzlA9GML5bGDBhGhRYwU1LWTvzLzKeYghSzpsalDU2VGjTWiEZZLUrngps1<br> iEsDk4Hvgf3rtXYhGQtxfWLZ+A1j-rNcfCi0BMWoijdAWkhlAZBF7MnXvZFWNO5I-EdfhfjCEZXg<br> NyzGWe1WflrNfma4DxyfGmS63P2ZgED2NmNqTr-30vcJu5D1nc4wRdi9L2+nBwtX9QxIvFtNLflJ<br> akhn1+Hp8mWxJd1m11ibkLzji7WX3Ac7+4JQESBne3SE9k2qgpL-T-6JTXSBrFjx31OYg1Mcusmz<br> LepTf0guCWNTSIaBCiQ=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://xrootd.swegrid.se:1094//NOLFN'>root://<span title='130.236.100.106:xrootd'><b>xrootd.swegrid.se:1094</b></span>//NOLFN</a><br><br><br><b>Duration</b>: Jan 23, 2020 18:43 - Jan 24, 2020 01:44 (7h) 235836 Storages : [ALICE::Hiroshima::EOS] - ADD test fails 2020-01-23T16:06:03.000Z 2020-01-23T16:52:26.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Hiroshima::EOS]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 17:06 - Jan 23, 2020 17:52 (46 min) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Hiroshima::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>16:49:07</b></font> CET 2020</b></font><br> Duration: 1m 1s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> oHsvh7Ey7ydLcwa7-NKUhN5lhyilFy5sXXM+UvoS-C7JIapey4l+L+zvQbOAT6KZycgCLcpt4qqS<br> 9WoQQHzOoDRNiYkqp68Vm-GAMgadgCa6HWCzIZIgpTsvaFBQ4SQ7Sehb9Y75J4Tl1b+qqnzF6-TJ<br> quZqJAt18Fmqw2Utn+4=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgCh9iSLOW3J2+1LaSc+cHV+XYoZZqYL1mpSEObdehnhvbb3H0oCPGj6QR7mnW5SoNGESAdf1<br> Lx1G0dQtdbTXL2ZOuZdQK3-GgUyHh8qneCK3Mbwt4R+3vhQ6dSHaKdP1gR2mSdT7KQWcVFgy8zVE<br> mDZeBXCg2J5-YHq0-1MdYWCUQVlCyNIhy3goo-6Mpvc8EJZL31Z8iuA2Dp+D73aI+ZPjDR4kxDdo<br> AeOJ20fJqoS5kREVg0IEBpiykJYkZcJLF2-EGHFXj3QMeRcA+8p-eXrZxn-BznX3TfUTrYuYrpMr<br> fjxgeriqXelZQP1Xp7+UIkCSj3tpPyZcS13z8JU3zSpGdzMNoEjAxHybXqmfSI8LuNp+oS9qyWVi<br> huL7uNUFIg8JY2H911OD5BGlOWs8yiMIln3Gl-82HXr5uUnV4mUV9c3LfhDSujvdyWMOtENHSLVn<br> akUUNRX+Q+CXTSiNEYEYQ-xmTrXyVniIxjvL4TRSn1+8j4Ym5qoFsHmEPbfVnqMgDtXIPp93pYxf<br> 5+cdeikQf2R9avF3O7uqY1JPHLfxBdt5faA6h+S5lr-GE1aNZdwjcYDvz6tYcVO2J1KzakN8qqRP<br> 1jMr5QXpzWi5weOmdhmWYspQLuYz3N5OYq3-4wshbmaw0CWpnNqFd7DVV+45iKCC7kvV5BL+tAr1<br> h4ShRGKiTc5HbBOi7y5hiBUN5ZiOpaAwOnXVNWHe2rrju7GYqrPxwHEFseproqzVHbahoS0jTise<br> UB88dnicx2lBF74Q3Z7aKXxkIQaTYUvIzRHFE2-0y-ic6MI+nznPQHr3DIA8cjFdkUDKs3YXGvQL<br> Do5cVxPMbyI023z1NlmGKCgiJ3QONMEWFCz2TiAVvrYC8nN4h2j9o0eYjFEDRza1cM-Y+ew3jq78<br> jPHgTS-H5sYtXiqdlPUWerV20Xb+iZkDsRG9dUm9+qv8JMIaZN48LM5JMcHg4-UnVIkU5JxjeYMq<br> RJhYpopo0xQoN60rmG4nirOxOPlEknh6CwyRrcDJFQJ2GyNgwtaQY1fHROsb9R-f8hyblxyZOAVy<br> ZeBDneMo<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://grid03.hepl.hiroshima-u.ac.jp:1094//08/00216/bf6168f0-3df7-11ea-a01e-0242790999e0'>root://<span title='202.13.220.43:xrootd'><b>grid03.hepl.hiroshima-u.ac.jp:1094</b></span>//08/00216/bf6168f0-3df7-11ea-a01e-0242790999e0</a><br><br><br><b>Duration</b>: Jan 23, 2020 17:06 - Jan 23, 2020 17:52 (46 min) 235835 Storages : [ALICE::SNIC::DCACHE] - ADD test fails 2020-01-23T15:45:29.000Z 2020-01-23T16:47:18.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SNIC::DCACHE]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 16:45 - Jan 23, 2020 17:47 (1h 1m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SNIC::DCACHE]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>16:42:14</b></font> CET 2020</b></font><br> Duration: 8s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 51: [FATAL] Connection error</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> JlVWAccIZdn2ORCTSCEClgCK60DS+w+cNPvrT6KT-KurXUW9ZQfpWeTv4-xwN0X6Yj1WwhC523st<br> Qs94iphAoFOLsL6LxVxSKkhXeskiycXg6E0YzxH8-8DMPYqAchdTy2i3hlBxl7tTe1qCjzvlhlVX<br> MbZWOAgq7sLtfZCBRGw=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgDSf2F0FBV5I6hLf-gtns-3W1bkbct5T61jzPJzPmvwxDoLs3GY43aOEjg16ga1KDKZH7vWC<br> rbRlg03s-GbpfVUVlPOH1mbPmEnsxQuvyUTR+XKLopAHt0RETi4u0Ckrfqea4ETaKJV8Ze-Ksyix<br> UZOUAbtyU9Clb-h4PMHK9x7I3Q7OaZTiL+ZWsDTET5iHZd0uutCcsGkZOZVEGc-A2W5zadHVPNBG<br> iWEjt1iVZSdNS4-zeXld2M-E0lcIru3r5eH3QWE21Yh0FIVcWJ1etEYLtbmGSbeKKwOe0-WYiWOJ<br> 1lDYrNAcncoc7kyeVA40AcW8GmsI0aqrZwQO9gA3+ym6T-a9hBTpdPJpsj6i+lIh-NRTFzaWijCl<br> 8KDUlU8DH3CXh4WtZ6VVzZ2ge9j4JC2JqeFhzVJPr5hs4V+yM3Ji4JOGrnA64fLdOvCFPn0hpwhF<br> ARmhrWBN8qgbbkV3hmL6x1pL5OdABAw9KKz1Xl9ene93Sq6KzKeziSNtfovgWvv-sAkpsBkyY7il<br> sJ-juWgEde-eBPU-y0H7u1mvA7cipM82uYudMdit+Q8gs-ajE8hb1bfgQoqs0jsnr3Tsx3PHw8UK<br> r3o8ImQ5ktFn2yte7dFI5B+pLeBcjg1EMMnGQ5z9jHXMgfeXUGSyt5VjR8gOHpz7zG95UqqMnqA2<br> 473zXjjUGXo66xFbBiEUSWSWNSKydZAYhc6lW7mv39DBcCmsTc3QTdyvjqjVgpb94vvSfn4BCljc<br> cZkx7gGXtB941IGByQGKw-ciwCjbd7AbmP6BH8dLX6PiCrEsiFjmjFT0UL6xtbONdJUjB2yn1M2z<br> cjKKvIQzMC7k3AjlPoGWWJMXpbkvOEMMNj-jeemKN39Idze4NWj-bqn1IpmtHvEq5Ez1U-bzGzoo<br> pCtu2oZYI9nm6Edsob3ptBC3yI1kkq0PZ1XobgXJPuwTGzshPrKD29i22Fk+pfDCxbM84N7B8ZZb<br> Vhv2eLeNfa1lZYYaPQVYVJIlHTxcA0M2d1yt53IkOVAnw86gxtJgsGbPCCVfYSz+hg7ZZVQwB7nH<br> Qyq9F+ZHTU6gDE0qoNI=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://xrootd.swegrid.se:1094//NOLFN'>root://<span title='130.236.100.106:xrootd'><b>xrootd.swegrid.se:1094</b></span>//NOLFN</a><br><br><br><b>Duration</b>: Jan 23, 2020 16:45 - Jan 23, 2020 17:47 (1h 1m) 235834 Storages : [ALICE::Prague::SE] - ADD test fails 2020-01-23T14:38:31.000Z 2020-01-23T15:40:17.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Prague::SE]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 15:38 - Jan 23, 2020 16:40 (1h 1m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Prague::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>15:36:30</b></font> CET 2020</b></font><br> Duration: 1m 44s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> QFqoGTk+FIOFFK1pLfnpXy3oPZ9aG8a+Vsk19+L1YjdS6YEdV8xkqGN7Ct9o04HtYcn46s0Jsdms<br> ZZdlhWK0livarvyCDgVHpCx5FnkUEiLqsZXwaDKegQTbp4uBnxBL4So1wcckOHzoXW8XxfDDSpuT<br> ao-EAxyAykIh5jhQZBQ=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgJO9PdqBxKLT2qI3T4A2o+33OVE1megfnDQhPe6aRx-owQs-e2O2rm0I2mn6Ve7CFM2sFwGx<br> wADtxO-xabepFV4D+hCSvebgooxQ4+Y9u9ImVG8ZAdfUzIqF+1XKWNbBkPGOC0BLe+s8B-ZLMaGC<br> sPsXZjRuHIFMrrw6RV8X+VSr1pZIN2hvSkBLjL325+vIOF2YH3xybspBKi3qTkThYTTgPhvUe9RB<br> OJSsVjA3FhvFhycGuPHybCvdMkjh1O8BHgZw63Tja0yuyi4lcHHbkY2I6rN5g6p8gHK8EbLi94Q3<br> xmMoMdxb43CJxj7RaBimQThMpBBz7V-bEEK+eJq4DPjZASpH+-kXcB8oBHFdyeVcMllGgHpFeZO-<br> Xfalzn-7xrjU52FUrSA0e+psm845PY+ZyCMcHBVevI8Rtq3NeJLfzEnUziMQ65Q5I1llyElTxyG9<br> 9hwGYWNNN9A8FqmNzLgvjKpt61-zshguduoL3AKL9HOkkZn6BUOZKoIEC1pxBRNFDHauqnp8SlLy<br> 8pa8BxoVSuAlwJ+atw8NTNdmESJEJkpxWP0BczAR2vIEH19x6ttoGGfINUR9gbA+XXBt9RUnFAqD<br> pSEatWEdGHrBOvBCRXNoFF4g8544DQwRD0Q-QDzECCZ194Yf1NaQlSm8FoFEQK0dd4Q629AoBtfr<br> 3optiLbYo0jKTZlql+2BNzYEp0BcPGEX9dJWXmhtcUw1I7caPVQkTk17G6rabniiVZHpUY9GSJMG<br> FyuDs9JQP40gHgeVrGmQ2IUQuuq-MwuGE5wMPNZ-IsP8hJDxbdjLi4y+QWErhXRuXERpsG+qu2OV<br> lMVNEoxvuAaZtOIDxBDBqaA0yTI8gZOGEYiFY+MyNSm1MD919XOxhJHzd8R8Tj766fHQGgzuyK6a<br> t4EpD5fJiSrf9+DKwA+g-RgYEVeMz2QYlpz7SBgXK6OW-q1VKSQO3mPiBhUDGHvALjLbAeyZhwuJ<br> QWdwrK4vBQthSYXAUWMqy+kUaJKqVtMOhzfcq8qO5PFtY7gEBVKc1rKUAl1ZugA=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://xrdhead.farm.particle.cz:1094//08/02786/80c5eda0-3ded-11ea-9515-0242790999e0'>root://<span title='147.231.25.162:xrootd'><b>xrdhead.farm.particle.cz:1094</b></span>//08/02786/80c5eda0-3ded-11ea-9515-0242790999e0</a><br><br><br><b>Duration</b>: Jan 23, 2020 15:38 - Jan 23, 2020 16:40 (1h 1m) 235833 Site services : [GRIF_IRFU] - MonALISA is down 2020-01-23T14:35:44.000Z 2020-01-23T16:42:28.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 15:35 - Jan 23, 2020 17:42 (2h 6m) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 15:35 - Jan 23, 2020 17:42 (2h 6m) 235832 Site services : [GRIF_IRFU] - MonALISA is down 2020-01-23T13:54:39.000Z 2020-01-23T14:15:11.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 14:54 - Jan 23, 2020 15:15 (20 min) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 14:54 - Jan 23, 2020 15:15 (20 min) 235831 Site services : [GSI] - MonALISA is down 2020-01-23T13:40:13.000Z 2020-01-23T15:04:34.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GSI]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 14:40 - Jan 23, 2020 16:04 (1h 24m) <b><i><font size=+1>Site services</font></i></b><br><b>[GSI]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 14:40 - Jan 23, 2020 16:04 (1h 24m) 235830 Site services : [NIKHEF] - Monitor is down 2020-01-23T13:37:10.000Z 2020-01-23T13:52:37.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[NIKHEF]</b><br>Monitor is down<br><br>Duration: Jan 23, 2020 14:37 - Jan 23, 2020 14:52 (15 min) <b><i><font size=+1>Site services</font></i></b><br><b>[NIKHEF]</b><br>Jan 23 14:26:53 info Hello ALICE::SARA::dCache Jan 23 14:26:53 info Hello ALICE::SARA::dCache_tape Jan 23 14:26:54 info Reading the configuration file from /vobox/home/sgmalice/.alien/alice.conf Jan 23 14:26:54 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 23 14:26:54 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://erf.nikhef.nl' (a variable that is not in the standard configuration) erf.nikhef.nlPinging service ClusterMonitor... The service is running at erf.nikhef.nl:8084, uri ClusterMonitor Attempt 1 (Thu Jan 23 14:26:54 2020) Attempt 2 (Thu Jan 23 14:26:59 2020) Attempt 3 (Thu Jan 23 14:27:04 2020) ERROR: Could not contact service. (Error 500 Can't connect to erf.nikhef.nl:8084 (connect: Connection refused) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Jan 23, 2020 14:37 - Jan 23, 2020 14:52 (15 min) 235829 Site services : [GRIF_IRFU] - Monitor is down 2020-01-23T13:37:10.000Z 2020-01-23T16:42:28.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>Monitor is down<br><br>Duration: Jan 23, 2020 14:37 - Jan 23, 2020 17:42 (3h 5m) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>Jan 23 14:19:46 info Reading the configuration file from /home/sgmalice/.alien/alice.conf Jan 23 14:19:49 info The local configuration is not allowed to define services Jan 23 14:19:49 info The local configuration is not allowed to define services Jan 23 14:19:49 info The local configuration is not allowed to define services Jan 23 14:19:49 info The local configuration is not allowed to define services Jan 23 14:19:49 info The local configuration is not allowed to define services Jan 23 14:19:49 info The local configuration is not allowed to define services Jan 23 14:19:49 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 23 14:19:49 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://node14.datagrid.cea.fr' (a variable that is not in the standard configuration) node14.datagrid.cea.frPinging service ClusterMonitor... The service is running at node14.datagrid.cea.fr:8084, uri ClusterMonitor Attempt 1 (Thu Jan 23 14:19:50 2020) Attempt 2 (Thu Jan 23 14:20:08 2020) Attempt 3 (Thu Jan 23 14:20:28 2020) ERROR: Could not contact service. (Error 500 read timeout at (eval 111) line 1 ). Exit code 1<br><br><b>Duration</b>: Jan 23, 2020 14:37 - Jan 23, 2020 17:42 (3h 5m) 235828 Site services : [GSI] - CE is down 2020-01-23T13:06:20.000Z 2020-01-23T15:09:44.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GSI]</b><br>CE is down<br><br>Duration: Jan 23, 2020 14:06 - Jan 23, 2020 16:09 (2h 3m) <b><i><font size=+1>Site services</font></i></b><br><b>[GSI]</b><br>Jan 23 13:53:25 info Hello ALICE::GSI::SE2 lxcealice03.gsi.deDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 23, 2020 14:06 - Jan 23, 2020 16:09 (2h 3m) 235827 Proxies : [GSI] - Alien proxy has expired 2020-01-23T12:55:31.000Z 2020-01-23T15:34:54.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[GSI]</b><br>Alien proxy has expired<br><br>Duration: Jan 23, 2020 13:55 - Jan 23, 2020 16:34 (2h 39m) <b><i><font size=+1>Proxies</font></i></b><br><b>[GSI]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /tmp/x509up_u1000 is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Jan 23, 2020 13:55 - Jan 23, 2020 16:34 (2h 39m) 235826 Site services : [GRIF_IRFU] - MonALISA is down 2020-01-23T12:46:48.000Z 2020-01-23T13:05:14.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 13:46 - Jan 23, 2020 14:05 (18 min) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 13:46 - Jan 23, 2020 14:05 (18 min) 235825 Storages : [ALICE::Prague::SE] - ADD test fails 2020-01-23T12:40:22.000Z 2020-01-23T13:42:00.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Prague::SE]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 13:40 - Jan 23, 2020 14:42 (1h 1m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Prague::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>13:37:07</b></font> CET 2020</b></font><br> Duration: 2m 21s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> lQLFqqjbt+NfEkEYb+7bOx5FCapobfLTc8hT2tqKwGmeFLu7dJgm9XDEAhfgcPvmwAmzA8hVJYUt<br> YHsm4Nz1fleGfgLm1Uku0AreCTE+jFaS7HIEI7L3jnMd6+o+32hlfpwXbOQ88I16LsVxJfzlxTwD<br> JmlPuchf5gRxhsl4NnE=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgBQPOg78k1Qz2xC8xJeOUK6i3CSA571OMQGUOvv2zuBPVeSaEH-oE1LqoqfOwZFnCMMPrS92<br> t-JTgdnNl-jn482JmEniq6Lv+L9mx98y2uvIa1w3bM+JAlzKKR2tJP6Ad+caJWm7nSlH-cF72yoO<br> U8giZdUgtIzBFl190H4eoKlBJYR8uOVnff-A81e1V8VCh6Wk6OojX7kfd1T+uNxooMExqJ7FTXr8<br> SsXidbewdvKhsq3SWiUTPDRtr87pN-ZrWRR5U+zW1vvLjLc4E9lISoVTTdeh0J7QnjlXXll6VjT0<br> NcWs3+Ijale0kwOOwaXvVWxqcK1AQ0xD4fxlwJZlcTwpEkQ2OdRlXQAWPJn1cCVyW2hKFPVuybiZ<br> Gh81Ejm0zRGyBLoPw3pN-KFSrGITcIO5nDt6rUjNqUEkcx-Hi6LA4CJ5rAIDbUuC0Ut8hikJCyyF<br> dSNvOSrb0ZR49MFruNi9UfYT9robkpdXfUI6qW85v3tjDk7Q13H4cVeA64FYULGESzMiUcKhes1v<br> ohLC1lGMR4yqLk10+c5nAw+PEIXbtg+txYE-216JcQnRBp9PpqlaFVpBPiauMu-BDIklWzmVBIQ1<br> UtnTewBF0JU0vFB8grCKiWpIcV9U59zH2zkWMnpLQgoBDXoWaXWVn1RKnrF8GaehumltrR1786rv<br> lJyX0d-iiyTDutBYiAhfv+6VZ7zmyiam36cPkFmP1FLyMwK3BZD9XChKduyjE2ehHUIXvoz5YYJo<br> CaT4-sKIrZbtr7SY2ZYlCRycrU0oHbptjPCYsv8LKO55tHdAMo7pJx3wvS6JkFNPhcC4g8AJU3-E<br> 3ylaLjslnRwP71BQ0zk0qthdjUhvhd2PX9igjfpOsJRyZLP+ebnQcerDCVMnquK5fNIM2PZcxbjP<br> tu9H0--Yfv8vh8WuYWpLjehwNnwLBeTCjIusHjqZUjQHdu1LYQvMYoWk7EOEWfUA2Nwwxiz+0q2d<br> vsS7f0rVzXoJXr4-W23teV7duOrhQAhLBJvWstsA+A0OOL5bf0yX4v-Dk37o+Is=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://xrdhead.farm.particle.cz:1094//09/39540/bd3cf690-3ddc-11ea-8260-0242790999e0'>root://<span title='147.231.25.162:xrootd'><b>xrdhead.farm.particle.cz:1094</b></span>//09/39540/bd3cf690-3ddc-11ea-8260-0242790999e0</a><br><br><br><b>Duration</b>: Jan 23, 2020 13:40 - Jan 23, 2020 14:42 (1h 1m) 235824 Storages : [ALICE::ITEP::SE] - ADD test fails 2020-01-23T12:35:14.000Z 2020-01-23T13:36:50.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ITEP::SE]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 13:35 - Jan 23, 2020 14:36 (1h 1m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ITEP::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>13:32:29</b></font> CET 2020</b></font><br> Duration: 1m 3s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] Unable to write file; eligible servers shunned.</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> iSf1EwXuFQdXDLoz38uz0E5ur4Ba-XHxolMsX3xKuCjRUzAMfl2TORghEW7KKR+IZftBHQnCkY26<br> -7BHvFhwWVHBJ4k9xcGy7UXdf-7k6Av62+5ihBb1x-eHb0ScifeauX4cGVQfhjFqNMns-d0gaCNa<br> 5-2T6-zqaXooMkw4YJ4=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgKYtQywJSHs5nMq8xUVRED3xOQCj27ENVAEhNlTW9Wb8ySGlcRHi6Owj3j-xNHujk6zGd5Pw<br> cEPvPDMy2skTUrzSl0INt0Vq40+oTHuO1LMP7+7sHT7SNCkKRJQZNWisqZkvE0tbWUvHYhchqJRD<br> O5TMHXb7soizYco6cNpApUBWfs-t3viROMrRHIt3Y0dv6vG6jb01yO6vgGDvP0+tc2RGe6pGlFXV<br> U9+8OtqKOLC++fhYIR7cqMR9FGfKq-02NTXktHJnlrACTZVeUzRCs-ohEDCzv3jUzhO5AzicUBWe<br> z7sETKLb15kJKa757l7K6ytOdb4Nguo7PcmvMzuC-zJx53jT-QZT7hNrmqYp+1qi4zy3eYECVjJY<br> Dd99NF3DqzaRyoK1yCd+HNReGxv4-2xbHL-3D6xT-Ca2QXwGJrx7SE1FMfPPO6ojIOTqh95Ogvoe<br> AGnm18T2eDAkEU1TKwbuGZLcRhqhCmPe39401kYeTrvPKxl3hCbPzW3WkAGGmD3UJn3G1FGa61AV<br> ryHlqH9psXrU8d+mDA1ZCb7xZZlE+6ao+2QL-cvG88kilsZRTPvt29HFZjEN5uavHQ35Wg5yFnqh<br> utCWBWgdstgFENyBCA00jfIn+DfAfplA0A76IZhSLcqxjffNpgR1SKf0VWySP+KUZ7f4fFeYs7Fn<br> JvVpBIyfGCPGf3fC9b1hFbY2uW5T4CIyovL3Q6KngyqJKmm8coXUuAUCSNfVF7xYehQ-l9SWAEuG<br> 4M-zfHaz5Czfnzdcz1dWa4px1plo46SwfSOzI5AiJH6tggL2I+2wbLjCJVonpsvjVbMur5VEcnIX<br> 0mOWi8UjlVnCYn+uBgAyWHb+NwF1YisbXnftlLVumYjrNziqQ0VEkrDa7p4hW4CIzGyfgzbji5b5<br> 87ayTKCrd0JPvuHs4Bs1QLASVpBP9o+ENPVrFILn0ocxdPMkJ9l27HExGVEfhLQFb7aAFySgwH5t<br> l5p0AyZprAWVFyGirEWAwSJG208h5D9xBr+5F9kq-p2Cvt2N5DkC<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://senf04.itep.ru:1094//14/45440/460c6ba0-3ddc-11ea-81d3-0242790999e0'>root://<span title='194.85.69.126:xrootd'><b>senf04.itep.ru:1094</b></span>//14/45440/460c6ba0-3ddc-11ea-81d3-0242790999e0</a><br><br><br><b>Duration</b>: Jan 23, 2020 13:35 - Jan 23, 2020 14:36 (1h 1m) 235823 Site services : [GRIF_IRFU] - MonALISA is down 2020-01-23T12:14:03.000Z 2020-01-23T12:24:18.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 13:14 - Jan 23, 2020 13:24 (10 min) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 13:14 - Jan 23, 2020 13:24 (10 min) 235822 Site services : [ITEP] - MonALISA is down 2020-01-23T11:57:43.000Z 2020-01-23T15:47:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[ITEP]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 12:57 - Jan 23, 2020 16:47 (3h 50m) <b><i><font size=+1>Site services</font></i></b><br><b>[ITEP]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 12:57 - Jan 23, 2020 16:47 (3h 50m) 235821 Storages : [ALICE::SaoPaulo::SE] - ADD test fails 2020-01-23T11:44:05.000Z 2020-01-23T12:45:29.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SaoPaulo::SE]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 12:44 - Jan 23, 2020 13:45 (1h 1m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SaoPaulo::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>12:42:32</b></font> CET 2020</b></font><br> Duration: 1m 6s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> gxmOYYAgOwCGzYnAx2H9yUbUk43xPQ7GR0b+15U+iJ0Z1nf9cSBtTzllpW2WfM3WufKXJkpfI+Gr<br> TWaYv47+4LTw-Xz75D1ruu1iWdO1WW7lxwOkMd9gOoj9XWBz1K49q6Gno1inDHrRnUzJ1pzMNanL<br> sW3E6KaQ6Tmkp99PM8U=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgFRveTBzMVKsRakAQYJrPYDIcwsPWXNxZjfCOVsaTopC9UTjUW9uhW59-4HLGmXNiSuyIdOX<br> zLj97vGx6Wm7PEB5WN7nin1JSo-j9fBJCtxAufUvO3T8jKhVVflZP1stnXeRH7kdr0MXQSZBIgMl<br> eFmIA0QmEOH2s3bb6n0eBK081YA9kvzTcjtqUSDsKZgphdV7UoWMgrtynFMQfzz4oSiCbDa7ZLKy<br> 3Tz6N48LUQ+5czqnPjwq7FhI2elwEDLdl+2QqOL3OI6vgfVUhmS74B0OsHYxyr6opXTgJBB18r6P<br> vwfKsZ+WBqzpX2Fw-sAvj99LqEAufDZEvkzqiiLgSPTVJs9xcbmopStWCszDOjgzIUc0xrJbUsRM<br> -xI2ZatF4uO2kcF8WmjEfY3k22IjpiZ7aHpFboL8z6cGDCeCiQsrdIF8q3DrClTPhTA+XAuMxUPZ<br> wKWD4TcFbOh66QG6tzHgd-G5jar7Z7zrT0mtPJipEh0cDBjMAh4pEGZjGI9JU+SaHBX9Nmelx+vm<br> naddhsIHv9Lcd9PTzsGoNj2LK11LBV3XnWkO7n03t1FAxNk8xF1ih5HJhFNYXixmzNhlHHEQUbwL<br> JlbRxBeQBWzMYlzN3JgiWdwKQdJqNZugpZnUW5f7GQmqXp7pMffmC4g0Xu0sBrOR6XDlHsAEC6Jk<br> srX5mXpGM-OLYEZJlrDHVayXGkQFP29uFjFU4Oc7pQV5u6gKbn35XlaclUROJ2h01j8Co+svZDWG<br> yZIO4+-BT1sHUDsVaEcpupjlj6uKm2gRrETzEp821srMLt0dayN5g3rQXecUJjHGqMcQYYvs5T7k<br> mM+4CN0RWspLF9NDhFBRVRkCr-xQ2IXuqybEccewnUnrlX-G-ASJGsXVLkcfdunkK3PucIWOZdpT<br> ImXOOeWKtEvw5sXcYkPL+8LA6U-fxIgASIwKyoODB++jd34aDPjxv8nmwEInaI1WX4YmbnNQDHuc<br> uSa+MeQLmalobMGYNHivYKNrq65ersn2uz9OoX3qZzBqXFx5nj+WTke8bHqgsMQ=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://sampafst01.if.usp.br:1094//08/22063/49e4c800-3dd5-11ea-bb3f-0242790999e0'>root://<span title='200.17.30.140:xrootd'><b>sampafst01.if.usp.br:1094</b></span>//08/22063/49e4c800-3dd5-11ea-bb3f-0242790999e0</a><br><br><br><b>Duration</b>: Jan 23, 2020 12:44 - Jan 23, 2020 13:45 (1h 1m) 235820 Storages : [ALICE::RRC-KI::SE] - ADD test fails 2020-01-23T11:38:59.000Z 2020-01-23T14:38:31.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::RRC-KI::SE]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 12:38 - Jan 23, 2020 15:38 (2h 59m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::RRC-KI::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>12:33:10</b></font> CET 2020</b></font><br> Duration: 4s<br> /home/monalisa/xrootd/bin/xrdcp exited with exit code 51: [FATAL] Socket timeout<br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> ZEPffO2YkHzwxFozqTn26yIfvRnUpgHYpwuWJQBQBBbtnxLHVdjJUlsccvhGlLuDFgEABVE4fH6o<br> NvtPg+gv8QlCGTjbL336J8BnSZp1zty2SXOQsUdlBL0gmin6yjoO33UbHs9HLE1zbv+P3JwCxJvI<br> XLZjbLZcig8Dm04HgMo=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgD69lMD7sE+XyFUeP2P3jQ4X4jKTaQ+b7boT8vgoVHoKkb3dJ-nK0T90STjbUsJeuFcmdEzf<br> sfRavR2XjU+VAGL54yv23ncHeTQQ2XHlaHX8zdpwj7cfZBUgUZ6-Ib7sO6QVltpGtDWAdtywekEG<br> O29fv1uBzyGwAbUs9FdCEYdd8yh4R2TdnGXe5joqS+PzaTc0RMimSmJeoWE43O+y0FW0yCk81uTB<br> NihUzHJr0nEG6TGH+l4S7vHFi0X--sNpu7kFEeM4GKDMm-azZZoF222oTAApdsRP1Oh17VU-k+Er<br> vc2ekxH1rmH61YDm6uzGDP6f1o9uqP2Uiw4x-hzDEEuCRpCOPQ0I8EKHsrhzpGz0W1cLUS5Xbrri<br> mycSu6BTLbRAOG67i0UTfuHfS3aI1AVAAZisKWhZqJc5IVaTqBFa5PjqVP6ku5biyLbEB+Cryd8c<br> Gfn+PNViZazlE5wofu8NhfKICRGjXvg2-hxzuTCA4Y0BJI8Dy+lOlJhnbFALEx6XDS2Id213VmKj<br> QahQCF5ZKxAVw4w-2W6-braC1HnCNk3fv+-fk-LHJ-4ByUTKSAi+78ybQLr4DclYBhPKGVix+TxJ<br> 6nZIFtCn2+iG46T9hH4eZ3YLN31kIbMcEhlqbCq4HNzZSrGUE9bkj8H3C3r9sDzInm2JsF0J0-wh<br> TTaCoOndlxKYFfLTtjK2ffFp4dijP93-CjffLJWkXFud54iRvla4hY0Q7o+d1wL1b7P02EdIXWz8<br> tAMQqHxQ1-gfR70Sp53RAAt5+Sb+WsCeieeE1d8+5kC5Tb6TpQU8oAaLWXNhQuq+N4Gtdm-aQzA+<br> TlBPXJ8ubgJzO7qF5fwsmck+oTFEjdyPm7Gc4ILkIdVAP8u0baIjCcWOURWMnRRYPgKv7IN4xt5m<br> H7rLv1tBpT0RDmS7QmsBLyF-t3B25T6nD9D6KMTZMqleCtmw4cQbU9SFVTDRR8CQTG9brNTq2afw<br> QNL0RQxymVJ9BvnP7PJsz9wqu5cgeZVNJDM7qqVZnB3LjgyeFPQGddhPqIO8FMg=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://radical.grid.kiae.ru:1094//09/18225/1fde87e0-3dd4-11ea-ba4c-0242790999e0'>root://<span title='144.206.237.11:xrootd'><b>radical.grid.kiae.ru:1094</b></span>//09/18225/1fde87e0-3dd4-11ea-ba4c-0242790999e0</a><br><br><br><b>Duration</b>: Jan 23, 2020 12:38 - Jan 23, 2020 15:38 (2h 59m) 235819 Site services : [GRIF_IRFU] - MonALISA is down 2020-01-23T11:36:13.000Z 2020-01-23T11:48:28.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2020 12:36 - Jan 23, 2020 12:48 (12 min) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2020 12:36 - Jan 23, 2020 12:48 (12 min) 235818 Site services : [Wuhan] - CMreport is down 2020-01-23T11:18:52.000Z 2020-01-23T11:18:52.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>CMreport is down<br><br>Duration: Jan 23, 2020 12:18 - <b><font color=red>continues</font></b> (14h 17m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>Jan 23 19:16:52 info Reading the configuration file from /home/sgmali01/.alien/alice.conf Jan 23 19:16:52 info The local configuration is not allowed to define services Jan 23 19:16:52 info The local configuration is not allowed to define services Jan 23 19:16:52 info The local configuration is not allowed to define services Jan 23 19:16:52 info The local configuration is not allowed to define services Jan 23 19:16:52 info The local configuration is not allowed to define services Jan 23 19:16:52 info The local configuration is not allowed to define services Jan 23 19:16:52 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 23 19:16:52 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 23 19:16:52 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://vobox.grid.ccnu.edu.cn' (a variable that is not in the standard configuration) Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 23, 2020 12:18 - <b><font color=red>continues</font></b> (14h 17m until now) 235812 Storages : [ALICE::Birmingham::EOS] - ADD test fails 2020-01-23T08:55:18.000Z 2020-01-23T11:54:21.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Birmingham::EOS]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 09:55 - Jan 23, 2020 12:54 (2h 59m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Birmingham::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>09:51:06</b></font> CET 2020</b></font><br> Duration: 1m<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> l9+rg+duAzU6RlUluMP1A2MoPhvdEd1VvaKaGI8IjKns+OYzgkOE+-389UAHfciVbP+pAicFw+7g<br> XZJ5zWP8Dal2KzCtaIZ24L6Jz1bZm9Fo87rrvIU9UMVp+3t+aPtyZ+sc4TMnHt-AY3KoLxsCNafQ<br> ab6o+O1HwxCqEbLuCuA=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgIPdfzCIMqC0+4cZfTUpouyFMzqIM0YG9gP36lgswMsXnAwJCwYMO7z5k2eH3ZDQ0T+Eywcf<br> kehmJITDiS0rYJv0aC0y0fqnf3pO69fYBZq6CCTbaZQjsu7C6-YoOaZZC3n3xqVwLAAr1Up2ApoZ<br> 4iEmbqeRMTvSwru0+KJ-VC07Jh4K+YN0fqfh331S4FLdsJyqnHbNVh507qXQTekUY5pOeaHngCv2<br> 2gjsCD0W0Zk-1ndK63q3VyYAVLISFToELD572JJoVtvXYsd1ZMk6HgQoyTLWZlC+6GjYBq1ZtdQW<br> Y4w7UiO6Nt+YecNSfljGxxjcH1qAOl59N55fT+RUuMGS3gEumB2szmX6X+5w1M7Cl9cD9vgg7C-4<br> hQvYKqBoD82MN22rf+4pr8D3QoSzX4+bvKb-DMOOFl5N4UDYpZfwKbzbh--07pUzKDxpdnSDbM6U<br> 1sitnXsvpj1H-uJVkZV2aJw2okN49pAW7aY-ccqRhwny37fBQAPkULfDkq-c1iHjhKMYyigSWKIo<br> 4bL2+3AB9-+tAYHXeMXqudrkqgnB+VSp1IBsfxUKJGMUORoX9tSVmW9wlpSHCN3WQrMRJZnvVrIw<br> ongLCjtcnvsQdfH4RS91QM7FhdG2iDlihA2644Mzpz7phpGQMa5Mb171ua9yQeskvtJrccdLk-h+<br> 8h2Tr01VSg9-0PLEp6WK1iEwV8Or0gBUl6N2Xg0a2ew9UhChn0jiG+JmnMamGx5HYVxeN9mE84pl<br> cUQS+5RZmV+LO3HdMPuo6S9EDX+ldlqpp2Grg3BKiTfiAGjP5S47t5TZ7OEEFaZut1hVL17Yvyha<br> 6urnALkPAy9QIK4zd3yslB83Po8-MpEnd9ho4N1gnWrUJo0VkANKxfZUdGPsyuBOmuNHojV4fV3V<br> 9II-es0N08FVsLPHLO7BkoTHoMrpgUh0FddfAeODd4Q7kz1Qhkf9+TTtwG3nG8+0iPPSnQEHWsUu<br> VcbJDRyK3PghLAlQ0IiX+vdDTJfiByD5NUBWTyXnAASf56HyeSjv9oMgEkWpOyhUJb-KwpIzsw==<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://epgeos.ph.bham.ac.uk:1094//07/58042/5aa99d40-3dbd-11ea-a248-0242790999e0'>root://<span title='193.62.56.45:xrootd'><b>epgeos.ph.bham.ac.uk:1094</b></span>//07/58042/5aa99d40-3dbd-11ea-a248-0242790999e0</a><br><br><br><b>Duration</b>: Jan 23, 2020 09:55 - Jan 23, 2020 12:54 (2h 59m) 235809 Site services : [Wuhan] - CE is down 2020-01-23T06:58:50.000Z 2020-01-23T06:58:50.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>CE is down<br><br>Duration: Jan 23, 2020 07:58 - <b><font color=red>continues</font></b> (18h 37m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>Jan 23 14:53:21 info Reading the configuration file from /home/sgmali01/.alien/alice.conf Jan 23 14:53:21 info The local configuration is not allowed to define services Jan 23 14:53:21 info The local configuration is not allowed to define services Jan 23 14:53:21 info The local configuration is not allowed to define services Jan 23 14:53:21 info The local configuration is not allowed to define services Jan 23 14:53:21 info The local configuration is not allowed to define services Jan 23 14:53:21 info The local configuration is not allowed to define services Jan 23 14:53:21 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 23 14:53:21 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 23 14:53:21 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://vobox.grid.ccnu.edu.cn' (a variable that is not in the standard configuration) vobox.grid.ccnu.edu.cnDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 23, 2020 07:58 - <b><font color=red>continues</font></b> (18h 37m until now) 235805 Storages : [ALICE::SNIC::DCACHE] - ADD test fails 2020-01-23T05:47:48.000Z 2020-01-23T13:47:09.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SNIC::DCACHE]</b><br>ADD test fails<br><br>Duration: Jan 23, 2020 06:47 - Jan 23, 2020 14:47 (7h 59m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SNIC::DCACHE]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Jan 23 <font color='#631BAA'><b>06:42:27</b></font> CET 2020</b></font><br> Duration: 1s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 51: [FATAL] Connection error</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> dQRna87N-up5L6NTNo--JcF3ZSrgRH22-paOYEOXPpbKYrPO8lMZbt3Lp2KxCUGpwyi67sIkuuk1<br> Z4KPQ9jBNwv0X0u16ejTAt-AxD8PCeJfWf6j29pwhGZ-Y54v513RYRfpnUjpmVL0I1b2QROCWtYZ<br> UihNBvJu4zk6bBR2zSI=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgCBvI9jNHsY32G3P1NIY0CGJyeY7xcpTFuGszd01Ot+o0yJdM-KV5AyAfkFRexPPfgBkyWN5<br> NlyQbhWJtGHO-zvpFGsUjjQK7GMSud4h3IusojDOBX36DOjQtvfyMPlCh-Lca9CW2zkEtRGw3Vsc<br> uMieqVQautiNMInLJ87xg-QnxDlIWtEIsdBUPnY2vDwKUL4M-Q4boAZ3ZOroERYIikXzzB7CXwLI<br> hFAfu8XHR-NVTb6RiQ-StNZ74UdViyUsDtNJ8WswAUiysKgZGbBOUen+ADl-PVMeQkcafsYcRH-h<br> mPwBilGcxg2IaX0uKcJRd9oF-mhUlYzRReecR5EKBg6GCGeDNqGAXEaIYqRk2jBXbl+ItoSuzuY5<br> lu4eeILWPs6Ooegm4ZxPE4yL7rSlKeGlH2pZQpfdQfPK4xungpiyhA6ugXih7P9l8m3t5Qi2+8V7<br> r2g35TePQLgcRdff3sdf1o2OYgbr0v1kdQgHUxjGOqyD2kIa47DAxdfEHNtlyZoXLIyFGHtdeNlC<br> Ez-VwIchh4FooTTYoNEaL7405Qbh6aD5Oec1G78fzY2teEIRrWOCBON9-zZ2iaeKDv9YGDjNoxoI<br> 4ePUBr2t6emViic9so9PcSfmdRKhkkCDg8WP8f1YSw1yxeidtpqrIj+FYPY-5A-E1l4-UUouBcmn<br> SHrDPhhvnt6Va85vhm2QchyV25b0anovH9Mp9nY6VBEwsObxMES9cU97RjlLoi+bar4Sj6LOT8BS<br> rrsJhmZFk+fczXOBldVnk4rn9unArToHWaIpilxkOYUbH1kCkBITCRE2ncWN2d26xqxmqJPrgQrx<br> qbZE5zPg4qLJXur2Mu7o+UKD47GbHwULLC1meTLbbwxWijfFafEqeJUS2hK-WnVK0Yw0cKbFndCz<br> q5POVrmkPy3wtF7G-asKjxwH0HAx24AsvSWWFu7SENAoUoL-RDi-n6s0PRk5O3BGBGfUSlLrSsSD<br> PtGhWnWObgAFGbNXz-b+Kd-ON28meLUIIhNvmBc1cRK5bwFdxk8O-9+Q95KCN3IRkx3as8yAIx60<br> IfktEk7WjfWpsGc6IFw=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://xrootd.swegrid.se:1094//NOLFN'>root://<span title='130.236.100.106:xrootd'><b>xrootd.swegrid.se:1094</b></span>//NOLFN</a><br><br><br><b>Duration</b>: Jan 23, 2020 06:47 - Jan 23, 2020 14:47 (7h 59m) 235641 Site services : [Tsukuba] - CMreport is down 2020-01-22T19:18:05.000Z 2020-01-22T19:18:05.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Tsukuba]</b><br>CMreport is down<br><br>Duration: Jan 22, 2020 20:18 - <b><font color=red>continues</font></b> (1d 6h 18m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Tsukuba]</b><br>Jan 23 04:05:29 info Reading the configuration file from /home/sgmali01/.alien/alice.conf Jan 23 04:05:29 info The local configuration is not allowed to define services Jan 23 04:05:29 info The local configuration is not allowed to define services Jan 23 04:05:29 info The local configuration is not allowed to define services Jan 23 04:05:29 info The local configuration is not allowed to define services Jan 23 04:05:29 info The local configuration is not allowed to define services Jan 23 04:05:29 info The local configuration is not allowed to define services Jan 23 04:05:29 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 23 04:05:29 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 23 04:05:29 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://utk-alice01.tsukuba.jp.hep.net' (a variable that is not in the standard configuration) Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 22, 2020 20:18 - <b><font color=red>continues</font></b> (1d 6h 18m until now) 235597 Storages : [ALICE::Kolkata::EOS2] - ADD test fails 2020-01-21T18:33:49.000Z 2020-01-21T18:33:49.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::EOS2]</b><br>ADD test fails<br><br>Duration: Jan 21, 2020 19:33 - <b><font color=red>continues</font></b> (2d 7h 2m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::EOS2]</b><br>Test finished at: <font color='#2A1FAA'><b>Tue Jan 21 <font color='#631BAA'><b>19:29:49</b></font> CET 2020</b></font><br> Duration: 2m<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> b3tV229fkMsXMoOWBE4gA28qDG7PrXw5GslZIGBhrMmKUUZEiDIupmEru2ouuSz62qrtZQxzw+lP<br> QDs9tFWocpfNWu+MfzTOq47q00EZAOXIQ5kA-Sahd4TXMtwLcqTVyq5SngAmOVvY4wAAzXozff3T<br> h2-GjiTczN3sJv1nmNU=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgKVp8sGDNKmYyrDu6tI6oqG1-xnKf2H+X05wm3BXZJ3FbPiOSOfBHNbkK06hZ5PMPmTMNwbc<br> thVzvx-YY40z3EYvVBRqXeGpLxrdE2Aohw3vw3JFYZRYo0v0Ds4L1GX8Bf-x+5hMq-OzmC7FiIYC<br> Z7yM4qlJH+cxzn4W1BXkjMG-+bMet1jOaMbyrEU606VfJsNImBmR0vG04nuAGVMs1pglSg6qFj4s<br> 7phzO4wE-ubXMXww-6l3-FPa7aB62KT39ddf-FJN3JJagZXScCv65WWtZ8wwmQY5ijg-I3Dlwxfr<br> -q7M9QzTQSBB6J+wP3CFsg0o6h8gGMtjzqNRvNnxvXEwaERQxblAaHduYw+05aD4cPHO30AgFi8D<br> sC-YU3w5dxwf0f4BVzrIiFtvpEZtjM2pr2QADRsiSWx3OuYjOTfnVK-GEblPbERzPp7L5AxTr7M-<br> S0WharXBpm9bdODbd5lN4wK9aB3rG1jDigQPzb3AAFZZ0+iAA59BAbBnTsHKXDF+JpwTkY01zi0K<br> hMGPSu2M1ap2CbJ4jZBJo3dlBAfi12yYpL9JKihTfXa4PEQMbw7fpWbYXBU+ZUPOEUOUeCCQ6ysr<br> Uniyy-+I8WjKNFF1OeDDHkr-M5C14yx-RtP+1-XFamVf5DizoHeMJCQPtx-Q6-GFOi9+tK0QfcXE<br> vcj7kr5G8uRZmDZq3oFABuyXRCFLSgpAfhPlwBvMb75Yg1ubkl3Hl6aCLnZazDLdJjk9-IXQF0vF<br> E-s0CDSkdEJefdYmMCceW-Z9la0WHLcWYsoARtkF5F8Eu8Jfs2UVjZsby8nrr7AFQ-tW9K25mY3q<br> 9micyRyB3bRXynCGBkyj8m49kzbxl7KHNbJqf42+bJdzzEmb7n4Pq8OFfwO4TwfqjaraUaU-19f-<br> WtaBVMELawe5YCqYYEaudx0rsMVP4c3m325fLe99LAShIr3g2vFi37Yp-QrfYBgtRpCBlHhjjJF3<br> f30m6dT2po6upztTCLPG3Qc4ZI0auJ+AAzLbo1uvHwjyIyVPKoA1-jQO4sOvKrjGtvjE-hg4vQ==<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://eoskolkata.tier2-kol.res.in:1094//04/10749/ba4772b0-3c7b-11ea-9e85-0242790999e0'>root://<span title='144.16.112.15:xrootd'><b>eoskolkata.tier2-kol.res.in:1094</b></span>//04/10749/ba4772b0-3c7b-11ea-9e85-0242790999e0</a><br><br><br><b>Duration</b>: Jan 21, 2020 19:33 - <b><font color=red>continues</font></b> (2d 7h 2m until now) 235594 Proxies : [CBPF] - Alien proxy has expired 2020-01-21T12:42:11.000Z 2020-01-21T12:42:11.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[CBPF]</b><br>Alien proxy has expired<br><br>Duration: Jan 21, 2020 13:42 - <b><font color=red>continues</font></b> (2d 12h 53m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[CBPF]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fDC+3dch+2fDC+3dcern+2fOU+3dOrganic+20Units+2fOU+3dUsers+2fCN+3dlbetev+2fCN+3d374855+2fCN+3dLatchezar+20Betev+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Jan 21, 2020 13:42 - <b><font color=red>continues</font></b> (2d 12h 53m until now) 235593 Site services : [CBPF] - MonALISA is down 2020-01-21T12:41:56.000Z 2020-01-21T12:41:56.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CBPF]</b><br>MonALISA is down<br><br>Duration: Jan 21, 2020 13:41 - <b><font color=red>continues</font></b> (2d 12h 54m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CBPF]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 21, 2020 13:41 - <b><font color=red>continues</font></b> (2d 12h 54m until now) 235581 Site services : [Tsukuba] - CE is down 2020-01-21T06:53:22.000Z 2020-01-21T06:53:22.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Tsukuba]</b><br>CE is down<br><br>Duration: Jan 21, 2020 07:53 - <b><font color=red>continues</font></b> (2d 18h 42m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Tsukuba]</b><br>Jan 21 15:41:28 info Reading the configuration file from /home/sgmali01/.alien/alice.conf Jan 21 15:41:28 info The local configuration is not allowed to define services Jan 21 15:41:28 info The local configuration is not allowed to define services Jan 21 15:41:28 info The local configuration is not allowed to define services Jan 21 15:41:28 info The local configuration is not allowed to define services Jan 21 15:41:28 info The local configuration is not allowed to define services Jan 21 15:41:28 info The local configuration is not allowed to define services Jan 21 15:41:28 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 21 15:41:28 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 21 15:41:28 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://utk-alice01.tsukuba.jp.hep.net' (a variable that is not in the standard configuration) utk-alice01.tsukuba.jp.hep.netDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 21, 2020 07:53 - <b><font color=red>continues</font></b> (2d 18h 42m until now) 235411 Proxies : [SARFTI] - Alien proxy has expired 2020-01-16T08:37:21.000Z 2020-01-16T08:37:21.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[SARFTI]</b><br>Alien proxy has expired<br><br>Duration: Jan 16, 2020 09:37 - <b><font color=red>continues</font></b> (7d 16h 58m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[SARFTI]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fC+3dRU+2fO+3dRDIG+2fOU+3dusers+2fOU+3dspbu+2eru+2fCN+3dAndrey+20Zarochentsev+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Jan 16, 2020 09:37 - <b><font color=red>continues</font></b> (7d 16h 58m until now) 235220 Proxies : [SARFTI] - Proxy Server has expired 2020-01-09T16:28:03.000Z 2020-01-09T16:28:03.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[SARFTI]</b><br>Proxy Server has expired<br><br>Duration: Jan 09, 2020 17:28 - <b><font color=red>continues</font></b> (14d 9h 8m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[SARFTI]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': Attempt 2 globus_credential: Error reading proxy credential globus_sysconfig: Could not find a valid proxy certificate file location globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fC+3dRU+2fO+3dRDIG+2fOU+3dusers+2fOU+3dspbu+2eru+2fCN+3dAndrey+20Zarochentsev+2fCN+3dproxy-v<br><br><b>Duration</b>: Jan 09, 2020 17:28 - <b><font color=red>continues</font></b> (14d 9h 8m until now) 235171 Proxies : [SARFTI] - Delegated proxy has expired 2020-01-07T16:38:56.000Z 2020-01-07T16:38:56.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[SARFTI]</b><br>Delegated proxy has expired<br><br>Duration: Jan 07, 2020 17:38 - <b><font color=red>continues</font></b> (16d 8h 57m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[SARFTI]</b><br>Unable to get delegation Failed to receive credentials. ERROR from myproxy-server: "<anonymous>" not authorized by server's default trusted_retrievers policy "<anonymous>" not authorized by server's authorized_retrievers policy "<anonymous>" not authorized by server's authorized_renewers policy<br><br><b>Duration</b>: Jan 07, 2020 17:38 - <b><font color=red>continues</font></b> (16d 8h 57m until now) 235155 Storages : [ALICE::ORNL::EOS] - ADD test fails 2020-01-06T15:05:38.000Z 2020-01-06T15:05:38.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ORNL::EOS]</b><br>ADD test fails<br><br>Duration: Jan 06, 2020 16:05 - <b><font color=red>continues</font></b> (17d 10h 30m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ORNL::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Mon Jan 06 <font color='#631BAA'><b>16:02:03</b></font> CET 2020</b></font><br> Duration: 7s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3009] Unable to get free physical space /eos/aliceornlxfer/grid/15/48011/7af5f060-3095-11ea-b5fa-0242790999e0; No space left on device</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> NWo2NjKXVHSGqjkRYtqijCSZApGNuuaSN0ctaq1QEKJidg2Smmp2yhUzSWQQaJkzuI255Z+mBeDc<br> roy9kjrUlHqGE9opbDv6-71SawEPtmz-VtzJvfSKZ08eS2PsrsESsYU6uGsJo7xgRQGzPcAvyScI<br> pMjvHYDtYyLQYGqwfH8=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgE33BDVmv-3UJKKbeSaGKE+GNF4RaI-Hvl4v9oYc2xkwOvmGtJ+A-rpvjg3bb5iDKDcMp9qN<br> 66LOzz6AoLX8fainKQFMHby0t+nFlbbifTXtsKxtZNOus76VrSmkEuYODIJvHagA0vLXpFbwXxPj<br> o7hf8gG5CUSfNx5-gbvDOMxoyNmCi0hvOZ5688YdYpIT3tBGbbdJDwoUZsu0f+O7DL8OAXdSMluJ<br> ZWCkQTJe5kq6LkEkQzvt8L5SZTGK4rDEr2xn23+Gd3YRZd93lm-72lkzcdluYq-TmFVD-baoIsVy<br> CaBY8OOiv24teb7USZqk+Z3gdMRz4BlSBWcWzUmTpf5xf-p05v73FVnNvf1355qDaPzbpnMxBVVO<br> p1Y38IK9r7EEorNCc1quT7tkXmWRSOMGX8x3OhQ3hHAFHWcADm74m3KhLxTtR-4w74RzXlDlgowv<br> boF25Rkb9tPO2W06IvIkoGE-WXpJmgLTezuhhQ8yV7nd5w3PSUpovYwXAI5PjhThQk7UF3KGzn3H<br> IWbAf8AZFm37RBtUQwBx00ITE6QWdw+ah2olYs0DEdQG6yPSnxXTHqFOpoqEBni0SHbPTiEwJn2X<br> 6B1O3dLvnvzeop0hq7HNbA8aiw0PYjy4+bZYUls1CCxvePVuQrBjmmfJU81LWPvx-if3LArMRey7<br> nbWsz-pn9Vv0kXsymve5SOJQiilfDHcijUjowexLMsYR3Qm08x43GHemkEIOc9E9GjWwYbQGYSYA<br> TWeoVtPMnCl0PdiQ46zJNqt5dLQ-1GQHZX4HkEOv4YIDhsw8z7p1lUo5Bu3cy1PLrgFysVJUvvZj<br> pKgVbF643YNrq6sBV+KhhR3ccZRLQ0KNaEzABmTBzv7FBIFJq9dILVZcmN0ISaRZRp4jLJYNbCZA<br> gQOKEwktDOZ19tckEsBrB+8E04Fr-vaMOK2+CY5H0NMQbiaY9LeISBZZ-iQD4zYOo83swjaHYJZq<br> U632OZ20BraAQIBjeIPubp+K+8PEDnVXIO5Hnkvydke1N375ltt9i9ZVTADc8-c=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://ornl-eos-01.ornl.gov:1094//15/48011/7af5f060-3095-11ea-b5fa-0242790999e0'>root://<span title='192.188.182.25:xrootd'><b>ornl-eos-01.ornl.gov:1094</b></span>//15/48011/7af5f060-3095-11ea-b5fa-0242790999e0</a><br><br><br><b>Duration</b>: Jan 06, 2020 16:05 - <b><font color=red>continues</font></b> (17d 10h 30m until now) 235001 Site services : [MEPHI] - MonALISA is down 2020-01-04T12:03:23.000Z 2020-01-04T12:03:23.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>MonALISA is down<br><br>Duration: Jan 04, 2020 13:03 - <b><font color=red>continues</font></b> (19d 13h 32m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 04, 2020 13:03 - <b><font color=red>continues</font></b> (19d 13h 32m until now) 234904 Site services : [MEPHI] - CE is down 2020-01-03T01:52:19.000Z 2020-01-03T01:52:19.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>CE is down<br><br>Duration: Jan 03, 2020 02:52 - <b><font color=red>continues</font></b> (20d 23h 43m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>alice02.lxfarm.mephi.ruDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 03, 2020 02:52 - <b><font color=red>continues</font></b> (20d 23h 43m until now) 234642 Storages : [ALICE::SPbSU::SE] - ADD test fails 2019-12-28T08:43:50.000Z 2019-12-28T08:43:50.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SPbSU::SE]</b><br>ADD test fails<br><br>Duration: Dec 28, 2019 09:43 - <b><font color=red>continues</font></b> (26d 16h 52m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SPbSU::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 28 <font color='#631BAA'><b>09:40:42</b></font> CET 2019</b></font><br> Duration: 6s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] No servers have write access to the file</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> fA5YAuweMHlAySgPNWa34n2zfexDuUTQJXw0I2talzZhV6tuM-8WoBaRrKEH+ZCAJHHDU-dFo5HJ<br> x1NDiYrvLIHCVMLjZjzDiAax8H4YkntBPvVJBLnshrs96Nau+CvzXiXNBfN54d6bOB1DBUkrkkXe<br> f9qjwVbGxB5sw9PUnME=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgI1H1z77JMQaTWN9BwHxycCNyIxOVbL+fnfS2jsc95H6XoCU0PEF1NlaI4MY84Vcee+dfMmP<br> p37x1AzC8P7+k83BdJmQHauidSKuyEST3wVa5+nUvVDLVOzT8UrLa6PJAAlQ3lR55yrKrwOs4A0C<br> iZ1n7v+h7K33DKGwRNgNrJJJk3oOWLoU0+xMTbDIJL7-MqkM3c+ZeozHaXx7OYXYbcVqrRj3soIv<br> xWH2xcNMWfZXBT7g1bCfdhiNuL6uuvK88VMTWbm4gGEKE+yL5GZ99uW4GXY1xdFccX9UZxeGHlqe<br> XEDCxrBt-9CUYeKwo+CKGHUYSFAE4ST6oUD7mH876hR-azT2OQb7IAYO5lH7ZBWeciHPu4XWGsZf<br> ZR-nXFkqDwmhFIDk79ElgNkQqM8flHJYt1ARemUwY83nxeUJ16HfNd+1TDn3iw7HvkpoOztRp7Sv<br> bBDdFigIpCt4KeXXXU-OfxtBKb7LTfUgnIBONDETFmtukNCSHrCKGnVjW4ntW0xt-FiC6-9a-mKR<br> 7alRRsaz61mBQ7Mx9bBSJdq55Dkuo4W+yAblOczzsjUnLBlWIZiTTDTW-jHyoNfldapCWlSFg8l-<br> 7InM17mo0XHs8Wq+krXUGY4-VfNK9e2GD89jf5bwGy5SVWGZ8TOs59IXCDzwDMkGmuFXPpKRFYOq<br> xarZHGBcKpRke2JAKf-vk3e91RP7OHxxjrzPOMFwDwSOES9ypsc1-2tctDyT8RwsBoYGp3fv+Raj<br> VCX1ewUMqSv+gCm6hGkaAn24on7xof5JY+h9JKJTWRfgehNy2BGOtlZREcy+W2Vh8-Bhz7gYci73<br> l7glsXwyNV5ivolOaj2ITMM6OK8vCv0Vc3L70ecNTdNnL-XIR86wnYBeI25SkG5Il-wKsIfB0yGh<br> vLFtKCwwpqf0lFFQUJKaE6Fuafc7X3TR5VIxoHSWUE8OgAwd4csk-WxTAzaW8vUBVLaS-vJB1eZ2<br> zVyluQvHB45JOiWvi7p4-hd8mxrwuIKMqNf2P3Mq1RH4O7T4ge9A<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://alice21.spbu.ru:1094//00/51080/b7ae1040-294d-11ea-b906-0242790999e0'>root://<span title='217.197.13.246:xrootd'><b>alice21.spbu.ru:1094</b></span>//00/51080/b7ae1040-294d-11ea-b906-0242790999e0</a><br><br><br><b>Duration</b>: Dec 28, 2019 09:43 - <b><font color=red>continues</font></b> (26d 16h 52m until now) 234541 Site services : [Tsukuba] - Monitor is down 2019-12-26T00:57:23.000Z 2019-12-26T00:57:23.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Tsukuba]</b><br>Monitor is down<br><br>Duration: Dec 26, 2019 01:57 - <b><font color=red>continues</font></b> (29d 0h 38m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Tsukuba]</b><br>Dec 26 09:45:34 info Reading the configuration file from /home/sgmali01/.alien/alice.conf Dec 26 09:45:34 info The local configuration is not allowed to define services Dec 26 09:45:34 info The local configuration is not allowed to define services Dec 26 09:45:34 info The local configuration is not allowed to define services Dec 26 09:45:34 info The local configuration is not allowed to define services Dec 26 09:45:34 info The local configuration is not allowed to define services Dec 26 09:45:34 info The local configuration is not allowed to define services Dec 26 09:45:34 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Dec 26 09:45:34 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Dec 26 09:45:34 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://utk-alice01.tsukuba.jp.hep.net' (a variable that is not in the standard configuration) utk-alice01.tsukuba.jp.hep.netPinging service ClusterMonitor... The service is running at utk-alice01.tsukuba.jp.hep.net:8084, uri ClusterMonitor Attempt 1 (Thu Dec 26 09:45:35 2019) Attempt 2 (Thu Dec 26 09:45:40 2019) Attempt 3 (Thu Dec 26 09:45:45 2019) ERROR: Could not contact service. (Error 500 Can't connect to utk-alice01.tsukuba.jp.hep.net:8084 (connect: ??????????) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Dec 26, 2019 01:57 - <b><font color=red>continues</font></b> (29d 0h 38m until now) 234539 Proxies : [Tsukuba] - Delegated proxy has expired 2019-12-26T00:40:00.000Z 2019-12-26T00:40:00.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Tsukuba]</b><br>Delegated proxy has expired<br><br>Duration: Dec 26, 2019 01:40 - <b><font color=red>continues</font></b> (29d 0h 56m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Tsukuba]</b><br>Cannot read X509_USER_PROXY<br><br><b>Duration</b>: Dec 26, 2019 01:40 - <b><font color=red>continues</font></b> (29d 0h 56m until now) 234538 Proxies : [Tsukuba] - Proxy Server has expired 2019-12-26T00:40:00.000Z 2019-12-26T00:40:00.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Tsukuba]</b><br>Proxy Server has expired<br><br>Duration: Dec 26, 2019 01:40 - <b><font color=red>continues</font></b> (29d 0h 56m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Tsukuba]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': Attempt 2 globus_credential: Error reading proxy credential globus_sysconfig: Could not find a valid proxy certificate file location globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fDC+3dch+2fDC+3dcern+2fOU+3dOrganic+20Units+2fOU+3dUsers+2fCN+3dlbetev+2fCN+3d374855+2fCN+3d<br><br><b>Duration</b>: Dec 26, 2019 01:40 - <b><font color=red>continues</font></b> (29d 0h 56m until now) 234398 Site services : [MEPHI] - CMreport is down 2019-12-21T08:17:17.000Z 2019-12-21T08:17:17.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>CMreport is down<br><br>Duration: Dec 21, 2019 09:17 - <b><font color=red>continues</font></b> (33d 17h 18m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Dec 21, 2019 09:17 - <b><font color=red>continues</font></b> (33d 17h 18m until now) 234224 Site services : [alihyperloop.cern.ch] - Problem with CACHE 2019-12-17T11:21:49.000Z 2019-12-17T11:21:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[alihyperloop.cern.ch]</b><br>Problem with CACHE<br><br>Duration: Dec 17, 2019 12:21 - <b><font color=red>continues</font></b> (37d 14h 14m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[alihyperloop.cern.ch]</b><br>Path: , usage: 100%, monitoring status: ok<br><br><b>Duration</b>: Dec 17, 2019 12:21 - <b><font color=red>continues</font></b> (37d 14h 14m until now) 234223 Site services : [alihyperloop.cern.ch] - Problem with LOG 2019-12-17T11:21:49.000Z 2019-12-17T11:21:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[alihyperloop.cern.ch]</b><br>Problem with LOG<br><br>Duration: Dec 17, 2019 12:21 - <b><font color=red>continues</font></b> (37d 14h 14m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[alihyperloop.cern.ch]</b><br>Path: , usage: 100%, monitoring status: ok<br><br><b>Duration</b>: Dec 17, 2019 12:21 - <b><font color=red>continues</font></b> (37d 14h 14m until now) 234222 Site services : [alihyperloop.cern.ch] - Problem with TMP 2019-12-17T11:21:49.000Z 2019-12-17T11:21:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[alihyperloop.cern.ch]</b><br>Problem with TMP<br><br>Duration: Dec 17, 2019 12:21 - <b><font color=red>continues</font></b> (37d 14h 14m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[alihyperloop.cern.ch]</b><br>Path: , usage: 100%, monitoring status: ok<br><br><b>Duration</b>: Dec 17, 2019 12:21 - <b><font color=red>continues</font></b> (37d 14h 14m until now) 234100 Site services : [UiO] - MonALISA is down 2019-12-13T10:01:04.000Z 2019-12-13T10:01:04.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UiO]</b><br>MonALISA is down<br><br>Duration: Dec 13, 2019 11:01 - <b><font color=red>continues</font></b> (41d 15h 35m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[UiO]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 13, 2019 11:01 - <b><font color=red>continues</font></b> (41d 15h 35m until now) 233852 Site services : [UiO] - Monitor is down 2019-12-09T20:34:48.000Z 2019-12-09T20:34:48.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UiO]</b><br>Monitor is down<br><br>Duration: Dec 09, 2019 21:34 - <b><font color=red>continues</font></b> (45d 5h 1m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[UiO]</b><br>Use of uninitialized value within %ENV in substitution iterator at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. Dec 9 21:31:59 info Hello ALICE::NDGF::DCACHE Dec 9 21:31:59 info Hello ALICE::SNIC::DCACHE Use of uninitialized value within %ENV in substitution iterator at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. alice.grid.uio.noPinging service ClusterMonitor... The service is running at alice.grid.uio.no:8084, uri ClusterMonitor Attempt 1 (Mon Dec 9 21:32:00 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 2 (Mon Dec 9 21:32:05 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 3 (Mon Dec 9 21:32:10 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to alice.grid.uio.no:8084 (connect: Connection refused) at (eval 103) line 1 ). Exit code 1<br><br><b>Duration</b>: Dec 09, 2019 21:34 - <b><font color=red>continues</font></b> (45d 5h 1m until now) 233799 Site services : [KFKI-2] - MonALISA is down 2019-12-07T10:42:11.000Z 2019-12-07T10:42:11.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[KFKI-2]</b><br>MonALISA is down<br><br>Duration: Dec 07, 2019 11:42 - <b><font color=red>continues</font></b> (47d 14h 53m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[KFKI-2]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 07, 2019 11:42 - <b><font color=red>continues</font></b> (47d 14h 53m until now) 233740 Storages : [ALICE::SARFTI::EOS] - ADD test fails 2019-12-05T19:18:42.000Z 2019-12-05T19:18:42.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SARFTI::EOS]</b><br>ADD test fails<br><br>Duration: Dec 05, 2019 20:18 - <b><font color=red>continues</font></b> (49d 6h 17m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SARFTI::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Dec 05 <font color='#631BAA'><b>20:12:05</b></font> CET 2019</b></font><br> Duration: 2m<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> ksJZAXs-xJhNdRyna5ADnvNbEbkriM-Ctef+-5T6XKDv6XfpGc3rL3LkmBVoZnLli4ebmDLBWqXS<br> TmgwR3A99o4Gw9uQBQmJsz1jjxuAvVOd0cmbSPiWOpEqBUne32G0ciWCevVsgDEEkNeU9TkCFmSi<br> jQA8wZP8EU0u3qOtzk4=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgJmIv3rxOAh8U97pObV136WrYso44NOzzdedEjaPyKC+g2d0hGKzV7eInlk2wS6997GKa0kd<br> B1vftHcRt+L04omjr9pAA-fsxiB5Tr23gkiOMacVHGhIdndOC2f8NN+p94lEeCC3NtDf6OVA1-3Y<br> 2TuLKfoplLYOJpkUVFYkx7j1Kr4O3p5p-FsI+MwhotNnQ9-fi6KPEYkkDLZAWTK6ML8fRBcijTB7<br> u4NkgnqVsjntpUpc74JZe1seQfvgl-9PncxpKdA32U+pWRz5fQ8fRZMvXBxiS-4MihRdzVlj-hI+<br> TB4QfUhEiID-006NjiPwoCS-Y1CU4pEChpf8AnvV-uJtO1qXj9ugOxJeZ7Bb9YqAww8zQzGCxxWb<br> 28818bjpIp4EjExVhQw9AuRbwaAcX69M5jr5KtmRqIdcqCOAzKfsL1wuvF0vbE7RQ4X3bud+9PTn<br> m9fOYZri-ypcVWqWJ6TFJp5Q5zgm98QfNNvtu2fwMM0k5rC7VD2RYnj23ZH5PDCAx8zgUZAFmYlF<br> qP-q-xZizFEXOx5UF+jGOIQCojLdJGLKNjn+0yWOli4t1RitFlrlyuJBIf7ygGx7ArGW2qUAsXlX<br> YKxBRteDHXnN2spqgOdivCgqRvwpsgb1NuCkxGg2BHj9rcsRiUuNWnRjK34C3hjrwjJqs7c+JbO3<br> pCRkxguHZYJvM0u82cCEJmaNcOfOawqARFgfJhetPlv-5sZRH5H6OJ0DLJ9TVeWjpp51KzyYQ055<br> +TPnlIwXgvywNHdIwC8XvCC5dxh4D2lqI8meYbBC85sHfuwuct2-RpVRCHoeocv4K9iclWkFJhnm<br> 62gCO2JoIyHYCLQ-AF+vk1ntXopI9izefGKKL7XIdTXo18JKz5ljfFaU7brlrI7x+IIehtlDcHfh<br> 0jrGV9FJ82CH8OZEMPwgorp6EvHNT6UfNI0DB6IJlHYQx+gfzmbSFUGAVOQ9tqbyRlvPI4XL9Ccn<br> 5hcDWe4koVvm8KRkXsWYozSFwdH6LO5xQ1miXEQgBAmBUXvVDLnLg1J6M3Xv7Ok=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://gridse1.sarfti.ru:1094//06/31297/d86e41f0-1792-11ea-b259-0242790999e0'>root://<span title='185.141.124.199:xrootd'><b>gridse1.sarfti.ru:1094</b></span>//06/31297/d86e41f0-1792-11ea-b259-0242790999e0</a><br><br><br><b>Duration</b>: Dec 05, 2019 20:18 - <b><font color=red>continues</font></b> (49d 6h 17m until now) 233719 Site services : [CBPF] - CE is down 2019-12-04T23:48:17.000Z 2019-12-04T23:48:17.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CBPF]</b><br>CE is down<br><br>Duration: Dec 05, 2019 00:48 - <b><font color=red>continues</font></b> (50d 1h 47m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CBPF]</b><br>Dec 4 21:44:44 info Reading the configuration file from /home/sgmali01/.alien/alice.conf Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Dec 4 21:44:44 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Dec 4 21:44:44 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://vobox.cat.cbpf.br' (a variable that is not in the standard configuration) vobox.cat.cbpf.brDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Dec 05, 2019 00:48 - <b><font color=red>continues</font></b> (50d 1h 47m until now) 233621 Storages : [ALICE::Grenoble::SE] - ADD test fails 2019-12-03T10:31:25.000Z 2019-12-03T10:31:25.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Grenoble::SE]</b><br>ADD test fails<br><br>Duration: Dec 03, 2019 11:31 - <b><font color=red>continues</font></b> (51d 15h 4m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Grenoble::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Tue Dec 03 <font color='#631BAA'><b>11:26:45</b></font> CET 2019</b></font><br> Duration: 5s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] No servers have write access to the file</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> nOyKyDP0dGGZsbPx+xau+O4x55+apE8kRT8Q7TrKJxx1K+62oXPMtnXhkcIFsEfHRuSUfQnPa-Ks<br> naaJ4ylRpvEQSrp3p6BnCCQGhHf+Nd7ILbMeTsHa5OajQNpOKpJEKuNdLuYSz4AtqM8vRTIAoy5j<br> F224h94AkzhA+LPc9zQ=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgB+9DKTjmDRVhh+FmG3xFvMKZwyNS-ynlgDW27PHjRuGfRFAxicJ13xNTVz8ISjHY0zmIMwd<br> cpWLV-7fMdaBPSLlzo1eeegMFCkymyllxB4etX13ZuFhObm-u0vyJaOGq6uGnKR-UVRaXzuvHCWE<br> neHRHNUCgGEg7Fqm2anLd65SMK5vAQ0XiTQ0NZrQrnTl9YG6QjYDjywBXlp9qu5p1j+Sxe1DyHpR<br> XAWO-hlHSAG+ww9JSZfV14ojrJ+Ormj3UpXZ3maJK-SMASBGoEZ3rKPNHXIJe8mMDOCgxpH9vIol<br> IoeN081f5cqv1LEzCTshpcugp2xc0DZoemX5w-X1iKL1RFEfog6Bz7J4Y2PWeiB5XzE2rFjEaGV4<br> HwPr8UrG4lcDVLQ48jj5lmKnjYefkQv4tSpAlte7Rqrxjs6MjM-cqnYE4chjB3zFXjlwP6219TSN<br> AM99RO-tbNRB9tYYhaFkZUCAuDbabg-am5UVz6FscI2Av9f8ZF1qqk4Mp-SxrCBcqRZwzZDHulhB<br> 6R8wIyXVywjsplgNVv6wxFTp942E7VbFwvA7CvLJjHwOqAX6-mLwjW0-ZmOvU23rdIaj201A+PMG<br> jUv8spRd7XCcl8Z7VtKekNAJtKadUw2iME27-oh7hydxSLrKVHBPw5nND980rjtR3Hm7-nVPhDcK<br> u35wFyyTOREkf0bhx2MUuGcUcapPjiqfVdo2tnlgzScrcBg2CO7SLFEaHMRXf7ZUw7dfEECuu8Qi<br> hqNnVliJIj6gUTQkl9o6elupHmQViHzfbcRVannHRRpLvNW8zggGA0a8VpIL8Vqa3emRnR53ecYF<br> xAGK1wDEnqCaGTa6DI7xHKwgOSRPOCkW3OxOmFJXZ8VLk6sXEfWnQprwO5UsM3qKhjHnl9XhQFiD<br> 2YKg8QdZ3mUO6MmF1UTd6Zr4DR0AxgfAF28by8znGEEAIwVjo5A1xYgS9hWON0TqfegTKXrpG5kU<br> DzX2ZikBOyNL51SpiGZMBPdZjEk63iVG4Yhi+0Iehcg1B163CRulyNavLKF83Jx5SsfvcwkN6w==<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://lpsc-se-dpm-disk17.in2p3.fr:1094//09/58285/64a1b860-15b7-11ea-bfd1-0242790999e0'>root://<span title='193.48.83.122:xrootd'><b>lpsc-se-dpm-disk17.in2p3.fr:1094</b></span>//09/58285/64a1b860-15b7-11ea-bfd1-0242790999e0</a><br><br><br><b>Duration</b>: Dec 03, 2019 11:31 - <b><font color=red>continues</font></b> (51d 15h 4m until now) 233042 Storages : [ALICE::Kolkata::EOS] - ADD test fails 2019-11-18T13:56:21.000Z 2019-11-18T13:56:21.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::EOS]</b><br>ADD test fails<br><br>Duration: Nov 18, 2019 14:56 - <b><font color=red>continues</font></b> (66d 11h 39m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Mon Nov 18 <font color='#631BAA'><b>14:53:58</b></font> CET 2019</b></font><br> Duration: 8s<br> /home/monalisa/xrootd/bin/xrdcp exited with exit code 51: [FATAL] Socket timeout<br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> FoWkC8ZbNVEb3NOUl65ygJh++HpUWCTUTZGDsai0WHwzu1Ygt-y2N4pr1LacYCDrm+OSQvTBZqQi<br> uqbevB2jW9pC94xSLtD6idLNAR0zAOkgLSVUUKPLizpi1NoplIwhduDHofEXXx4P3UM1fUj3cgJQ<br> I34vs8AJaq+TkXq0yTo=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgB3GptaahMifGXzSEvsQk1IsXIiDRHcauLOPpDcYz9WFteC4KMgpcQbxve7Sn8Q2FXIYhe-b<br> hstdKB17hihhVrob0xaLWJCmnR3QD4B+FQdAQUyH10GBp1W0FT1zTWJXDooUX6sXvvUK2YZmp5z+<br> psZBoUZrTMJvc5UzcBIRwS0LdpoHJMNRQhZpsK63ltbM+FbcdvwAkksshQOoVR5aveTMyRQ2UmYS<br> 1-AWLYRYIltMRXB4V+JY96uA93kx9PMHiwcXGN6DWzjN0kwftKDibQk5MqFTNpNVJCT974G0kXLp<br> P+WhLMSx37anzrO6ON9Gb43xs4hVlEEOFv-5gTM66xa3lYZIXuXtsr9V5SlW4Jn6lDJTZOO6AByG<br> EpEVDg9LeUcRPO13Vp2VUpuxjvh96-tUxUmyMDcSSypoND4z7AtuwXzSNjTxgYc-wtJYE8J8VTsd<br> e2c9iCPJG8ZoTmfrSc+8vxIUM0Q6aHTf7danfR7F5blgyNh5e5jHpS5ObYZMuJNGVxA+8jG6jVU1<br> WfPObNdjrmXsodnVJax+3PzKDKtdrLbMevI0WznLDp3sZ6d+7n-sVawNgSzQ3fVsPdDzl6HbauhQ<br> D9h2UCTAK4QzwlthueIh2uFMmONwJh4S8rXjiLAdUJCYpJF5Fbp0FX+4q2-Gvf7XwrE3RQjZ8Wxo<br> vGL4mbGCD0CM3sBE-mF8cqLaixi-syDCqizUItdkUhbdpVeG7b56Qth3jI2tJlB507iX01DFxGed<br> V1W07QEltjJMSbiUGww1xpkIGiBa4QxXLEWFCKlmktzhTgkM8kmmcUVt6inNqpC3ebt448-UsDkC<br> rGLMXIFIoLJzzSibfIN6pSQkQ03b5LGggHvf8uSIXBDakja75taUmwhGEKtAXk1hUigtbx8As-o0<br> I8DE4yKW1TBI6DOvLRZ25pu9YAjTxhMSdO0eyKcycTOeHvUS21QgQCcv24XD4jY0P0GIBDw2lW10<br> IJ2+A98I1YHoT7ZkRmMg2WJLFLHtNH7kcvwsRWsJdnMveYV9SwcKvG2ofCe6Pxg=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://eos.tier2-kol.res.in:1094//04/12018/d9c6b310-0a0a-11ea-a389-0242790999e0'>root://<span title='144.16.112.17:xrootd'><b>eos.tier2-kol.res.in:1094</b></span>//04/12018/d9c6b310-0a0a-11ea-a389-0242790999e0</a><br><br><br><b>Duration</b>: Nov 18, 2019 14:56 - <b><font color=red>continues</font></b> (66d 11h 39m until now) 233041 Storages : [ALICE::Kolkata::SE] - ADD test fails 2019-11-18T13:40:48.000Z 2019-11-18T13:40:48.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::SE]</b><br>ADD test fails<br><br>Duration: Nov 18, 2019 14:40 - <b><font color=red>continues</font></b> (66d 11h 55m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Mon Nov 18 <font color='#631BAA'><b>14:37:14</b></font> CET 2019</b></font><br> Duration: 4s<br> /home/monalisa/xrootd/bin/xrdcp exited with exit code 51: [FATAL] Socket timeout<br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> FWU4YUjj2iLBdIK5tQa0oIy+OoDfoU4yI-2smU74wCq2trk81u7ENpsTml8jjBewqWwEJ5yK0hdw<br> ZqPXNQ5xuOyI+39cSCXTZGYYwp7zsnk-9GKly5yQXrrAc05OX-U53M68auW6zdkgUY0mMP88EH+i<br> 79AjQzrI+TSP8BjviCE=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgIevcYJqacEsLc4P42+4+SPFDjYysbJFOAxYFQYZpfO0tMx1MRIUQrQAOwSu4AZOOswRxMS1<br> Tos9-F8Atin-049-TeTEAe+0UluGuKnH6EmGo62p3WGHMnihgtwhwFikITJSCylgj30DhkyfeKYS<br> 9TEjMTsWzM3H7-lD3AOTXqtNQVA4MmSZIiu+MaRK+xSRVMdQl3lagLSoBHdBJ-VfMyMl2Zx1UspW<br> HRibpKmgjA3QB1F32N4+LY1wov-oSYqjlQjKE-jWEmlmwED9bn1bQg+NkBiXWPNzO2XkS-bbHImt<br> hoPOErT20v9tMONjxd0QSUkjySdQ+ETJrOPokElOffd5Ytsf1Y-ci8r-YDsEhSm+wjCu0md2nUOu<br> Pokq0wFO11iSTaOP6NFeMpIFNB7aJRzR7IY2PlSUBcCd1-K8de5AExczwZzpmx-eCLaI5M9Giv04<br> 05sR90Jbw8iEl+rT58WQOVZzthOt+FhBjb4rch72+QdgL-4wCAcRg2-BL8Nu58cl2eUdP3e6GBZu<br> p6Z7KvjlxLleKW8jsdC-Z2ZcmkY1Dpzm1Ox7H9UMem33WAOegi2NM+MIKeqLt5m9TRRyeAUyPzx3<br> aumT4fqRNHmPCm38jW0fmHT9mrVnCNc9rcsTjwfZKoSvkVxwtROPSkAmbWLUUILYtsQ5ZiJRpkFL<br> Oy0A2-iMxmWScYbA9lTX8c4fuEcNphOO-lPoqHeKPD-vC9tavoSESAq1DPXAEgxbeorQCSBmwoOG<br> fJp3Cd45NdRVZjN+yXhwzTM6aSptZmHbWSZpE2CXkVQMwsnuGuuAAoF+64vuSc05A7+cvSbN4SbC<br> R+L+Glf3hHBwWvgguE8Jt1uwJeUItdxLyRfKKTUwxzoqzPSCPvOrek5Arx2hwdS68uLy4Zg-f5we<br> 5kTGR40wDvy1ECTYyXE2vAbeWWqGGd47WizHaS7Cvc3fUsUdBR7RCNoQd6iWxI+DEEITtiCtb5ZQ<br> +U89JgaWSRsJaXD-q5aRQElinUqVr6VVHHtgLM80HuuTju3ebkdTo5R33S6qG7YO7VZjf2DGCg==<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://dcache-server.tier2-kol.res.in:1094//13/27433/85b94870-0a08-11ea-a0d5-0242790999e0'>root://<span title='144.16.112.16:xrootd'><b>dcache-server.tier2-kol.res.in:1094</b></span>//13/27433/85b94870-0a08-11ea-a0d5-0242790999e0</a><br><br><br><b>Duration</b>: Nov 18, 2019 14:40 - <b><font color=red>continues</font></b> (66d 11h 55m until now) 232764 Storages : [ALICE::RAL::SE] - ADD test fails 2019-11-12T14:48:55.000Z 2019-11-12T14:48:55.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::RAL::SE]</b><br>ADD test fails<br><br>Duration: Nov 12, 2019 15:48 - <b><font color=red>continues</font></b> (72d 10h 47m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::RAL::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Tue Nov 12 <font color='#631BAA'><b>15:45:16</b></font> CET 2019</b></font><br> Duration: 5s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3009] Unable to do async PUT request. File creation canceled since pool is full; No space left on device</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> Oacy5IXq-FXhArsKeh-AbVqo2ho80oLYnmRblqbC6FugiKZNQc5dXDXTh58P7ffnR9RKERmFBFS4<br> zKo5hb3jXKwVerhvf12S1Cd8RGprWfYO14ICCr6ylefgF1GsuO7uIacv5X6Pm8Ae9R29Waoc+34u<br> NBzAhLETZC4ZX5a12-s=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgAaBl1wuB0UQU1RHfEQb3KjW5vvs2bFbji8EG-mRGtsSbmv-XAz4sUkeO+C9GjUZPJUhyqEV<br> nbyxTH-j5YOUyBZzHH55tIpiJ86CCa8ukE7Jdw9JC+JZA+y4jmPRkDKIe4Mzq-xZg2q93NZ+eggs<br> zhp5-va1Zw-wHBRN78pYeeGOXgvJAiS2drtJ1DoaWCvdhQK8m2jL2qva-YkZcq2yFLDjvdAYvJHh<br> 9pt8QKXyeVCig9rMXDoJceuL6Bp7lMlKfvp+HyefR97gS7v9rXIb6g+hYEB3hKEL5e9I0ReDGMo0<br> Sds5oY1-YneNiJ-YBLq5ThKXPBD3tn1A9zG53D7du9M+6gyKngCCcUSZ35zeryWwdJ7SLYpZRz7a<br> dTLin7-OtpYvnvYmsrIDoEhjJ6ZF1sPFFhImPHIKG1KwYZhj8XlBFyeT3I2j3tyibYG7TU+Z8fkT<br> Aun8dPoAjtWIQi7HlWFV-OsWiTUL1XBN3-jyTF7d2jfqLTZzKryc2z36qQPTiYbMcg18pMiD6ZMw<br> gMK08fo5xUMZJ5RNRebOJrDJLEmhjsXJQHiqpAq12TWFOHRSxDKp5u526b1hnH9ivmvJ9yzE6kBv<br> kYFyOoMFKGsXZXJnTU22iZQpIhUlM5MPwf8E3DrxjdRLh262-baJ0qYhz9p2vxq75rEGypjb7OgK<br> UVTRcy3tbmax-stFZ5lipfaV8EHN-zsI5k4rtKPKcF-DETiodQuXJEwFbZyWg0GoBHndfYp+ZI76<br> dLzfm59ZIrgG03ONKYl78k3jChIXpYcefSfb7WJohaxz8QCiSqFntp6kXVPrBOwJNORMlcNnajBi<br> 87cw2yu+AzjIqiLetxbV-OfjYQ-4kjppRMSi3OVHydOwn-cMQDav-Xp3LK42xbCay+UGo-yTwq+c<br> XFfzIHTeuwoYOHFG7b2cfJlWCY5jAcEVRzPDaLp9Vx3qk-jvhV06vbzJVw7cQqTeZ3Nfyv1WFFGS<br> rKtuZoi1t-FJV+JpkJSs7rOQV2U8BLYIVgAxBdRzVXQggoncM8+2z1fnYvtef4CVVPkbDBfjQ2eK<br> YzGRZ7tI4eMKJrcq4nqsgeMgf9jDGTK1nijvcAOa-xQb22jTduK-G3EsyWZD5LGB8gKpMy3KxO2k<br> VGoYxPU=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://cgendlf.ads.rl.ac.uk:1094//castor/ads.rl.ac.uk/prod/alice/disk/10/58045/078ac840-055b-11ea-8c2e-0242a3ceac7a'>root://<span title='130.246.182.36:xrootd'><b>cgendlf.ads.rl.ac.uk:1094</b></span>//castor/<span title='Cannot resolve this name'><b>ads.rl.ac.uk</b></span>/prod/alice/disk/10/58045/078ac840-055b-11ea-8c2e-0242a3ceac7a</a><br><br><br><b>Duration</b>: Nov 12, 2019 15:48 - <b><font color=red>continues</font></b> (72d 10h 47m until now) 232606 Site services : [Wuhan] - Monitor is down 2019-11-07T04:40:46.000Z 2019-11-07T04:40:46.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>Monitor is down<br><br>Duration: Nov 07, 2019 05:40 - <b><font color=red>continues</font></b> (77d 20h 55m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>ERROR: Could not get Config. (Error Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' ). Exit code 1<br><br><b>Duration</b>: Nov 07, 2019 05:40 - <b><font color=red>continues</font></b> (77d 20h 55m until now) 232376 Site services : [Phoenix] - MonALISA is down 2019-10-29T19:43:42.000Z 2019-10-29T19:43:42.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Phoenix]</b><br>MonALISA is down<br><br>Duration: Oct 29, 2019 20:43 - <b><font color=red>continues</font></b> (86d 5h 52m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Phoenix]</b><br>MonALISA is not running<br><br><b>Duration</b>: Oct 29, 2019 20:43 - <b><font color=red>continues</font></b> (86d 5h 52m until now) 232365 Proxies : [Tsukuba] - Alien proxy has expired 2019-10-29T11:15:05.000Z 2019-10-29T11:15:05.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Tsukuba]</b><br>Alien proxy has expired<br><br>Duration: Oct 29, 2019 12:15 - <b><font color=red>continues</font></b> (86d 14h 21m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Tsukuba]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fDC+3dch+2fDC+3dcern+2fOU+3dOrganic+20Units+2fOU+3dUsers+2fCN+3dlbetev+2fCN+3d374855+2fCN+3dLatchezar+20Betev+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Oct 29, 2019 12:15 - <b><font color=red>continues</font></b> (86d 14h 21m until now) 232364 Proxies : [Wuhan] - Alien proxy has expired 2019-10-29T11:15:05.000Z 2019-10-29T11:15:05.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Alien proxy has expired<br><br>Duration: Oct 29, 2019 12:15 - <b><font color=red>continues</font></b> (86d 14h 21m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fC+3dCN+2fO+3dHEP+2fO+3dCCNU+2fOU+3dPHYS+2fCN+3dJianlin+20Zhu+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Oct 29, 2019 12:15 - <b><font color=red>continues</font></b> (86d 14h 21m until now) 232076 Proxies : [Wuhan] - Delegated proxy has expired 2019-10-18T09:44:02.000Z 2019-10-18T09:44:02.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Delegated proxy has expired<br><br>Duration: Oct 18, 2019 11:44 - <b><font color=red>continues</font></b> (97d 15h 52m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Unable to get delegation Failed to receive credentials. ERROR from myproxy-server: certificate chain verification failed X509_verify_cert() failed: certificate has expired authentication failed<br><br><b>Duration</b>: Oct 18, 2019 11:44 - <b><font color=red>continues</font></b> (97d 15h 52m until now) 232075 Proxies : [Wuhan] - Proxy Server has expired 2019-10-18T09:44:02.000Z 2019-10-18T09:44:02.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Proxy Server has expired<br><br>Duration: Oct 18, 2019 11:44 - <b><font color=red>continues</font></b> (97d 15h 52m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': globus_gsi_gssapi: Error with GSI credential globus_gsi_gssapi: Error with gss credential handle globus_credential: Error with credential: The proxy credential: /var/lib/vobox/alice/proxy_repository/+2fC+3dCN+2fO+3dHEP+2fO+3dCCNU+2fOU+3dPHYS+2fCN+3dJianlin+20Zhu+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin with subject: /C=CN/O=HEP/O=CCNU/OU=PHYS/CN=Jianlin Zhu/CN=2031149731/CN=1453357366/CN=811364488/CN=1593813194 expired 23 minutes ago.<br><br><b>Duration</b>: Oct 18, 2019 11:44 - <b><font color=red>continues</font></b> (97d 15h 52m until now) 231118 Site services : [SPbSU-CC] - MonALISA is down 2019-09-19T15:57:24.000Z 2019-09-19T15:57:24.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[SPbSU-CC]</b><br>MonALISA is down<br><br>Duration: Sep 19, 2019 17:57 - <b><font color=red>continues</font></b> (126d 9h 38m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[SPbSU-CC]</b><br>MonALISA is not running<br><br><b>Duration</b>: Sep 19, 2019 17:57 - <b><font color=red>continues</font></b> (126d 9h 38m until now) 231029 Proxies : [Grenoble] - Alien proxy has expired 2019-09-18T08:40:54.000Z 2019-09-18T08:40:54.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Grenoble]</b><br>Alien proxy has expired<br><br>Duration: Sep 18, 2019 10:40 - <b><font color=red>continues</font></b> (127d 16h 55m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Grenoble]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: +2fDC+3dch+2fDC+3dcern+2fOU+3dOrganic+20Units+2fOU+3dUsers+2fCN+3dmmmartin+2fCN+3d697178+2fCN+3dMiguel+20Martinez+20Pedreira+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Sep 18, 2019 10:40 - <b><font color=red>continues</font></b> (127d 16h 55m until now) 230433 Site services : [alitraintest3.cern.ch] - Problem with CACHE 2019-09-02T12:46:58.000Z 2019-09-02T12:46:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Problem with CACHE<br><br>Duration: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (143d 12h 49m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Path: , usage: 100%, monitoring status: ok<br><br><b>Duration</b>: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (143d 12h 49m until now) 230432 Site services : [alitraintest3.cern.ch] - Problem with LOG 2019-09-02T12:46:58.000Z 2019-09-02T12:46:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Problem with LOG<br><br>Duration: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (143d 12h 49m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Path: , usage: 100%, monitoring status: ok<br><br><b>Duration</b>: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (143d 12h 49m until now) 230431 Site services : [alitraintest3.cern.ch] - Problem with TMP 2019-09-02T12:46:58.000Z 2019-09-02T12:46:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Problem with TMP<br><br>Duration: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (143d 12h 49m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Path: , usage: 100%, monitoring status: ok<br><br><b>Duration</b>: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (143d 12h 49m until now) 230278 Site services : [CORI] - MonALISA is down 2019-08-29T18:36:18.000Z 2019-08-29T18:36:18.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>MonALISA is down<br><br>Duration: Aug 29, 2019 20:36 - <b><font color=red>continues</font></b> (147d 6h 59m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 29, 2019 20:36 - <b><font color=red>continues</font></b> (147d 6h 59m until now) 229669 Site services : [CERN_HLT] - CMreport is down 2019-08-11T03:54:23.000Z 2019-08-11T03:54:23.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>CMreport is down<br><br>Duration: Aug 11, 2019 05:54 - <b><font color=red>continues</font></b> (165d 21h 41m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Cannot execute /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/bin/alien<br><br><b>Duration</b>: Aug 11, 2019 05:54 - <b><font color=red>continues</font></b> (165d 21h 41m until now) 229668 Site services : [CERN_HLT] - MonALISA is down 2019-08-11T03:48:43.000Z 2019-08-11T03:48:43.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>MonALISA is down<br><br>Duration: Aug 11, 2019 05:48 - <b><font color=red>continues</font></b> (165d 21h 47m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 11, 2019 05:48 - <b><font color=red>continues</font></b> (165d 21h 47m until now) 229251 Site services : [CORI] - Monitor is down 2019-07-30T17:06:38.000Z 2019-07-30T17:06:38.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>Monitor is down<br><br>Duration: Jul 30, 2019 19:06 - <b><font color=red>continues</font></b> (177d 8h 29m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. Jul 30 09:53:32 info Reading the configuration file from /global/homes/a/alicepro/.alien/alice.conf Jul 30 09:53:32 info Error reading the config file /global/homes/a/alicepro/.alien/alice.conf: Error in config file /global/homes/a/alicepro/.alien/alice.conf, line 2: unable to parse line at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 162 Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. cori21-224.nersc.govPinging service ClusterMonitor... The service is running at cori21-224.nersc.gov:8084, uri ClusterMonitor Attempt 1 (Tue Jul 30 09:53:32 2019) Use of uninitialized value in pattern match (m//) at /global/homes/a/alicepro/alien.v2-19.446_new/scripts/pingService.pl line 115. Attempt 2 (Tue Jul 30 09:53:37 2019) Use of uninitialized value in pattern match (m//) at /global/homes/a/alicepro/alien.v2-19.446_new/scripts/pingService.pl line 115. Attempt 3 (Tue Jul 30 09:53:42 2019) Use of uninitialized value in pattern match (m//) at /global/homes/a/alicepro/alien.v2-19.446_new/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to cori21-224.nersc.gov:8084 (connect: Connection refused) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Jul 30, 2019 19:06 - <b><font color=red>continues</font></b> (177d 8h 29m until now) 228737 Site services : [CORI] - CE is down 2019-07-17T17:47:58.000Z 2019-07-17T17:47:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>CE is down<br><br>Duration: Jul 17, 2019 19:47 - <b><font color=red>continues</font></b> (190d 7h 48m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>/bin/bash: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/bash) /bin/bash: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/bash) /bin/sh: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/sh) Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. /bin/bash: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/bash) /bin/sh: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/sh) Jul 17 10:45:57 info Reading the configuration file from /global/homes/a/alicepro/.alien/alice.conf Jul 17 10:45:57 info Error reading the config file /global/homes/a/alicepro/.alien/alice.conf: Error in config file /global/homes/a/alicepro/.alien/alice.conf, line 2: unable to parse line at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 162 Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. cori21-224.nersc.govDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Jul 17, 2019 19:47 - <b><font color=red>continues</font></b> (190d 7h 48m until now) 228579 Site services : [NIPNE] - MonALISA is down 2019-07-11T06:37:20.000Z 2019-07-11T06:37:20.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[NIPNE]</b><br>MonALISA is down<br><br>Duration: Jul 11, 2019 08:37 - <b><font color=red>continues</font></b> (196d 18h 58m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[NIPNE]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jul 11, 2019 08:37 - <b><font color=red>continues</font></b> (196d 18h 58m until now) 228380 Site services : [Kosice] - MonALISA is down 2019-07-02T16:34:57.000Z 2019-07-02T16:34:57.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Kosice]</b><br>MonALISA is down<br><br>Duration: Jul 02, 2019 18:34 - <b><font color=red>continues</font></b> (205d 9h 1m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Kosice]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jul 02, 2019 18:34 - <b><font color=red>continues</font></b> (205d 9h 1m until now) 228015 Central services : [aliendb06f.cern.ch] - mysql at aliendb06f.cern.ch is down 2019-06-25T07:49:17.000Z 2019-06-25T07:49:17.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06f.cern.ch]</b><br>mysql at aliendb06f.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06f.cern.ch]</b><br>mysql at aliendb06f.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) 228014 Central services : [aliendb06f.cern.ch] - mysql2 at aliendb06f.cern.ch is down 2019-06-25T07:49:17.000Z 2019-06-25T07:49:17.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06f.cern.ch]</b><br>mysql2 at aliendb06f.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06f.cern.ch]</b><br>mysql2 at aliendb06f.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) 228013 Central services : [aliendb06g.cern.ch] - mysql at aliendb06g.cern.ch is down 2019-06-25T07:49:17.000Z 2019-06-25T07:49:17.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06g.cern.ch]</b><br>mysql at aliendb06g.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06g.cern.ch]</b><br>mysql at aliendb06g.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) 228012 Central services : [aliendb06g.cern.ch] - mysql3 at aliendb06g.cern.ch is down 2019-06-25T07:49:17.000Z 2019-06-25T07:49:17.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06g.cern.ch]</b><br>mysql3 at aliendb06g.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06g.cern.ch]</b><br>mysql3 at aliendb06g.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) 228011 Central services : [aliendb06h.cern.ch] - mysql at aliendb06h.cern.ch is down 2019-06-25T07:49:16.000Z 2019-06-25T07:49:16.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06h.cern.ch]</b><br>mysql at aliendb06h.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06h.cern.ch]</b><br>mysql at aliendb06h.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) 228010 Central services : [aliendb06h.cern.ch] - mysql2 at aliendb06h.cern.ch is down 2019-06-25T07:49:16.000Z 2019-06-25T07:49:16.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06h.cern.ch]</b><br>mysql2 at aliendb06h.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06h.cern.ch]</b><br>mysql2 at aliendb06h.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (212d 17h 46m until now) 227880 Site services : [CERN_HLT] - Problem with TMP 2019-06-19T07:36:49.000Z 2019-06-19T07:36:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Problem with TMP<br><br>Duration: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (218d 17h 59m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Path: /var/lib/aliprod/ALICE/tmp, usage: 95%, monitoring status: ok<br><br><b>Duration</b>: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (218d 17h 59m until now) 227879 Site services : [CERN_HLT] - Problem with LOG 2019-06-19T07:36:49.000Z 2019-06-19T07:36:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Problem with LOG<br><br>Duration: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (218d 17h 59m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Path: /var/lib/aliprod/ALICE/log, usage: 95%, monitoring status: ok<br><br><b>Duration</b>: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (218d 17h 59m until now) 227878 Site services : [CERN_HLT] - Problem with CACHE 2019-06-19T07:36:48.000Z 2019-06-19T07:36:48.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Problem with CACHE<br><br>Duration: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (218d 17h 59m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Path: /var/lib/aliprod/ALICE/cache, usage: 95%, monitoring status: ok<br><br><b>Duration</b>: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (218d 17h 59m until now) 227710 Site services : [CERN_HLTDEV] - MonALISA is down 2019-06-11T08:31:26.000Z 2019-06-11T08:31:26.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLTDEV]</b><br>MonALISA is down<br><br>Duration: Jun 11, 2019 10:31 - <b><font color=red>continues</font></b> (226d 17h 4m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLTDEV]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jun 11, 2019 10:31 - <b><font color=red>continues</font></b> (226d 17h 4m until now) 227229 Storages : [ALICE::ICM::SE] - ADD test fails 2019-05-29T07:34:32.000Z 2019-05-29T07:34:32.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ICM::SE]</b><br>ADD test fails<br><br>Duration: May 29, 2019 09:34 - <b><font color=red>continues</font></b> (239d 18h 1m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ICM::SE]</b><br>ADD test fails<br><br><b>Duration</b>: May 29, 2019 09:34 - <b><font color=red>continues</font></b> (239d 18h 1m until now) 227176 Site services : [GRIF_IRFU_ARC] - MonALISA is down 2019-05-27T16:39:07.000Z 2019-05-27T16:39:07.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU_ARC]</b><br>MonALISA is down<br><br>Duration: May 27, 2019 18:39 - <b><font color=red>continues</font></b> (241d 8h 57m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU_ARC]</b><br>MonALISA is not running<br><br><b>Duration</b>: May 27, 2019 18:39 - <b><font color=red>continues</font></b> (241d 8h 57m until now) 226712 Proxies : [MEPHI] - Alien proxy has expired 2019-05-20T12:19:10.000Z 2019-05-20T12:19:10.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Alien proxy has expired<br><br>Duration: May 20, 2019 14:19 - <b><font color=red>continues</font></b> (248d 13h 16m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fC+3dRU+2fO+3dRDIG+2fOU+3dusers+2fOU+3dspbu+2eru+2fCN+3dAndrey+20Zarochentsev+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: May 20, 2019 14:19 - <b><font color=red>continues</font></b> (248d 13h 16m until now) 226171 Site services : [MEPHI] - Monitor is down 2019-05-03T21:40:30.000Z 2019-05-03T21:40:30.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>Monitor is down<br><br>Duration: May 03, 2019 23:40 - <b><font color=red>continues</font></b> (265d 3h 55m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' Syntax: pingService.pl <serviceName> <logDir>. Exit code 1<br><br><b>Duration</b>: May 03, 2019 23:40 - <b><font color=red>continues</font></b> (265d 3h 55m until now) 226169 Proxies : [MEPHI] - Delegated proxy has expired 2019-05-03T21:36:03.000Z 2019-05-03T21:36:03.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Delegated proxy has expired<br><br>Duration: May 03, 2019 23:36 - <b><font color=red>continues</font></b> (265d 4h until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Unable to get delegation Unknown host "myproxy.cern.ch" Unable to connect to myproxy.cern.ch<br><br><b>Duration</b>: May 03, 2019 23:36 - <b><font color=red>continues</font></b> (265d 4h until now) 226168 Proxies : [MEPHI] - Proxy Server has expired 2019-05-03T21:36:03.000Z 2019-05-03T21:36:03.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Proxy Server has expired<br><br>Duration: May 03, 2019 23:36 - <b><font color=red>continues</font></b> (265d 4h until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': Unknown host "myproxy.cern.ch" Unable to connect to myproxy.cern.ch<br><br><b>Duration</b>: May 03, 2019 23:36 - <b><font color=red>continues</font></b> (265d 4h until now) 225650 Site services : [HPCS] - MonALISA is down 2019-04-11T20:04:59.000Z 2019-04-11T20:04:59.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[HPCS]</b><br>MonALISA is down<br><br>Duration: Apr 11, 2019 22:04 - <b><font color=red>continues</font></b> (287d 5h 31m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[HPCS]</b><br>MonALISA is not running<br><br><b>Duration</b>: Apr 11, 2019 22:04 - <b><font color=red>continues</font></b> (287d 5h 31m until now) 225502 Site services : [LBL] - MonALISA is down 2019-04-03T21:15:32.000Z 2019-04-03T21:15:32.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[LBL]</b><br>MonALISA is down<br><br>Duration: Apr 03, 2019 23:15 - <b><font color=red>continues</font></b> (295d 4h 20m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[LBL]</b><br>MonALISA is not running<br><br><b>Duration</b>: Apr 03, 2019 23:15 - <b><font color=red>continues</font></b> (295d 4h 20m until now) 225400 Storages : [ALICE::MEPHI::EOS] - ADD test fails 2019-03-30T02:16:59.000Z 2019-03-30T02:16:59.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::MEPHI::EOS]</b><br>ADD test fails<br><br>Duration: Mar 30, 2019 03:16 - <b><font color=red>continues</font></b> (299d 23h 19m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::MEPHI::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Mar 30 <font color='#631BAA'><b>03:13:10</b></font> CET 2019</b></font><br> Duration: 0s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3009] Unable to get free physical space /eos/alice/grid/02/16883/5d5f1a00-5291-11e9-8f73-0242266c4d21; No space left on device</font><br> <br> Full command was:<br> [/home/monalisa/xrootd/bin/xrdcp, -DIFirstConnectMaxCnt, 2, -DITransactionTimeout, 60, -DIRequestTimeout, 60, -DIReadCacheSize, 0, -N, -p, -v, -f, -P, /home/monalisa/MLrepository/bin/setesting/testfile, -ODauthz=-----BEGIN SEALED CIPHER-----<br> HJCztPNi9E+QKiVZogsp-5sdhYPEEythXN8X7wYS5rwJwdsx2G9+ShYnDqXxZPH25jOyHVU8CT5q<br> zT1HtL2aDOuCg4YhiRmn8OYId2eiyl6ZKjGvSf-1uOLuaJoz+FZtrdOVWzSYOBbV-UjaUmj1LPM-<br> SLdjzqoo+gIWvxSrs3U=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgDb0O2U3t541LGvTz+CBZtRcI897F7RWfvdtZCG1qseokpnHaIdABgJI9oX87GMJWd5Y9fEK<br> btw7RRsoyDbkQF4qPsDpZDtS6pzrrkOaDYWrk+qvJHfzZ7SpcNnXtwg0eHokGJ2yf6+udWiG+iez<br> r5yYnUyRPm4Ra+v+CSyb8SdRVmpx2d8kBT4cxINLeo9qE6ZXpfvT6jYQXzMQOKGDrJ1mYGJZ2gUa<br> SnLdol-r3hO+FqbSCKEJ9D-NGSpI2MbKRPKoQDLvFBjaZuzC3s6NR9s5TKkGSDWNo1qP9r5ZJqYW<br> N4REihpz9npttcph-5udexWFTrExmiCPNMozOizq3R+cR3SHNr9JJVgyNLVwfU-kFV3T-hE0miKg<br> GINzf2+bK-SpeU3g6vouLtCcy+q1lgg9CrDFt7UYJMVofjbJrcMgSV0I120zue98GGcrDsu4pZlg<br> HCGxwg43-ORuv01O3Zd5h7I5MJeNq78GoMrFfkxNAiMgKfnOJuHKa5WxFcpxPXAwyTTdmoM2kqGH<br> zh2GgbcVs69BRWiFwuaF7sAeAI-9kR8OZmftiHsqH01cFtgAmlalsS4RFnR+jc9fU7j4AgAEGlxh<br> +MUhZdvaOAhWBZSGoSi2YWMAQM57pMGOU1YY7YpWh9ayenUviJ6Of+HhX3rRhpKc6DN-UhNpL-1g<br> nkhjVccKUd8ftNhITHs8a9wQvsQxA9r9wGYI3Kpur0nfiz6PWfHGojBRKHVlcQRdsD1q5D0CVL-Z<br> DrDuZDPbi-1UDfBk6UI+BQ1AELCdedUkWw0ecl+GueAp+983gV7ylmBCWHbdEnPWv-ve6eZyAzsu<br> 86Sc8N3-I0Jn1B-cYFXiJJCZDX4F1KmIs+nQGQ6LaZo+8B6INDJfISRDRhm+tpiB7B+HypNpVhnw<br> q7hq8BZ3+4LMgTMTq+9d7-ZE56nK+bGtEXyjCUakLN9ArOpxYJsdwR5DQk86AHtEjE2YjPu0FHbE<br> rCxZIgUloHgTh8OCt27SbXJ3aIgtR6zoQgk3QdEFtqjhiUjSkRciBiiw46NlHCo=<br> -----END SEALED ENVELOPE-----<br> , <a target=_blank href='root://se10.lxfarm.mephi.ru:1094//02/16883/5d5f1a00-5291-11e9-8f73-0242266c4d21'>root://<span title='85.143.115.44:xrootd'><b>se10.lxfarm.mephi.ru:1094</b></span>//02/16883/5d5f1a00-5291-11e9-8f73-0242266c4d21</a>]<br><br><br><b>Duration</b>: Mar 30, 2019 03:16 - <b><font color=red>continues</font></b> (299d 23h 19m until now) 225304 Storages : [ALICE::LBL::EOS] - ADD test fails 2019-03-28T05:40:42.000Z 2019-03-28T05:40:42.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::LBL::EOS]</b><br>ADD test fails<br><br>Duration: Mar 28, 2019 06:40 - <b><font color=red>continues</font></b> (301d 19h 55m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::LBL::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Mar 28 <font color='#631BAA'><b>06:38:50</b></font> CET 2019</b></font><br> Duration: 1s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3009] Unable to get free physical space /eos/alice/grid/00/60059/c3558780-511b-11e9-a27c-0242266c4d21; No space left on device</font><br> <br> Full command was:<br> [/home/monalisa/xrootd/bin/xrdcp, -DIFirstConnectMaxCnt, 2, -DITransactionTimeout, 60, -DIRequestTimeout, 60, -DIReadCacheSize, 0, -N, -p, -v, -f, -P, /home/monalisa/MLrepository/bin/setesting/testfile, -ODauthz=-----BEGIN SEALED CIPHER-----<br> qEBkqvD9WoBJPobQHaBTG9AnCUnmOYIiMiGjU+pplxKiOg0OxNx3fjoMFlpP6QmeC9AYj3xJ5z58<br> 9hYleMn3PCPd7cFn+rAMTSicVGF9q8X-aAb7-QWwWxT01URSmQTLIT3QKbnU1E-faHWtA1XcPHAi<br> Y17DZt-0QxmvTXxpU60=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgH5e27jEA2eKSR6zrAwg3nYL00onv+cfFv-qVejF8O+vs0fSenVcXWu1+jN1gfIzV6V2nazR<br> XH6xzdlBNjveFSix2zDDXHA4gxbs6cJxKomhSt1JvYAunLfYR3y8NYLnCvY7+hjLLS6N7gQnlwP4<br> H9CBU+EkRCm1MBDP03gOP874xduKlnyF5-X-+wnrWtm0mRommmlTuVN-fTaMHAbFwFuk-krh4pjq<br> Cs8MVo76WOGDz2BoPfqT5wfvrslA2nLkBzDchEchbYJeVL5nFDHmybGo8VUQYbbcfDsQvmX7mRjm<br> YHZUHTMjYnQpE1SAzDbVGTN23qewmjUOdn9ql4G6DDPxfhbRldvHXzmHpWSdQpAJq-sm7pAaexrb<br> +kN+SONXaTZy+K-xF9Sq9Di-huiJfYLNrvy+Lyp-qdvFEQTKlSJuk8-4YfRCsUC5xQzx-kXoluTi<br> c1DRmxtuF8MOROkIfEE2jPIttZkDLlhTGxqzEKDyjWkBd1NfYH6kFoSgHVEzNvg0Fks2qTCB79Hd<br> R6+4kzTLv7aF16QpA9h1usMVC5Su5yEGf4niTcF0awrV6EKPH2S7u12UGQYsNjqfrtLZwVZ5uNFl<br> PMcB2LHGlWx-K33JZWVq07mM5wnIInpkWIqsSlGU38W-sEp7vEElGVPWRC5vLiQBcNdb3WssuXkc<br> EcBVMvNV0p5uYwyX98JHJIbZLs1DfrCZ+8NnnQAtyvLdF803yuNibjbdHMeTTg1W7oC8IUitjrdc<br> 8WVs2qPlKxGaUWUgtyK7lVv9Uv4cZ-PVm9jO+o+wu1v5rOJPuVcZTRz5NH4OW2unMdaD9buQxV9X<br> siLcy67C4Z6oD8Sfr1Ik4aS1YqvvYsDxRMEj6HqaZheFLjB78aEvvw066M0C0zbw2NnK1cuCTEwY<br> A0oWm2B4hkfjyGgJGq5-iUu1zRsQmgtPql6FYZBd4B73LSUHGWZ2bddtejmNKpveHQY6ZXfbRZK0<br> tRBolz83T-qNCsDRxTbutJKf8svVR9dETIJwlzIquUiR-rKeWh3Q<br> -----END SEALED ENVELOPE-----<br> , <a target=_blank href='root://eosalice.nersc.gov:1094//00/60059/c3558780-511b-11e9-a27c-0242266c4d21'>root://<span title='128.55.160.182:xrootd'><b>eosalice.nersc.gov:1094</b></span>//00/60059/c3558780-511b-11e9-a27c-0242266c4d21</a>]<br><br><br><b>Duration</b>: Mar 28, 2019 06:40 - <b><font color=red>continues</font></b> (301d 19h 55m until now) 225205 Site services : [Cyfronet] - Problem with TMP 2019-03-27T00:06:39.000Z 2019-03-27T00:06:39.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Problem with TMP<br><br>Duration: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (303d 1h 29m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Path: /home/alicesgm/ALICE/tmp, usage: -1%, monitoring status: ok<br><br><b>Duration</b>: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (303d 1h 29m until now) 225204 Site services : [Cyfronet] - Problem with LOG 2019-03-27T00:06:39.000Z 2019-03-27T00:06:39.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Problem with LOG<br><br>Duration: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (303d 1h 29m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Path: /home/alicesgm/ALICE/alien-logs, usage: -1%, monitoring status: ok<br><br><b>Duration</b>: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (303d 1h 29m until now) 225203 Site services : [Cyfronet] - Problem with CACHE 2019-03-27T00:06:38.000Z 2019-03-27T00:06:38.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Problem with CACHE<br><br>Duration: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (303d 1h 29m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Path: /home/alicesgm/ALICE/cache, usage: -1%, monitoring status: ok<br><br><b>Duration</b>: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (303d 1h 29m until now) 221532 Site services : [Prague] - MonALISA is down 2019-01-23T19:07:31.000Z 2020-01-23T19:07:31.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2019 20:07 - Jan 23, 2020 20:07 (365d 0h) <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2019 20:07 - Jan 23, 2020 20:07 (365d 0h)