ALICE ML Repos - All events http://alimonitor.cern.ch/ml2.jpg http://alimonitor.cern.ch/mona.jpg 2019-12-14T23:02:36.000Z Costin Grigoras Costin.Grigoras@cern.ch http://alimonitor.cern.ch/ All events recorded by MonALISA 234170 Storages : [ALICE::ITEP::SE] - ADD test fails 2019-12-14T22:52:13.000Z 2019-12-14T22:52:13.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ITEP::SE]</b><br>ADD test fails<br><br>Duration: Dec 14, 2019 23:52 - <b><font color=red>continues</font></b> (32 min until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ITEP::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 14 <font color='#631BAA'><b>23:48:05</b></font> CET 2019</b></font><br> Duration: 13s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] Unable to write file; eligible servers shunned.</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> fa+pkj20bFeKXYAQIEj8mVA89Aplj-yRwL5SkOe1xrsf8gKF9-7tb9t1Ov6+F5UxOuq6V5wGeLHd<br> 8nDTGYG885iRFy4ZU0AJLYU6d+-wlc6FjLVlTpncGkT0ERBFmc5A0x5ECl6kchm467k2N70Os77B<br> O8mHzgiAJcUSotSwyrg=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgHH0jMYK5pzKPeuvDzp3XNr+K5+0EEdOSWcObr54yElwBjG2bNHyhAgfS3XgFDBeuW639BfG<br> oUOGNNP-z+8OzkYb873lWwosBR2GaUopdRFCqcnJ+utkeJM-GfQcyBnlbPu-Wc9LdWCnTEzhAojX<br> jH6sWbF+eyhz1imAlXR25OO4lmFv07Ghf+O4dqP1I+VKSGlnfgwdm2gDopJLl+oJ3O4AUMp5rPrU<br> cjBVE21stJitrn8A7chXQ6xCl4sTBz4ZOyoL6RnKoMElHPHQcTCCe+25HNZyseoy0U4pqC+bL4mP<br> 3TuG7CPMFqAamFgLMElpt07RVdW7U2GsjGhSFh0kKwGe6E2r3eOZkO+wUCID4Vuc4ZSy5LFmfl-t<br> Zw+WueQIiTKq6KwLT0AFCoIzpzYQGTkflCmQs3FzI-XXRs+dGQU080B92gZRUrhFsw8SDDLPS1-M<br> ZJgiwzlYnn90UjpBZcob-NDEJIs061TbVaW07ejjteIyEKZh1WwhcleoJ1LnbyWIFVbmNyRSOlDb<br> WMK2MOgk7z9n7LmDEqQac3516UTQnkPVrFL6R-ALtA0Z5OdnFAX+ThHWdH6sfUMSOpdNcQ4+yT9G<br> Smtb+gEORiJ6-WcD82sMSOeMfE2yxHXuEV5Lb+2eyCr369PQz5n-zm06gob0Dv+sa1KX4tKeA7qr<br> 9pc2sGLza22sUGXKEzZRrq-QzKP4FxdYFyRfvQ4yxnEFpMXsFa6OXuk1aKoFe9+CF-EeBfCqe5Fu<br> cEWnARWI+VGq1ptBLPAf5zwmtnhdUsb30H-L+k4zzCm+4a3pnEi92K9J9TJ0VKwTWv4x63aeJVxk<br> C6XHtAELnIAgHXzQd82Lvs6HOwrTg5FKWWMOfvcVbiYHlbAJODIC-DMCzoENUsmSBnZKsLtGl3XC<br> aJM-ovfU6UOGRUmlBuQ9miGiOtu9tKKH1To2qFwVm25y+b+VgfsRhr-kjLy-9jRkuOQvsKqzMtLt<br> 6ZCiSUIfZ0xjyix+DiwpD29SuCiuhBwcZL7SHMDPRSHRuyCbjpE6<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://senf04.itep.ru:1094//02/47741/c2a460b0-1ec3-11ea-b719-0242790999e0'>root://<span title='194.85.69.126:xrootd'><b>senf04.itep.ru:1094</b></span>//02/47741/c2a460b0-1ec3-11ea-b719-0242790999e0</a><br><br><br><b>Duration</b>: Dec 14, 2019 23:52 - <b><font color=red>continues</font></b> (32 min until now) 234169 Storages : [ALICE::NDGF::DCACHE] - ADD test fails 2019-12-14T22:05:26.000Z 2019-12-14T23:02:36.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::NDGF::DCACHE]</b><br>ADD test fails<br><br>Duration: Dec 14, 2019 23:05 - Dec 15, 2019 00:02 (57 min) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::NDGF::DCACHE]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 14 <font color='#631BAA'><b>23:00:10</b></font> CET 2019</b></font><br> Duration: 18s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3012] Internal timeout</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> khrvRucNSbN+fHLjXYmP69G1+OTdwKO1yXa8NK7QrBO40UvRIcBO6SVtQb0glQsQkRzQ9ZcB6pis<br> jDhBCBSKytbUHm4tj4IdymaUQ0VP81yxAUB2QbGVy4Nkpu3kDCQYT-YaE65x+i7eEsfDgqIfs4Ry<br> v8WSd7Q2ZrvD9YT2XjA=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgK22GqUM46sCcGIhn0L30YdiVDC7d6BO7FNFfn0tsddEmu1s50hdtZqb5ZY-93vf8fmb7trU<br> 3YPQuA28yz--GPQ0QymPD2ofgW-tF9+J1Bg6lqKOtY0r+-fczZ93d2uRFYW-nokYQ32tIVkIEs-J<br> 0jmVxmVQj31rNYLgTNpKuUXQESc4CNWjXUouRrgJqHizpJxqi07NxPuxqAIUfY+mqQgOFe4rZiM9<br> aqmpwqUoTBuXU8ejdKQN4GPyqpMgS7Fz8pDdYdC53CC-BBz-aNEzB1flXqxEJcCkGKCRFDMA0pGK<br> MwQkafYJpXFT8qPLxgVVp6Bs9aFRYPJvf8fh1MSAN4n9pkYHWdDhhmo6sFP2SIkY6zMyb2W6UcPE<br> cW6sYAiwifjDexMZFaJsqImpA+NRAa8zd5ZbQBqc4yGMEbFoqWVYgH8p2LaI+lHjkEdEtogXDHld<br> j3NXUcxc6mPMOemyStWaNMPzeGIRwMxBGF06LaoXNplIIz8ft54gbczeYVdwIysJrVtJY9tX8RR8<br> v9mzMJf56SzDK7hag21WXr93Tpf7V5u4fat6dtWL-Xebdpd7M9fbgWaH6PX8UqypXmWNolZNa0lZ<br> +MBSa4L+MnhuhUpZmSmAYp+rtzu0nJlAlxvYCnCpBsdrMfu1gJWSi4zQxMfayR-FajHrDhQaz68-<br> +hYZUQ-5f8hkU4eZs3svGD4jeU6nYZm415RMoAE-QhtQ43wZUQktzTmCv+MCUhMHbU-IegaD-QL-<br> PG2i47KxLZCCiwQ1jleM-Cjp4uUBrYvZCh9d6F++i76wsKpze-B-OYcRX8HELQqUTXFkxLKFI6gE<br> n7OfWbNvZrMamVIeOOQ3tBq98z7Qywe8u8XMGWrb5x5bJGxhoYlI7KDqM2g9aolhrH+G4d6zSItM<br> HezbVWrMtbyH5Tzr8MBXzppFhlpEN52753ocCasaiK5R3q38v52jyVTrywKdpDszJ7M+JR4yo1t3<br> gEoZDCyuL8VtmN7K+tDnCn5NH5ZwDiNq7a7g0THmk-PZVVRaywt1J6NbLlcgm9jnEA3PMkfPCoB1<br> vQD98y5r<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://srm.ndgf.org:1094//NOLFN'>root://<span title='109.105.124.162:xrootd'><b>srm.ndgf.org:1094</b></span>//NOLFN</a><br><br><br><b>Duration</b>: Dec 14, 2019 23:05 - Dec 15, 2019 00:02 (57 min) 234168 Storages : [ALICE::ITEP::SE] - ADD test fails 2019-12-14T17:50:20.000Z 2019-12-14T18:52:58.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ITEP::SE]</b><br>ADD test fails<br><br>Duration: Dec 14, 2019 18:50 - Dec 14, 2019 19:52 (1h 2m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ITEP::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 14 <font color='#631BAA'><b>18:48:05</b></font> CET 2019</b></font><br> Duration: 13s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] Unable to write file; eligible servers shunned.</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> CLiEFRb3DfXWemyjegQr9j9eYEKrPb7NLMgoh3JDAhjG9rVw6ON-PiMK5xRec5sLICpXd66kIuu3<br> PplDQvGUorim2pSju1ZTj4UOB7c5-0oLg0T6wUlpLwrEYPlcVHHQPl3HRrVec13WmzRSTjEMtH4g<br> 6fb+2kPqrSY2CDac-0o=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgAOnzJPGPAYl5-UIwtxB7-6e5IoLFT0SbPnjPnoGWK5t9QTltfdtfcs7E88H7uZ1WoBHkY9w<br> iCsVy9K1mFaIVnwDPERgwvVF3XpGQpBgDFYVtWweRzDU5cvqPBMJK5gUFbmNo-F4WYcruVhpz2k9<br> WnT1rtzLcrcYXPICxNx68ATZjOaMwAvG67d2amqOTN-Vb2yo4Xgy5u6x-xahCjKigDPaGAPBnA8f<br> UnqOHeWCYYFepBJqaU2GKOceg6Ie+D-aIQh-3ZMrHOlLOTrP31dJ1WoDXtOnMph97tdXlRY-p-S9<br> boMjwGJbHr1yJcZURgM4JE2IYBPep6sm5awucVWRFNLznC1p-DQiYnjBT9LiQ8esRcbc2GzO2zE4<br> tFyhG9dMypKugoe2yyC2+t3sSN6fUBN65PhgKhZmDVB5X8fYushZF0pPPf-Md1WMu09rhup8WevM<br> OEE4VdXvs0AXytIKoQDHidd+j8hB-R-dRoPQKR6w2ClpiMtZrI-3XUiuy05NizLBt+gxnZ+A++Ha<br> ZVkAah94G5jZlEJZC+kV1j5svOUlhvD6qazpVT59ONOOU1JpUxSQmpdDlnVqPLgvhyHKGxwo1RTZ<br> nBhtuC71o+e2sGGZsHePZeIaDspiYjy7Za-c8+5vMwOTpBPi5g+c2PCMxPYj7krNx4csqqW7uVRh<br> YRtVj2eRY2eihazhb-OVdh-y7aWdi2O95XE80fKjQWxwPZBsdQm5vO65whDKdR61vVvSQdNUljnJ<br> Gg2cr9XvsxCmMih2Ggz7hOf37RMf9VOa4vIOOlGUNybgut6p9yndv5ODRZdXLtnL2JGFfJ9pyuho<br> 8Zeek5gshryyvPnNAATgpo2-m5CfzfhgZsBAvGV3svmF0G2i4cRucarEyJq9pMNcxJRd9Z1Gd6nP<br> aX+1IOwhawgi7HQmVcrdPhrOqN41n30sWKW1iT7aC4JRpsWDQ+n8gzJF1e1229E-4s0CGX+PGbxy<br> 9N4eJZSFQMXChDnqsiUaUCKYub4zE1gTtkY8m9wZDCJAqTxLYFry<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://senf04.itep.ru:1094//03/23632/d9ce7fc0-1e99-11ea-87ac-0242790999e0'>root://<span title='194.85.69.126:xrootd'><b>senf04.itep.ru:1094</b></span>//03/23632/d9ce7fc0-1e99-11ea-87ac-0242790999e0</a><br><br><br><b>Duration</b>: Dec 14, 2019 18:50 - Dec 14, 2019 19:52 (1h 2m) 234167 Storages : [ALICE::ZA_CHPC::EOS] - ADD test fails 2019-12-14T17:08:36.000Z 2019-12-14T18:06:00.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ZA_CHPC::EOS]</b><br>ADD test fails<br><br>Duration: Dec 14, 2019 18:08 - Dec 14, 2019 19:06 (57 min) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ZA_CHPC::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 14 <font color='#631BAA'><b>18:04:53</b></font> CET 2019</b></font><br> Duration: 1m 1s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> ZafDuv6-karqH09dE2al7vhUYqrV4snq-MpUxzdgjYF0jwB4wNrYjVgtXEdGzyZKyhoaXEtQqY1l<br> QyzTZ4a-SngFSo4rZfttJ+U5TyWClgIHXsEfuhBuhkEWgRbAkwceYzYxk-hlfUwlDFt-Q550ov1m<br> raA7cFzL+i2rK3A4mrI=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgEz5bU27pkWjZVnnzXoblysrW6c3rPPqmE1NMgO9SONKiNempl0k6KSJ5wgq+ollMvteBVjO<br> JJ9fLNCenFccx7zFiyJlk9mHRzjWmZTbEdCkAiNeN78gfLWBRTw8Zpp4RFqN24WH34c6dKpIUKpN<br> AOBTzXG1KAd7Nj8moMHijJYQkePBh95YOGx7za57nTNNYDRKNCnCbcHHe3m4FChGSsgnw+32mW4Z<br> jfWOeeDMKralGjeAKJdTulFmgmZsMhFb8cFCDweiaJnU9Qj0yv3z+hBxATq8dRV6mNBRRGhCG7Yo<br> Hlvpvz2r4aKqlHqnV6uOT5aTEl9QR5gd5yJCS1T44cMOgSzWwV-Uyq9uJK-PGXlGVUN36PBmBTVB<br> Zl+HNmjd7BLyDPgJ0TpdQQdSKxr83VP+xhqrouwxP2JqlgC9TcoBkkAcWk1WuR5-2UQNpg+IefK5<br> zqs17BrDpH4T2aqtztT7G5RWjBiTKoRacAmL1uSDMg2-BGN2dp5Cqtmazn2V9UTrVi0XO+ECg5Vn<br> 80NZueQE64JEQ3Lg9oY47zfftUIXFHJ-WbNX4urESZ5Gi64LWGmlLesIcK3FiAqtUwLwywimT0qn<br> tZjuZXwJdq-7GaLtR67cYbmd7T9RvcnzSY6JXyiqTN5PiGidU9pp3USdjO5SxJteiGuaCw0xLbTc<br> N4pv7zLyvkzbIKEQIWwc734YrGrm-NAX6T+im4PQCHJTkSlS-wNbxAS3buxrpqzPtJBVhkQHH7ux<br> W0ycoN0bHAv4Hd+PiZB5OIyLivAodS1bDwP2dR99zzD4wcPxoWvVaKq-jFKa+5GByfIMwT+L0ZUl<br> -FUdaSG7HhqpodUKbcKL2CFQzNrSSUTTKVcW63mKGTptrcs4UWCJGGEPXqryyDlrghEbfVX-1H-3<br> swL9Csr75-1wjOPi-Y245Rd+3TMu+OFKhe3Q7Ms661QB0JfcR6Ka9n-2ANSpk2sz3Uujqc8F6HxC<br> 4NklO4-QJvhz4EpnX7IWE5n5TqoR4qgxoSI-LlKvzwWj03e-wNWCOmDLXThYN4M=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://grid-se2.chpc.ac.za:1094//10/16891/b44618e0-1e93-11ea-810b-0242790999e0'>root://<span title='154.114.32.135:xrootd'><b>grid-se2.chpc.ac.za:1094</b></span>//10/16891/b44618e0-1e93-11ea-810b-0242790999e0</a><br><br><br><b>Duration</b>: Dec 14, 2019 18:08 - Dec 14, 2019 19:06 (57 min) 234166 Storages : [ALICE::SaoPaulo::SE] - ADD test fails 2019-12-14T17:03:25.000Z 2019-12-14T18:00:47.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SaoPaulo::SE]</b><br>ADD test fails<br><br>Duration: Dec 14, 2019 18:03 - Dec 14, 2019 19:00 (57 min) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SaoPaulo::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 14 <font color='#631BAA'><b>17:58:58</b></font> CET 2019</b></font><br> Duration: 1m 6s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> CTcD9KalS6NgbYU-PgsIV-t-GsdMWz3+PtjuTIufVLxiZDHNbml7v7vzLwwlUYk6TqSjL+VlFedC<br> fKWBN+bfUAKAPTNTsnWQTw-RaCm6O-DkVz++FPTF+IUpMvxUjCGE6iWA7f2QLuM6BVRvplSN6lI9<br> K6U9JQp8+W4lTf+biCg=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgEDroiVYTeNFfLWVBP4hPgJIGUuz7nO7mXwkjbjuiI64Uxe9lQK4RjfBcZDFRNOLjxS1kj3-<br> R9lDpCN1qHqEx3wjQTr51SdzCwmhiSiCFcU0BEQu0KMOKiqNB5-uNFzAsV13P7YRFkqaF667SO+H<br> -6tj2gTOMkaixDYZNWyeOfxtS3p4SLStk0ZKJlKr2YmcVeHowhwH-85939VVy7PnKzqKDlIInW14<br> E4Ltms4Zo4dugRfaioLmZF1Um0Zv8TMA71eiePd6X-q9kjjEweUP4YIUlpCXcOopsvS5euFs8Jyw<br> 5SgSYcxq3g8UEU5BUZ06zmp2-FW5pEMP5YoazSYYS-kk+yU2u4nKFS6qGq513XA2+hCTyjwekbVI<br> H5YKpB4BnJdj4Tt6+nowqQ2qr6GxWBLeck5TrW-Bkf9Js2NpNrDSVl36MxMCQqv40-VxHCJfE9vP<br> 2+JMEY6Rh2lV7XzEdyYkcN2sbhj5kyKSf6UjoLA+QBUrOX6TZKD9kdeWEyNl3D5AoXKe7VT9aurD<br> HyVf3Zlgd9DdHj6-nzHhZsfEgl1PUldwvJj63AUEfuD8BWU5OMugkJKND+jhIKio72BiY5pca+gj<br> rryU-E8MnfJVsOwjrV6CJMmCVsKAi16IYmWXj2RvNHLOew0yxR2rdm+KbpJI0yHJfzKeMx2G5w8i<br> rgD-gIAjzxfl3kU1RngtJnnSOcVciy1ZSnmLrYvMo7uGvkv1HBLzFHDvh5LmPyG0+aKySqpens6z<br> hDWfxq7v6zohIuEuWRh+0DQYBFjiXzztrf-9YttCz9k+I0Vdl1RfMdHmhGU+Ss52nuEt-wqSi7VJ<br> aOJp4PMZdlG0i2D7o4BbrZzmIzk7U210oF46TTnZXZXQITOsjl3wBjSZ76CbBV1UwGZI-xQc9I5x<br> WERDrXMcx0mqywiYelaALouPcJNQtNS7KdAtJF2FYS5iuNeELBSHJey1yLWaQxt4RwpBMyUCWrBa<br> j4llRfo4q7yPUhd7REkX7ryjhIXPWxT5eaaaCdGUvrXVpYycP52KlT6BFMesiHs=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://sampafst01.if.usp.br:1094//07/14593/ddb24dd0-1e92-11ea-8023-0242790999e0'>root://<span title='200.17.30.140:xrootd'><b>sampafst01.if.usp.br:1094</b></span>//07/14593/ddb24dd0-1e92-11ea-8023-0242790999e0</a><br><br><br><b>Duration</b>: Dec 14, 2019 18:03 - Dec 14, 2019 19:00 (57 min) 234165 Site services : [NIKHEF] - MonALISA is down 2019-12-14T15:45:14.000Z 2019-12-14T16:04:56.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[NIKHEF]</b><br>MonALISA is down<br><br>Duration: Dec 14, 2019 16:45 - Dec 14, 2019 17:04 (19 min) <b><i><font size=+1>Site services</font></i></b><br><b>[NIKHEF]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 14, 2019 16:45 - Dec 14, 2019 17:04 (19 min) 234164 Proxies : [NIKHEF] - Delegated proxy has expired 2019-12-14T14:47:49.000Z 2019-12-14T15:34:49.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[NIKHEF]</b><br>Delegated proxy has expired<br><br>Duration: Dec 14, 2019 15:47 - Dec 14, 2019 16:34 (47 min) <b><i><font size=+1>Proxies</font></i></b><br><b>[NIKHEF]</b><br>Unable to get delegation timeout<br><br><b>Duration</b>: Dec 14, 2019 15:47 - Dec 14, 2019 16:34 (47 min) 234163 Site services : [NIKHEF] - MonALISA is down 2019-12-14T13:54:04.000Z 2019-12-14T14:09:52.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[NIKHEF]</b><br>MonALISA is down<br><br>Duration: Dec 14, 2019 14:54 - Dec 14, 2019 15:09 (15 min) <b><i><font size=+1>Site services</font></i></b><br><b>[NIKHEF]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 14, 2019 14:54 - Dec 14, 2019 15:09 (15 min) 234162 Storages : [ALICE::Kolkata::EOS2] - ADD test fails 2019-12-14T13:15:34.000Z 2019-12-14T13:15:34.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::EOS2]</b><br>ADD test fails<br><br>Duration: Dec 14, 2019 14:15 - <b><font color=red>continues</font></b> (10h 9m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::EOS2]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 14 <font color='#631BAA'><b>14:10:04</b></font> CET 2019</b></font><br> Duration: 12s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> J5Fr1mW2lyYaIcP-6Cj6L1puQCyLFaZ0wyYNJ1FzjkP+D4HnAZApy7Xwhr5yfKygerRXUDnipMGC<br> -elLBsZVTAdiJDUT5EEDabC+F+iw-EQieRBi2mKYFsIjwLRGYzRX7B-ttccM+tmFZlt-v18+crj0<br> UThGGn0l01nt4cHhkSc=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgLcNcB4x4Cn3SnHf5vqm4O7-0AgDdsK1qxnH3TJdS3aXkYyncxpTTcZhQ8JVxfYIEJg-kOob<br> LSBgkfj6xk15gjB6Gpi8zoHHnWAYXpjsEwfJWseVW546khf8t2VSPxpqTKgZWSlrUtKRWWvI2Hyd<br> vRXWr+SX8VCuwXeVC9+0wH-j4K2gvE2Uz-E7Ufx2VERmSstXuFu0PpSqvsKkIyI57l67AafbJ+n2<br> 7zb2GJ1RwrCcFqXc+rhM3Jjixws2sNjRwpE8bQ-H2J2mLvdBv457Xk6opcjrkh3MxbioWLdS7MYa<br> mgvNHQoSH0nUN+5ZSPxKGJ-AfSnDLOY2F18sedDdMHE+sPUbqHtdFyqbKPT9H0Xbhsc4dOgKc5+v<br> lbp9b3PHojJt-zSF23nDZnn+MhOA2DFQT8f66B9Pwm2ejFqBgki4L4lPfZA1xAdBOcKYXUoC5g+1<br> S6jQAQjBEPiwapHfczVShpXktpPve1yy5eNtagLn502wy5EgiB4PFWdQLska8G0ZrA0j6QULqMyQ<br> YM-JjwOSvvysVgVbKBBERfb2-fvC+Pb7MPvbAj1cOzNTaaDDZxk90RhMjYYZr3KZNImlkxKeQOxf<br> ik8PrtLUZYCftnq6QzpvP+Ejigv2jFF1K8d0vnY3BsPg5bvmVCrT0teNyQX9AQrFtGZ3vEijft0G<br> Ia1is-RHkbjTr0SDPWsxo4DtXwz9hUWZ1rOSOuUtRrKw3E53lb9X29e-VHhQ0vj8x0WUuQ8UYTrl<br> PKisH9KDATtNzBtuH3IB8zbB5x87nUiGdEpkz5hZOQMmVL7imgUalG-ItPEPPbPz2EZHyhBF8Sys<br> l3+pscSA7HLqQLgak8lBFY8Vq38GUarTk1QZ3Ltn+nvwVHt4rSc2xHn4Tnja44pdW7G2XHeLyC4O<br> B483Z9ltXtuRxSwwjAkQJ0nCWXKT-ZdKcnq7rAyJGJbdQDLdypkGe0k1Vh+RI1tLTIADvyTVjqpx<br> D3ByEdyBsT7O-QP3RG9Yao2+L3w2y6x5t1PyGthcWUo0s0KZfBxHtdo6+4VUObjka1Qea84QTQ==<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://eoskolkata.tier2-kol.res.in:1094//12/03818/03ccfee0-1e73-11ea-9d1b-0242790999e0'>root://<span title='144.16.112.15:xrootd'><b>eoskolkata.tier2-kol.res.in:1094</b></span>//12/03818/03ccfee0-1e73-11ea-9d1b-0242790999e0</a><br><br><br><b>Duration</b>: Dec 14, 2019 14:15 - <b><font color=red>continues</font></b> (10h 9m until now) 234161 Storages : [ALICE::ISS::FILE] - ADD test fails 2019-12-14T13:10:32.000Z 2019-12-14T14:11:34.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ISS::FILE]</b><br>ADD test fails<br><br>Duration: Dec 14, 2019 14:10 - Dec 14, 2019 15:11 (1h 1m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ISS::FILE]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 14 <font color='#631BAA'><b>14:07:18</b></font> CET 2019</b></font><br> Duration: 25s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] Unable to write file; eligible servers shunned.</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> o9Mm22Vdmvnhrexn4RoPDIXx0fbFDTcqfNqktiQEHW7xgblgT-Z1tgDHBP76F5acEDmdfzerZRR1<br> Q0zBZ5vfj+gv2EBBD3MQ85Gkg4y5oiaCHvArMgXAVKphIpRIO42IHhQbojGUlj2oHbMBJW17x7pe<br> 7cAUiCdIztIHAajH1to=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgHnDLcSo1491kyQsPGbF1F8TzDbOFtVMve1r6mV7FAbMWJKWmWqmWNcjaghwwKvp0Xga9aMa<br> SGn3uFkzeXbDaHnEAFJamhcEI6dZQc0Dmgi3DemiyKAYP3Mf7+zIHjUxXf5QLhc0fX2P0obsfq2z<br> QOHqm3BpIr1TR587hQZQ2OHnYVbUmJJF5GYCoK9mwgRjdExNPptOvFHCv-etrnv3J8HktGREHdOA<br> cVRTGKbzM5hD48HbJ0zbaOh+WJtZaJXH86deL99qxVXQQVTSZZDjmENjCHe6hM4+1VhuNLIsrvvH<br> YtOSGum6-n2kFsAshAm+IFjmeSmaAHKeTayhnULbssAfgmd44xf8KooLndZ5ejrL8Br22crdcT88<br> dBkRcIpvBA7bKUEOI52eXbf-ny19V+E7H9sBeSWWLgV8Y-oEqZantIh0Fq8yxk+7mE5BskR7XgzA<br> vzM-GuGRqJoJZ7G8X5Wi4ULGy+ig7RgANeSbksJ9GHGmDMCCBdWJdT+922Bz8HPUyq+2Wr3LqHOe<br> 8WheozkoIoqjXoz70MJyg4o37m+SCD6FiEB0bmN6OUXERg3bccEcHE1Pt7uNc1QxjzFzNDcvM2QF<br> rDJeWq89Bjq19j5DDgSo-LzP8mqZbdH0G0dXi5vJUOXn0N2ipBxUOtfpvAROuYD5yKwZD6pex7Bn<br> ngwyRWUw7Ajovs3p7WVnXYvlpxgOt8vkJTn-3AQc-npcRK8WrkqJFE9qSQZ1kPAIZLGCptHvgLGQ<br> vtn8yfS7bSYbJ+jcbStv5nSzUS5b57yY5c7O7j7MmIw1fOwD2NwyR0AAsD59eUdSLrVdVhGIXvv7<br> vvvA0WmWU825gdNBJf8-isLS0cSQFXgOMVs1QlQKZVbuBSeKWeOf2j17-vbRF3IwRotGAe7cZY5T<br> ZAhk0NuI6DNmSn2zu1Ye6w9fn9NqTyCS9TLroP-iyRMutruN32+ZHKVA+6IVNTeCygnIffdxk5j4<br> +nGQkK48d3TrjWSVuqLB8ffxhalF6jDeaHCA0V7TU1NGIIyJgt5faLEA38BNzGLLmyEoQYQ77E+g<br> 0u2gdgpfHXMD2nWoEkCd8stSXgkmWA==<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://rd.spacescience.ro:1094//home/aliprod/data/02/59322/98832ce0-1e72-11ea-9cb7-0242790999e0'>root://<span title='85.120.46.20:xrootd'><b>rd.spacescience.ro:1094</b></span>//home/aliprod/data/02/59322/98832ce0-1e72-11ea-9cb7-0242790999e0</a><br><br><br><b>Duration</b>: Dec 14, 2019 14:10 - Dec 14, 2019 15:11 (1h 1m) 234160 Storages : [ALICE::Torino::SE] - ADD test fails 2019-12-14T12:55:25.000Z 2019-12-14T13:56:17.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Torino::SE]</b><br>ADD test fails<br><br>Duration: Dec 14, 2019 13:55 - Dec 14, 2019 14:56 (1h) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Torino::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 14 <font color='#631BAA'><b>13:52:01</b></font> CET 2019</b></font><br> Duration: 9s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] Too many attempts to gain dfs write access to the file</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> df57OPDJoJ0Zhtuun4szmYmDHHLahBxDinJ-O9w7GM0llRhZFyVCxcXeYjJ49oCsTwGh7bTydRrw<br> HateXRA6yJUxdeIAXRlECqNYLwRyB2AmX21sebpyVu41UGcMGpZN5aJiHnI+OmQatoUkVYfPjm6M<br> g5SDzMMNQgOr72k63nE=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgD7YqZc25W3C4S8bmfs6A5CtYUiUjSlQ7E25KlqJ40wsnOzzCrW76I011L3hDxSisEeuaO7N<br> gTWGj5eYbJZSXCLM75H1BGojH4xM6uieWKbSsiI8Gy7kJrcwWIC8gHpZgXE2cvtPnxQlKbzb1B90<br> wd5qEadLQ7FAqwScYQR2sbxgO72GV2SZaqAqgLtjp82efFeI2X-QLyR3OXkRmaoR-MuK-lJP9L58<br> JETK4aLerbNbv0Gf7pvigDJIuniIy0TWc3BnVcaAxl6+amEXC5PnUrdfh0zojqSGFW3ng2JqIEt3<br> o6WIPC10ji8ZILzm8OrkTHIcZjh4gv4flVs6pi6GnyxucqB2DaIognSfNxnoUzcHb3vwKoY5kRyh<br> heeqOo2A+V0fAjWZaK8RbhN+hP2O8KuqGPBJOGOwz5xaCIQeVGYc9ITM6qqmSH-J3k45fIxiAXd1<br> ASAUfAuItkxVxGdL2i0fgTEJQaoZGi85f1r+uUjLWVv+8VwFBmZCsvgPjePUeXwsjPmnvfwY7b7b<br> qztaE8xyG9Qxg6CZn2AVMzwyQXEVckpB7yu8bK2VFw82-x085Gi19tlynPDS1dVSAIacg8KdT9BU<br> a1TZu7vyRG1vBQNZcceI1z7Rl-IHNeDPL5DCJBMUZmGNsVIRj6dlp-oOH4YcW8TqJhn8cIECUg-4<br> QS5IzQVhZPvLMdFYx+Ugtgy0PVxuc6-tAYb2etNgvoZ-fme5bWtvuvEyzUWfWW-BBkEpTJUQcXX9<br> x1-tyWN1yCcfJmBwQ18+gja4dyEaJO+k8IPlEcb9rUO2hoDd6fGaiMzgs2xeYl-WrLZKICigxeT+<br> ylOvHomoT0lZxrUkKivGirzAVSNGdL5jMG-yykIDXOSJ-TQYiR0j-rOV6FYwAd8-9FOnJIAoapz3<br> 9eTr4ACN8w7B16Uu9mjkMGHIEI8+6j5C0A0xpJMiee4FwHz0NLZU-Ff6E7WbBvWvKV02R01+1bRw<br> 3YUtexgzyh-VtdPNrwbC5WU-6mzdUFW3tdKEG5GEsf99Y5YrzSdcFblRLPehvwI=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://alice-xrd.to.infn.it:1094//01/36159/80071660-1e70-11ea-9a7a-0242790999e0'>root://<span title='193.205.66.200:xrootd'><b>alice-xrd.to.infn.it:1094</b></span>//01/36159/80071660-1e70-11ea-9a7a-0242790999e0</a><br><br><br><b>Duration</b>: Dec 14, 2019 13:55 - Dec 14, 2019 14:56 (1h) 234159 Site services : [RRC_KI_T1] - Monitor is down 2019-12-14T12:25:33.000Z 2019-12-14T12:40:39.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[RRC_KI_T1]</b><br>Monitor is down<br><br>Duration: Dec 14, 2019 13:25 - Dec 14, 2019 13:40 (15 min) <b><i><font size=+1>Site services</font></i></b><br><b>[RRC_KI_T1]</b><br>rhole.t1.grid.kiae.ruPinging service ClusterMonitor... The service is running at rhole.t1.grid.kiae.ru:8084, uri ClusterMonitor Attempt 1 (Sat Dec 14 15:13:43 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 2 (Sat Dec 14 15:13:48 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 3 (Sat Dec 14 15:13:53 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to rhole.t1.grid.kiae.ru:8084 (connect: Connection refused) at (eval 103) line 1 ). Exit code 1<br><br><b>Duration</b>: Dec 14, 2019 13:25 - Dec 14, 2019 13:40 (15 min) 234158 Site services : [CCIN2P3] - Monitor is down 2019-12-14T12:10:26.000Z 2019-12-14T12:40:39.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CCIN2P3]</b><br>Monitor is down<br><br>Duration: Dec 14, 2019 13:10 - Dec 14, 2019 13:40 (30 min) <b><i><font size=+1>Site services</font></i></b><br><b>[CCIN2P3]</b><br>Dec 14 13:08:42 info Reading the configuration file from /home/alicesgm/.alien/alice.conf Dec 14 13:08:42 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Dec 14 13:08:42 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://ccwlcgalice02.in2p3.fr' (a variable that is not in the standard configuration) ccwlcgalice02.in2p3.frPinging service ClusterMonitor... The service is running at ccwlcgalice02.in2p3.fr:8084, uri ClusterMonitor Attempt 1 (Sat Dec 14 13:08:42 2019) Attempt 2 (Sat Dec 14 13:08:48 2019) Attempt 3 (Sat Dec 14 13:08:53 2019) ERROR: Could not contact service. (Error 500 Can't connect to ccwlcgalice02.in2p3.fr:8084 (connect: Connection refused) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Dec 14, 2019 13:10 - Dec 14, 2019 13:40 (30 min) 234157 Storages : [ALICE::Prague::SE] - ADD test fails 2019-12-14T12:00:04.000Z 2019-12-14T13:56:17.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Prague::SE]</b><br>ADD test fails<br><br>Duration: Dec 14, 2019 13:00 - Dec 14, 2019 14:56 (1h 56m) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Prague::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Dec 14 <font color='#631BAA'><b>12:53:04</b></font> CET 2019</b></font><br> Duration: 1m 52s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> fMGd3F+dZq+JMAdbWtud4-IGArMUoD7QvuGEFALBeuMQVwZ4gp-EUqL-S2yVF7xjtqFVMdGl6gDx<br> 2K+K3XM2hfqt4uE2pHQzNtNEPtnr0thERamBQ27MqbJcfE4QGNbwWk9xJIPowUbnrup0qn9IXrVA<br> mx9A0rzY6bn8TpCd+1w=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgDRy9ED60XwYciqFaqcaNL4c0SriIzL-Ngjn4GawPE8s8EBb5-sFZ2oVwf3jhlYTRcISmWby<br> w457yLQ8+DYdepsI+BMQ3z8iCBwAI3GkiyOfgxwZ+QdNKjm3DIHitUFClkt0EBPOyXQybkVQO5Nv<br> sfXTr80gppYH8xwu5VSvPaTdtZAnYxX3Ix3udF9ZWKO0KxZqWzxjV2O9NPCXS7GmekhGsS8O0XkX<br> va60Zgy2wmIV-ylKktktaJyTWPsNEQKtSveuQ64jTmd77oiz+OIOQiuM5Mj7FJDRPM24ydHc5Ko3<br> +RvRt6+ZrvNJOrGUdtzvxE-2JNCmfUG3+BbVD5fveliT6msYcJkinV7XgsglhWyT0wbd1PFSADQY<br> 0sBJhBBMN5zzzzQFe8uQtOq+mLwZ7OFYQgBTnPR024Qoko4i4kHPIAnQ1bZ5IqN4nBP2-B0EqVf5<br> 5G1QWso2U5o0o1lxatCXaNp-JRs6xu1fJ+djTs665tbHFtCNhQx5D1dmtUR4uPn-sUDvPUsxW5o+<br> 0h+P3FcRlVYMrrxzedoCJ6BXCNCeTT9PQE2T87bXFXyNyDrkRKCdA0-nxOWwN1rHwA5DDf16U1G2<br> 9clwI37YcyUzW4UkLMuRJoGsdCOHTaAKr35J-5CobXfEfGivioWm-gtJXDmB0Qq66jjffyYulyBe<br> aHeSDDWxVzVfZjK+jXkWwkGQP7GycT1BiPilDb7F7bIpkiBGw2DfoXnEXjP-ILfKSyhRVKPteNRP<br> IvWXu2odA3JCAW-lMDqWAcvjC7AqbwXs0o0f+gDXSFYxM0tucPolFQMQxYNZDRlL0aP2tGmxFr8A<br> jS-zlfKayjkA7CVT31uAiFT5gmi+fwjVqVpt6lyTBcMvcw6auOgxkNWJSbtdRAHw5FP6z6Rr+a2P<br> nxD7UMtJK9P9vOxEvVNkvuTpCDocFYonRHglAbgal4hmsBYnrCO8kLsWYVuwYvrksVOQXoPOAamH<br> jn9YXhjMq0N5ugf3hqbRsOqYb2LgiqlmsD6e+FaabjubfO8B86KMt+PEvnvGNJM=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://xrdhead.farm.particle.cz:1094//01/34119/066a8e20-1e68-11ea-91b6-0242790999e0'>root://<span title='147.231.25.162:xrootd'><b>xrdhead.farm.particle.cz:1094</b></span>//01/34119/066a8e20-1e68-11ea-91b6-0242790999e0</a><br><br><br><b>Duration</b>: Dec 14, 2019 13:00 - Dec 14, 2019 14:56 (1h 56m) 234156 Site services : [NIKHEF] - MonALISA is down 2019-12-14T11:57:37.000Z 2019-12-14T13:14:56.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[NIKHEF]</b><br>MonALISA is down<br><br>Duration: Dec 14, 2019 12:57 - Dec 14, 2019 14:14 (1h 17m) <b><i><font size=+1>Site services</font></i></b><br><b>[NIKHEF]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 14, 2019 12:57 - Dec 14, 2019 14:14 (1h 17m) 234129 Storages : [ALICE::JINR::EOS] - ADD test fails 2019-12-13T18:05:43.000Z 2019-12-13T18:05:43.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::JINR::EOS]</b><br>ADD test fails<br><br>Duration: Dec 13, 2019 19:05 - <b><font color=red>continues</font></b> (1d 5h 19m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::JINR::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Fri Dec 13 <font color='#631BAA'><b>19:04:12</b></font> CET 2019</b></font><br> Duration: 0s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3010] Unable to open file /eos/alice/grid/06/29257/f785f330-1dd2-11ea-a6d9-0242790999e0; Operation not permitted</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> X21Rlim7bjknunUpP7eeHlpsNPLQlqneHi9YVMEu24jd+CB+pkhpBCJ9x9V5eAd8hmaU42tewVGD<br> lKG7tDOlgXbJAeJsD0NUWilZgGKdklRm+Qq4kAl81JH+vBaIDD23V6Cn1SDV+JwrTt1UkpidmqHV<br> M7K2k2dEEW0j26mbG4M=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgDwabslIDNcfx5qK6wDwvEZdRurPbxKrOWsfVdwhy1iI4M-WZCfcLR6xutcvFUQ7pT-bsROu<br> glfXSptJDRVX2HoRY1SRrh+96JyfjIKGpB8YWJUwE7gUGkEUaVMF-0r4dqxgEKYDfwLWlxdvibBJ<br> FjJv2aIM67g7Nl0qKDDhSjEaq+O6LEAPxL+2oJ5BJSWiu+x8eKrznKvbrwhjqCMC5Q+xqT760WSb<br> p6sQJ2dWbRj8Svx+SE8MFDiqaslCvMjVKCpk6TQCImdQ7Bh9jIA7MDUJaR+6O3bE1m2E9C++Hacx<br> I9s046YfLLzmLUANicj7TUbH4Wg1YkMExQ5g5xFIpPVgSvahV3XVnJ-5wub7KTWPRXYaXgUAII2y<br> m9YnMsD+QmuWhRlZodgeswjDfmutPSQ5hl8F22eBp4gsETIsUTUsNnFZmBsVi5xETP15iW934CjG<br> S+f3woQxbZ7mT-+EJ8GnoOzAw1NFMiGLDzAbRofMQH-EtxVCDNjzeQSNdnbrhyrqy8h4pbDinYuT<br> erQqWVdY+4Hm1qLLt7kXrnuU9ZiAQcGwl0LXopxSxMT0exB+RqKV9b4MNpUF+G9AHdQQJ8PFl1Co<br> KUfuE5stbasZI8xCoXhVW8ZixM5jqxmDzfJMkZmL2z6xvNwgOTtFJHP8TcGZf5w846HE0C0Wva9Y<br> ymWUdvI+oPH51dJTJjrk-3pB2Xj5Bf5BZAZKxde15yAf-NLsyEQacDQ51l-brZiAHmb8uWPeFrYV<br> qGrxK6GMwRuyHlTnEuPQBMM0p0eB8GOTwya-KPXWUNlIuMMlDxnhTkAOXDVUbehCucptr75F-YDP<br> yfOEnu2XuEDB5kD6DjwZ+rGArdnFjcSuws28cmOPn5cJO5Tymr9DNNQslbTvqWLLzXC+0R9SoPpk<br> uI2aEFYFOUKUpI2Hu3ccO1xXv4gzR18zSuQpPgOTG6txF59OwyBjQ5HsUFqmDLgdEAMk0ugVlxrf<br> Uzp7+22DtuGGG4jbDRyefP39zcIsRrsZepmb5r-eMbyF3L5J1JZf<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://lcgeos01.jinr.ru:1094//06/29257/f785f330-1dd2-11ea-a6d9-0242790999e0'>root://<span title='159.93.225.208:xrootd'><b>lcgeos01.jinr.ru:1094</b></span>//06/29257/f785f330-1dd2-11ea-a6d9-0242790999e0</a><br><br><br><b>Duration</b>: Dec 13, 2019 19:05 - <b><font color=red>continues</font></b> (1d 5h 19m until now) 234100 Site services : [UiO] - MonALISA is down 2019-12-13T10:01:04.000Z 2019-12-13T10:01:04.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UiO]</b><br>MonALISA is down<br><br>Duration: Dec 13, 2019 11:01 - <b><font color=red>continues</font></b> (1d 13h 23m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[UiO]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 13, 2019 11:01 - <b><font color=red>continues</font></b> (1d 13h 23m until now) 234044 Site services : [GRIF_IRFU] - MonALISA is down 2019-12-12T12:46:56.000Z 2019-12-12T12:46:56.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is down<br><br>Duration: Dec 12, 2019 13:46 - <b><font color=red>continues</font></b> (2d 10h 37m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 12, 2019 13:46 - <b><font color=red>continues</font></b> (2d 10h 37m until now) 234002 Site services : [Wuhan] - CMreport is down 2019-12-12T02:28:51.000Z 2019-12-12T02:28:51.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>CMreport is down<br><br>Duration: Dec 12, 2019 03:28 - <b><font color=red>continues</font></b> (2d 20h 55m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>ERROR: Could not get Config. (Error Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' ). Exit code 1<br><br><b>Duration</b>: Dec 12, 2019 03:28 - <b><font color=red>continues</font></b> (2d 20h 55m until now) 233894 Site services : [MEPHI] - CE is down 2019-12-10T20:34:09.000Z 2019-12-10T20:34:09.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>CE is down<br><br>Duration: Dec 10, 2019 21:34 - <b><font color=red>continues</font></b> (4d 2h 50m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>alice02.lxfarm.mephi.ruDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Dec 10, 2019 21:34 - <b><font color=red>continues</font></b> (4d 2h 50m until now) 233884 Site services : [SUT] - CE is down 2019-12-10T18:48:37.000Z 2019-12-10T18:48:37.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[SUT]</b><br>CE is down<br><br>Duration: Dec 10, 2019 19:48 - <b><font color=red>continues</font></b> (4d 4h 36m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[SUT]</b><br>Warning! not able to use /home/alicesgm/ALICE/cache as cache dir Warning! not able to use /home/alicesgm/.alien/cache as cache dir ERROR: getting the configuration Syntax: pingService.pl <serviceName> <logDir>. Exit code 1<br><br><b>Duration</b>: Dec 10, 2019 19:48 - <b><font color=red>continues</font></b> (4d 4h 36m until now) 233883 Site services : [SUT] - Monitor is down 2019-12-10T18:48:37.000Z 2019-12-10T18:48:37.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[SUT]</b><br>Monitor is down<br><br>Duration: Dec 10, 2019 19:48 - <b><font color=red>continues</font></b> (4d 4h 36m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[SUT]</b><br>Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' Syntax: pingService.pl <serviceName> <logDir>. Exit code 1<br><br><b>Duration</b>: Dec 10, 2019 19:48 - <b><font color=red>continues</font></b> (4d 4h 36m until now) 233882 Site services : [SUT] - CMreport is down 2019-12-10T18:48:37.000Z 2019-12-10T18:48:37.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[SUT]</b><br>CMreport is down<br><br>Duration: Dec 10, 2019 19:48 - <b><font color=red>continues</font></b> (4d 4h 36m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[SUT]</b><br>Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' Syntax: pingService.pl <serviceName> <logDir>. Exit code 1<br><br><b>Duration</b>: Dec 10, 2019 19:48 - <b><font color=red>continues</font></b> (4d 4h 36m until now) 233881 Site services : [SUT] - MonALISA is down 2019-12-10T18:30:45.000Z 2019-12-10T18:30:45.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[SUT]</b><br>MonALISA is down<br><br>Duration: Dec 10, 2019 19:30 - <b><font color=red>continues</font></b> (4d 4h 54m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[SUT]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 10, 2019 19:30 - <b><font color=red>continues</font></b> (4d 4h 54m until now) 233879 Storages : [ALICE::SUT::SE] - ADD test fails 2019-12-10T18:00:38.000Z 2019-12-10T18:00:38.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SUT::SE]</b><br>ADD test fails<br><br>Duration: Dec 10, 2019 19:00 - <b><font color=red>continues</font></b> (4d 5h 24m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SUT::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Tue Dec 10 <font color='#631BAA'><b>18:56:38</b></font> CET 2019</b></font><br> Duration: 1m 6s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> bolJg1j9noSxyZvzNKo7LjPVV3uN0HKt9kdfwk1+PXLNAYFPPm0xV8NygL35GNBDY3yy4CDG6shP<br> iGe9AzVDUvkQ7STg9Srmjt0tlAIEvXygfuCXXHk-cGW3LAuZY-y9KdSLw-Lx00XK+QBANK8iaRUC<br> B5x23lK9jJdE9bbT7Xg=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgKXQg0SLVVtvf2rNYbFsGkreZa4eKMiNSxf-vIn3bNCD7Y2Zh226r2E0xMLwPjHDcH59YBbu<br> fjkla5l7w6KOwzjVJwzQJ0KFKJhrqlKrDzyENmdibPxLp490T0h1p2diBCkO4sQ5KEV-vg4TQIgN<br> YkB8GPURGc0M3Pb2m6PAIjvb6OoN45kpQGf-elYyLm0kbncp4AwFM20-RVbjgj+DJ4Z9jlp20se0<br> 97Rrk+vOFIgR7K5xvyZfVxpim2X0x-e6OeR3AhMxNHLU4JQPjXUNp8e7gCkWk2zSdobUnhc2hLIX<br> oEYYm1+3eZ3A1BlIbGJfAnqwrWuuCNIevXt37M-V9vwQOgUA-ioKZcMXyZl8DxiZe4LeX8NPspHr<br> 2GgULXtWpsIbnIuJEKj0S+Db9shnEI9xoDpw8k5miZJ21vxGw9M5BDFi+EthQ1xNupJd8DfvCSs4<br> kJdkIqAQ7XmravG9ecFkZNNGRzbQ2uup4BfmNL3Fv+zY6BJNW9QdqvhUa2AlgKLUjsuBRNG+Ay+1<br> iZZ2HvK55MgOpqNg-ziWlJfyuF6nY7Xlt2Tei0xTBb65-LO3FEalMrhpaoEPe6eY3Ai0tSBvY5U0<br> PLr46GetP9V-9nLiO2wW-C0YoO2a0w37gifPOC7mh0eSYPz3WNjYgHlT4fdXJ0q58UdJmnSqYBM4<br> LC8ChJ-bY0aMtdL2j-tbrhiQ-mUJna1-jZtcLoez8IOlvVtxVqhit7ERxNVr-uN19Chdk-JeAw5j<br> RKuZQlzIyv6Vqc-U8qJPakHwzjW82PjWYWnuvYAZgtKHimkgV5nCoGXmsU6hhjMs0YfX3qBJFsk9<br> opuiyiOu1DS82Dv0UdkkSPFmd9jhIbF+lzcbNs--2AZS0kYNyfibyyzshAuICynrEowb3oot56Ra<br> 1dQAJ+45mTWe6VCfjTgsj5U9TXFCHa+2iCWf7e9Rae34Sen6TLEv7mU2i9h-TQlO-Ta7mM2U3+Wh<br> 4t5XZkyM6cK1jgkWrAu1tJYUf9B2r-XAkWBp2WX-sgXuu+8rY+zxi0hX3QZ78OM=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://physics-se.sut.ac.th:1094//01/00177/42568a00-1b76-11ea-943a-0242790999e0'>root://<span title='202.28.43.132:xrootd'><b>physics-se.sut.ac.th:1094</b></span>//01/00177/42568a00-1b76-11ea-943a-0242790999e0</a><br><br><br><b>Duration</b>: Dec 10, 2019 19:00 - <b><font color=red>continues</font></b> (4d 5h 24m until now) 233861 Site services : [MEPHI] - CMreport is down 2019-12-10T10:25:58.000Z 2019-12-10T10:25:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>CMreport is down<br><br>Duration: Dec 10, 2019 11:25 - <b><font color=red>continues</font></b> (4d 12h 58m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Dec 10, 2019 11:25 - <b><font color=red>continues</font></b> (4d 12h 58m until now) 233852 Site services : [UiO] - Monitor is down 2019-12-09T20:34:48.000Z 2019-12-09T20:34:48.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UiO]</b><br>Monitor is down<br><br>Duration: Dec 09, 2019 21:34 - <b><font color=red>continues</font></b> (5d 2h 50m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[UiO]</b><br>Use of uninitialized value within %ENV in substitution iterator at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. Dec 9 21:31:59 info Hello ALICE::NDGF::DCACHE Dec 9 21:31:59 info Hello ALICE::SNIC::DCACHE Use of uninitialized value within %ENV in substitution iterator at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. alice.grid.uio.noPinging service ClusterMonitor... The service is running at alice.grid.uio.no:8084, uri ClusterMonitor Attempt 1 (Mon Dec 9 21:32:00 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 2 (Mon Dec 9 21:32:05 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 3 (Mon Dec 9 21:32:10 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to alice.grid.uio.no:8084 (connect: Connection refused) at (eval 103) line 1 ). Exit code 1<br><br><b>Duration</b>: Dec 09, 2019 21:34 - <b><font color=red>continues</font></b> (5d 2h 50m until now) 233847 Site services : [ZA_CHPC] - MonALISA is down 2019-12-09T19:59:14.000Z 2019-12-09T19:59:14.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[ZA_CHPC]</b><br>MonALISA is down<br><br>Duration: Dec 09, 2019 20:59 - <b><font color=red>continues</font></b> (5d 3h 25m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[ZA_CHPC]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 09, 2019 20:59 - <b><font color=red>continues</font></b> (5d 3h 25m until now) 233841 Storages : [ALICE::SPbSU::SE] - ADD test fails 2019-12-09T09:53:04.000Z 2019-12-09T09:53:04.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SPbSU::SE]</b><br>ADD test fails<br><br>Duration: Dec 09, 2019 10:53 - <b><font color=red>continues</font></b> (5d 13h 31m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SPbSU::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Mon Dec 09 <font color='#631BAA'><b>10:50:30</b></font> CET 2019</b></font><br> Duration: 6s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] No servers have write access to the file</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> fn8-WlOyCVXFtmWK3Q88+4Tt0Fhs8FTXECTsmqwob6Ad2GYegsmPTmP8vJz1hlsDa0cZRLkUi368<br> r8ziJYMu1hcFIpZPAZvSw5L6ovduJ7sEw5VBQI9cQjSf95XmJBUaKV67JFla8fSwq9hVnj8WcdN3<br> IhaAhR87+MoHWtDCzaA=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgJvc6a3SqjJPpxlLqckXK1R04JeibTDpnScH57s0UxHcMyJT-Q53huCOdKYKmCT4m+j79ltR<br> e+ga2399FSf5q71lL0diA-CJ82vzLFQYUHEScTKKZf543Z9+PzOg5XmpMZ8yRPIke4AxrX2im5iQ<br> IAsCK4Hc0TTbuOGdVQADeZKr5Xb8wCFrsEApc6hA3XJTQKkkdEodIpITpOvVfd2o7QFWf+EJwA8w<br> HVC45j0Fur1LFZM+m6ABfG6JLkVDpcG05ZEO2qPa7tTHzPsvobDUTokCoCWBL96+vCCL0jlxk2he<br> fryO-KNb8KeGN2+dn3+45r-c9Mx3oHoyxQ3Y5+cs5EnHSKRHrnQgjMAEhueKTTJlHjssZ297XR0h<br> Oi-cpQfpG7PU+JJBgVA9OIq1brx9TO7F+IN9A06NWcsl8eOaX0oT5hrAgvqSsNX+puei5+zPHq1W<br> E77BZGYLUD+aZgX8oqzvz37HWE1huVAC9WBran57VEbi34k3ItKuo7JgmFQt9U5SmJX+gF0+bD++<br> OqGxP06H80cYXavuZqhlY3NGomD6O6nBiUvsfZu4EyhNAuDYT5gLvtfPSCWimGrKicaHWI2U42-N<br> 7y9tjJ0rPa1B1jTB-Anqj-+DFGW1enpm5fEM2ITtNVlATXJzcbymi4xhIWzYNcEqNA+phblPoPmg<br> VrglP1I7TIQf-YQs6juAdpqytqncJ9tSlIUNwGNdgBb3GUZFEWIm9NMuPoVIPw4LXjWwdC1zo8Ap<br> Aw+Bup+-WzrBUMNGW1ESu7vqPV+WzJdZ5sLXNXV6R6f-H2hF-iS8W+-rr7PS9nWCiI4XweBW-kxn<br> oCAAVa57t+NMLL0vjyJj5g3mET4hKtsJ+8CnG8refLfr6+toltK4LYNspvWfZfYDtQJvSrGAWOUU<br> lOLLlUQdCluS6c2wEYoj8GWfui826g1RdvxompBCoY8XhPbImgySd6EOxJU5UOL4y0HLVEB71J4t<br> usS+6iXxzaJmRZHXxiTuC+odjNQWNj+SLDSnuA3UHB4p+vHa4bL5<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://alice21.spbu.ru:1094//15/21524/52d68460-1a69-11ea-9e25-0242790999e0'>root://<span title='195.19.226.151:xrootd'><b>alice21.spbu.ru:1094</b></span>//15/21524/52d68460-1a69-11ea-9e25-0242790999e0</a><br><br><br><b>Duration</b>: Dec 09, 2019 10:53 - <b><font color=red>continues</font></b> (5d 13h 31m until now) 233806 Site services : [Wuhan] - CE is down 2019-12-07T20:03:20.000Z 2019-12-14T22:45:55.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>CE is down<br><br>Duration: Dec 07, 2019 21:03 - Dec 14, 2019 23:45 (7d 2h 42m) <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>Dec 8 03:59:17 info Reading the configuration file from /home/sgmali01/.alien/alice.conf Dec 8 03:59:17 info The local configuration is not allowed to define services Dec 8 03:59:17 info The local configuration is not allowed to define services Dec 8 03:59:17 info The local configuration is not allowed to define services Dec 8 03:59:17 info The local configuration is not allowed to define services Dec 8 03:59:17 info The local configuration is not allowed to define services Dec 8 03:59:17 info The local configuration is not allowed to define services Dec 8 03:59:17 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Dec 8 03:59:17 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Dec 8 03:59:17 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://vobox.grid.ccnu.edu.cn' (a variable that is not in the standard configuration) vobox.grid.ccnu.edu.cnDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Dec 07, 2019 21:03 - Dec 14, 2019 23:45 (7d 2h 42m) 233799 Site services : [KFKI-2] - MonALISA is down 2019-12-07T10:42:11.000Z 2019-12-07T10:42:11.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[KFKI-2]</b><br>MonALISA is down<br><br>Duration: Dec 07, 2019 11:42 - <b><font color=red>continues</font></b> (7d 12h 42m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[KFKI-2]</b><br>MonALISA is not running<br><br><b>Duration</b>: Dec 07, 2019 11:42 - <b><font color=red>continues</font></b> (7d 12h 42m until now) 233740 Storages : [ALICE::SARFTI::EOS] - ADD test fails 2019-12-05T19:18:42.000Z 2019-12-05T19:18:42.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SARFTI::EOS]</b><br>ADD test fails<br><br>Duration: Dec 05, 2019 20:18 - <b><font color=red>continues</font></b> (9d 4h 6m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::SARFTI::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Dec 05 <font color='#631BAA'><b>20:12:05</b></font> CET 2019</b></font><br> Duration: 2m<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 52: [ERROR] Operation expired</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> ksJZAXs-xJhNdRyna5ADnvNbEbkriM-Ctef+-5T6XKDv6XfpGc3rL3LkmBVoZnLli4ebmDLBWqXS<br> TmgwR3A99o4Gw9uQBQmJsz1jjxuAvVOd0cmbSPiWOpEqBUne32G0ciWCevVsgDEEkNeU9TkCFmSi<br> jQA8wZP8EU0u3qOtzk4=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgJmIv3rxOAh8U97pObV136WrYso44NOzzdedEjaPyKC+g2d0hGKzV7eInlk2wS6997GKa0kd<br> B1vftHcRt+L04omjr9pAA-fsxiB5Tr23gkiOMacVHGhIdndOC2f8NN+p94lEeCC3NtDf6OVA1-3Y<br> 2TuLKfoplLYOJpkUVFYkx7j1Kr4O3p5p-FsI+MwhotNnQ9-fi6KPEYkkDLZAWTK6ML8fRBcijTB7<br> u4NkgnqVsjntpUpc74JZe1seQfvgl-9PncxpKdA32U+pWRz5fQ8fRZMvXBxiS-4MihRdzVlj-hI+<br> TB4QfUhEiID-006NjiPwoCS-Y1CU4pEChpf8AnvV-uJtO1qXj9ugOxJeZ7Bb9YqAww8zQzGCxxWb<br> 28818bjpIp4EjExVhQw9AuRbwaAcX69M5jr5KtmRqIdcqCOAzKfsL1wuvF0vbE7RQ4X3bud+9PTn<br> m9fOYZri-ypcVWqWJ6TFJp5Q5zgm98QfNNvtu2fwMM0k5rC7VD2RYnj23ZH5PDCAx8zgUZAFmYlF<br> qP-q-xZizFEXOx5UF+jGOIQCojLdJGLKNjn+0yWOli4t1RitFlrlyuJBIf7ygGx7ArGW2qUAsXlX<br> YKxBRteDHXnN2spqgOdivCgqRvwpsgb1NuCkxGg2BHj9rcsRiUuNWnRjK34C3hjrwjJqs7c+JbO3<br> pCRkxguHZYJvM0u82cCEJmaNcOfOawqARFgfJhetPlv-5sZRH5H6OJ0DLJ9TVeWjpp51KzyYQ055<br> +TPnlIwXgvywNHdIwC8XvCC5dxh4D2lqI8meYbBC85sHfuwuct2-RpVRCHoeocv4K9iclWkFJhnm<br> 62gCO2JoIyHYCLQ-AF+vk1ntXopI9izefGKKL7XIdTXo18JKz5ljfFaU7brlrI7x+IIehtlDcHfh<br> 0jrGV9FJ82CH8OZEMPwgorp6EvHNT6UfNI0DB6IJlHYQx+gfzmbSFUGAVOQ9tqbyRlvPI4XL9Ccn<br> 5hcDWe4koVvm8KRkXsWYozSFwdH6LO5xQ1miXEQgBAmBUXvVDLnLg1J6M3Xv7Ok=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://gridse1.sarfti.ru:1094//06/31297/d86e41f0-1792-11ea-b259-0242790999e0'>root://<span title='185.141.124.199:xrootd'><b>gridse1.sarfti.ru:1094</b></span>//06/31297/d86e41f0-1792-11ea-b259-0242790999e0</a><br><br><br><b>Duration</b>: Dec 05, 2019 20:18 - <b><font color=red>continues</font></b> (9d 4h 6m until now) 233719 Site services : [CBPF] - CE is down 2019-12-04T23:48:17.000Z 2019-12-04T23:48:17.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CBPF]</b><br>CE is down<br><br>Duration: Dec 05, 2019 00:48 - <b><font color=red>continues</font></b> (9d 23h 36m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CBPF]</b><br>Dec 4 21:44:44 info Reading the configuration file from /home/sgmali01/.alien/alice.conf Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration is not allowed to define services Dec 4 21:44:44 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Dec 4 21:44:44 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Dec 4 21:44:44 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://vobox.cat.cbpf.br' (a variable that is not in the standard configuration) vobox.cat.cbpf.brDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Dec 05, 2019 00:48 - <b><font color=red>continues</font></b> (9d 23h 36m until now) 233621 Storages : [ALICE::Grenoble::SE] - ADD test fails 2019-12-03T10:31:25.000Z 2019-12-03T10:31:25.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Grenoble::SE]</b><br>ADD test fails<br><br>Duration: Dec 03, 2019 11:31 - <b><font color=red>continues</font></b> (11d 12h 53m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Grenoble::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Tue Dec 03 <font color='#631BAA'><b>11:26:45</b></font> CET 2019</b></font><br> Duration: 5s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3011] No servers have write access to the file</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> nOyKyDP0dGGZsbPx+xau+O4x55+apE8kRT8Q7TrKJxx1K+62oXPMtnXhkcIFsEfHRuSUfQnPa-Ks<br> naaJ4ylRpvEQSrp3p6BnCCQGhHf+Nd7ILbMeTsHa5OajQNpOKpJEKuNdLuYSz4AtqM8vRTIAoy5j<br> F224h94AkzhA+LPc9zQ=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgB+9DKTjmDRVhh+FmG3xFvMKZwyNS-ynlgDW27PHjRuGfRFAxicJ13xNTVz8ISjHY0zmIMwd<br> cpWLV-7fMdaBPSLlzo1eeegMFCkymyllxB4etX13ZuFhObm-u0vyJaOGq6uGnKR-UVRaXzuvHCWE<br> neHRHNUCgGEg7Fqm2anLd65SMK5vAQ0XiTQ0NZrQrnTl9YG6QjYDjywBXlp9qu5p1j+Sxe1DyHpR<br> XAWO-hlHSAG+ww9JSZfV14ojrJ+Ormj3UpXZ3maJK-SMASBGoEZ3rKPNHXIJe8mMDOCgxpH9vIol<br> IoeN081f5cqv1LEzCTshpcugp2xc0DZoemX5w-X1iKL1RFEfog6Bz7J4Y2PWeiB5XzE2rFjEaGV4<br> HwPr8UrG4lcDVLQ48jj5lmKnjYefkQv4tSpAlte7Rqrxjs6MjM-cqnYE4chjB3zFXjlwP6219TSN<br> AM99RO-tbNRB9tYYhaFkZUCAuDbabg-am5UVz6FscI2Av9f8ZF1qqk4Mp-SxrCBcqRZwzZDHulhB<br> 6R8wIyXVywjsplgNVv6wxFTp942E7VbFwvA7CvLJjHwOqAX6-mLwjW0-ZmOvU23rdIaj201A+PMG<br> jUv8spRd7XCcl8Z7VtKekNAJtKadUw2iME27-oh7hydxSLrKVHBPw5nND980rjtR3Hm7-nVPhDcK<br> u35wFyyTOREkf0bhx2MUuGcUcapPjiqfVdo2tnlgzScrcBg2CO7SLFEaHMRXf7ZUw7dfEECuu8Qi<br> hqNnVliJIj6gUTQkl9o6elupHmQViHzfbcRVannHRRpLvNW8zggGA0a8VpIL8Vqa3emRnR53ecYF<br> xAGK1wDEnqCaGTa6DI7xHKwgOSRPOCkW3OxOmFJXZ8VLk6sXEfWnQprwO5UsM3qKhjHnl9XhQFiD<br> 2YKg8QdZ3mUO6MmF1UTd6Zr4DR0AxgfAF28by8znGEEAIwVjo5A1xYgS9hWON0TqfegTKXrpG5kU<br> DzX2ZikBOyNL51SpiGZMBPdZjEk63iVG4Yhi+0Iehcg1B163CRulyNavLKF83Jx5SsfvcwkN6w==<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://lpsc-se-dpm-disk17.in2p3.fr:1094//09/58285/64a1b860-15b7-11ea-bfd1-0242790999e0'>root://<span title='193.48.83.122:xrootd'><b>lpsc-se-dpm-disk17.in2p3.fr:1094</b></span>//09/58285/64a1b860-15b7-11ea-bfd1-0242790999e0</a><br><br><br><b>Duration</b>: Dec 03, 2019 11:31 - <b><font color=red>continues</font></b> (11d 12h 53m until now) 233042 Storages : [ALICE::Kolkata::EOS] - ADD test fails 2019-11-18T13:56:21.000Z 2019-11-18T13:56:21.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::EOS]</b><br>ADD test fails<br><br>Duration: Nov 18, 2019 14:56 - <b><font color=red>continues</font></b> (26d 9h 28m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Mon Nov 18 <font color='#631BAA'><b>14:53:58</b></font> CET 2019</b></font><br> Duration: 8s<br> /home/monalisa/xrootd/bin/xrdcp exited with exit code 51: [FATAL] Socket timeout<br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> FoWkC8ZbNVEb3NOUl65ygJh++HpUWCTUTZGDsai0WHwzu1Ygt-y2N4pr1LacYCDrm+OSQvTBZqQi<br> uqbevB2jW9pC94xSLtD6idLNAR0zAOkgLSVUUKPLizpi1NoplIwhduDHofEXXx4P3UM1fUj3cgJQ<br> I34vs8AJaq+TkXq0yTo=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgB3GptaahMifGXzSEvsQk1IsXIiDRHcauLOPpDcYz9WFteC4KMgpcQbxve7Sn8Q2FXIYhe-b<br> hstdKB17hihhVrob0xaLWJCmnR3QD4B+FQdAQUyH10GBp1W0FT1zTWJXDooUX6sXvvUK2YZmp5z+<br> psZBoUZrTMJvc5UzcBIRwS0LdpoHJMNRQhZpsK63ltbM+FbcdvwAkksshQOoVR5aveTMyRQ2UmYS<br> 1-AWLYRYIltMRXB4V+JY96uA93kx9PMHiwcXGN6DWzjN0kwftKDibQk5MqFTNpNVJCT974G0kXLp<br> P+WhLMSx37anzrO6ON9Gb43xs4hVlEEOFv-5gTM66xa3lYZIXuXtsr9V5SlW4Jn6lDJTZOO6AByG<br> EpEVDg9LeUcRPO13Vp2VUpuxjvh96-tUxUmyMDcSSypoND4z7AtuwXzSNjTxgYc-wtJYE8J8VTsd<br> e2c9iCPJG8ZoTmfrSc+8vxIUM0Q6aHTf7danfR7F5blgyNh5e5jHpS5ObYZMuJNGVxA+8jG6jVU1<br> WfPObNdjrmXsodnVJax+3PzKDKtdrLbMevI0WznLDp3sZ6d+7n-sVawNgSzQ3fVsPdDzl6HbauhQ<br> D9h2UCTAK4QzwlthueIh2uFMmONwJh4S8rXjiLAdUJCYpJF5Fbp0FX+4q2-Gvf7XwrE3RQjZ8Wxo<br> vGL4mbGCD0CM3sBE-mF8cqLaixi-syDCqizUItdkUhbdpVeG7b56Qth3jI2tJlB507iX01DFxGed<br> V1W07QEltjJMSbiUGww1xpkIGiBa4QxXLEWFCKlmktzhTgkM8kmmcUVt6inNqpC3ebt448-UsDkC<br> rGLMXIFIoLJzzSibfIN6pSQkQ03b5LGggHvf8uSIXBDakja75taUmwhGEKtAXk1hUigtbx8As-o0<br> I8DE4yKW1TBI6DOvLRZ25pu9YAjTxhMSdO0eyKcycTOeHvUS21QgQCcv24XD4jY0P0GIBDw2lW10<br> IJ2+A98I1YHoT7ZkRmMg2WJLFLHtNH7kcvwsRWsJdnMveYV9SwcKvG2ofCe6Pxg=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://eos.tier2-kol.res.in:1094//04/12018/d9c6b310-0a0a-11ea-a389-0242790999e0'>root://<span title='144.16.112.17:xrootd'><b>eos.tier2-kol.res.in:1094</b></span>//04/12018/d9c6b310-0a0a-11ea-a389-0242790999e0</a><br><br><br><b>Duration</b>: Nov 18, 2019 14:56 - <b><font color=red>continues</font></b> (26d 9h 28m until now) 233041 Storages : [ALICE::Kolkata::SE] - ADD test fails 2019-11-18T13:40:48.000Z 2019-11-18T13:40:48.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::SE]</b><br>ADD test fails<br><br>Duration: Nov 18, 2019 14:40 - <b><font color=red>continues</font></b> (26d 9h 44m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Kolkata::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Mon Nov 18 <font color='#631BAA'><b>14:37:14</b></font> CET 2019</b></font><br> Duration: 4s<br> /home/monalisa/xrootd/bin/xrdcp exited with exit code 51: [FATAL] Socket timeout<br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> FWU4YUjj2iLBdIK5tQa0oIy+OoDfoU4yI-2smU74wCq2trk81u7ENpsTml8jjBewqWwEJ5yK0hdw<br> ZqPXNQ5xuOyI+39cSCXTZGYYwp7zsnk-9GKly5yQXrrAc05OX-U53M68auW6zdkgUY0mMP88EH+i<br> 79AjQzrI+TSP8BjviCE=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgIevcYJqacEsLc4P42+4+SPFDjYysbJFOAxYFQYZpfO0tMx1MRIUQrQAOwSu4AZOOswRxMS1<br> Tos9-F8Atin-049-TeTEAe+0UluGuKnH6EmGo62p3WGHMnihgtwhwFikITJSCylgj30DhkyfeKYS<br> 9TEjMTsWzM3H7-lD3AOTXqtNQVA4MmSZIiu+MaRK+xSRVMdQl3lagLSoBHdBJ-VfMyMl2Zx1UspW<br> HRibpKmgjA3QB1F32N4+LY1wov-oSYqjlQjKE-jWEmlmwED9bn1bQg+NkBiXWPNzO2XkS-bbHImt<br> hoPOErT20v9tMONjxd0QSUkjySdQ+ETJrOPokElOffd5Ytsf1Y-ci8r-YDsEhSm+wjCu0md2nUOu<br> Pokq0wFO11iSTaOP6NFeMpIFNB7aJRzR7IY2PlSUBcCd1-K8de5AExczwZzpmx-eCLaI5M9Giv04<br> 05sR90Jbw8iEl+rT58WQOVZzthOt+FhBjb4rch72+QdgL-4wCAcRg2-BL8Nu58cl2eUdP3e6GBZu<br> p6Z7KvjlxLleKW8jsdC-Z2ZcmkY1Dpzm1Ox7H9UMem33WAOegi2NM+MIKeqLt5m9TRRyeAUyPzx3<br> aumT4fqRNHmPCm38jW0fmHT9mrVnCNc9rcsTjwfZKoSvkVxwtROPSkAmbWLUUILYtsQ5ZiJRpkFL<br> Oy0A2-iMxmWScYbA9lTX8c4fuEcNphOO-lPoqHeKPD-vC9tavoSESAq1DPXAEgxbeorQCSBmwoOG<br> fJp3Cd45NdRVZjN+yXhwzTM6aSptZmHbWSZpE2CXkVQMwsnuGuuAAoF+64vuSc05A7+cvSbN4SbC<br> R+L+Glf3hHBwWvgguE8Jt1uwJeUItdxLyRfKKTUwxzoqzPSCPvOrek5Arx2hwdS68uLy4Zg-f5we<br> 5kTGR40wDvy1ECTYyXE2vAbeWWqGGd47WizHaS7Cvc3fUsUdBR7RCNoQd6iWxI+DEEITtiCtb5ZQ<br> +U89JgaWSRsJaXD-q5aRQElinUqVr6VVHHtgLM80HuuTju3ebkdTo5R33S6qG7YO7VZjf2DGCg==<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://dcache-server.tier2-kol.res.in:1094//13/27433/85b94870-0a08-11ea-a0d5-0242790999e0'>root://<span title='144.16.112.16:xrootd'><b>dcache-server.tier2-kol.res.in:1094</b></span>//13/27433/85b94870-0a08-11ea-a0d5-0242790999e0</a><br><br><br><b>Duration</b>: Nov 18, 2019 14:40 - <b><font color=red>continues</font></b> (26d 9h 44m until now) 232778 Site services : [Tsukuba] - MonALISA is down 2019-11-13T02:24:24.000Z 2019-11-13T02:24:24.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Tsukuba]</b><br>MonALISA is down<br><br>Duration: Nov 13, 2019 03:24 - <b><font color=red>continues</font></b> (31d 21h until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Tsukuba]</b><br>MonALISA is not running<br><br><b>Duration</b>: Nov 13, 2019 03:24 - <b><font color=red>continues</font></b> (31d 21h until now) 232764 Storages : [ALICE::RAL::SE] - ADD test fails 2019-11-12T14:48:55.000Z 2019-11-12T14:48:55.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::RAL::SE]</b><br>ADD test fails<br><br>Duration: Nov 12, 2019 15:48 - <b><font color=red>continues</font></b> (32d 8h 35m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::RAL::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Tue Nov 12 <font color='#631BAA'><b>15:45:16</b></font> CET 2019</b></font><br> Duration: 5s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3009] Unable to do async PUT request. File creation canceled since pool is full; No space left on device</font><br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> Oacy5IXq-FXhArsKeh-AbVqo2ho80oLYnmRblqbC6FugiKZNQc5dXDXTh58P7ffnR9RKERmFBFS4<br> zKo5hb3jXKwVerhvf12S1Cd8RGprWfYO14ICCr6ylefgF1GsuO7uIacv5X6Pm8Ae9R29Waoc+34u<br> NBzAhLETZC4ZX5a12-s=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgAaBl1wuB0UQU1RHfEQb3KjW5vvs2bFbji8EG-mRGtsSbmv-XAz4sUkeO+C9GjUZPJUhyqEV<br> nbyxTH-j5YOUyBZzHH55tIpiJ86CCa8ukE7Jdw9JC+JZA+y4jmPRkDKIe4Mzq-xZg2q93NZ+eggs<br> zhp5-va1Zw-wHBRN78pYeeGOXgvJAiS2drtJ1DoaWCvdhQK8m2jL2qva-YkZcq2yFLDjvdAYvJHh<br> 9pt8QKXyeVCig9rMXDoJceuL6Bp7lMlKfvp+HyefR97gS7v9rXIb6g+hYEB3hKEL5e9I0ReDGMo0<br> Sds5oY1-YneNiJ-YBLq5ThKXPBD3tn1A9zG53D7du9M+6gyKngCCcUSZ35zeryWwdJ7SLYpZRz7a<br> dTLin7-OtpYvnvYmsrIDoEhjJ6ZF1sPFFhImPHIKG1KwYZhj8XlBFyeT3I2j3tyibYG7TU+Z8fkT<br> Aun8dPoAjtWIQi7HlWFV-OsWiTUL1XBN3-jyTF7d2jfqLTZzKryc2z36qQPTiYbMcg18pMiD6ZMw<br> gMK08fo5xUMZJ5RNRebOJrDJLEmhjsXJQHiqpAq12TWFOHRSxDKp5u526b1hnH9ivmvJ9yzE6kBv<br> kYFyOoMFKGsXZXJnTU22iZQpIhUlM5MPwf8E3DrxjdRLh262-baJ0qYhz9p2vxq75rEGypjb7OgK<br> UVTRcy3tbmax-stFZ5lipfaV8EHN-zsI5k4rtKPKcF-DETiodQuXJEwFbZyWg0GoBHndfYp+ZI76<br> dLzfm59ZIrgG03ONKYl78k3jChIXpYcefSfb7WJohaxz8QCiSqFntp6kXVPrBOwJNORMlcNnajBi<br> 87cw2yu+AzjIqiLetxbV-OfjYQ-4kjppRMSi3OVHydOwn-cMQDav-Xp3LK42xbCay+UGo-yTwq+c<br> XFfzIHTeuwoYOHFG7b2cfJlWCY5jAcEVRzPDaLp9Vx3qk-jvhV06vbzJVw7cQqTeZ3Nfyv1WFFGS<br> rKtuZoi1t-FJV+JpkJSs7rOQV2U8BLYIVgAxBdRzVXQggoncM8+2z1fnYvtef4CVVPkbDBfjQ2eK<br> YzGRZ7tI4eMKJrcq4nqsgeMgf9jDGTK1nijvcAOa-xQb22jTduK-G3EsyWZD5LGB8gKpMy3KxO2k<br> VGoYxPU=<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://cgendlf.ads.rl.ac.uk:1094//castor/ads.rl.ac.uk/prod/alice/disk/10/58045/078ac840-055b-11ea-8c2e-0242a3ceac7a'>root://<span title='130.246.182.36:xrootd'><b>cgendlf.ads.rl.ac.uk:1094</b></span>//castor/<span title='Cannot resolve this name'><b>ads.rl.ac.uk</b></span>/prod/alice/disk/10/58045/078ac840-055b-11ea-8c2e-0242a3ceac7a</a><br><br><br><b>Duration</b>: Nov 12, 2019 15:48 - <b><font color=red>continues</font></b> (32d 8h 35m until now) 232669 Proxies : [ICM] - Proxy Server has expired 2019-11-09T05:41:57.000Z 2019-11-09T05:41:57.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[ICM]</b><br>Proxy Server has expired<br><br>Duration: Nov 09, 2019 06:41 - <b><font color=red>continues</font></b> (35d 17h 42m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[ICM]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': Unknown host "myproxy.cern.ch" Unable to connect to myproxy.cern.ch<br><br><b>Duration</b>: Nov 09, 2019 06:41 - <b><font color=red>continues</font></b> (35d 17h 42m until now) 232606 Site services : [Wuhan] - Monitor is down 2019-11-07T04:40:46.000Z 2019-11-07T04:40:46.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>Monitor is down<br><br>Duration: Nov 07, 2019 05:40 - <b><font color=red>continues</font></b> (37d 18h 44m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Wuhan]</b><br>ERROR: Could not get Config. (Error Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' ). Exit code 1<br><br><b>Duration</b>: Nov 07, 2019 05:40 - <b><font color=red>continues</font></b> (37d 18h 44m until now) 232376 Site services : [Phoenix] - MonALISA is down 2019-10-29T19:43:42.000Z 2019-10-29T19:43:42.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Phoenix]</b><br>MonALISA is down<br><br>Duration: Oct 29, 2019 20:43 - <b><font color=red>continues</font></b> (46d 3h 41m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Phoenix]</b><br>MonALISA is not running<br><br><b>Duration</b>: Oct 29, 2019 20:43 - <b><font color=red>continues</font></b> (46d 3h 41m until now) 232365 Proxies : [Tsukuba] - Alien proxy has expired 2019-10-29T11:15:05.000Z 2019-10-29T11:15:05.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Tsukuba]</b><br>Alien proxy has expired<br><br>Duration: Oct 29, 2019 12:15 - <b><font color=red>continues</font></b> (46d 12h 9m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Tsukuba]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fDC+3dch+2fDC+3dcern+2fOU+3dOrganic+20Units+2fOU+3dUsers+2fCN+3dlbetev+2fCN+3d374855+2fCN+3dLatchezar+20Betev+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Oct 29, 2019 12:15 - <b><font color=red>continues</font></b> (46d 12h 9m until now) 232364 Proxies : [Wuhan] - Alien proxy has expired 2019-10-29T11:15:05.000Z 2019-10-29T11:15:05.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Alien proxy has expired<br><br>Duration: Oct 29, 2019 12:15 - <b><font color=red>continues</font></b> (46d 12h 9m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fC+3dCN+2fO+3dHEP+2fO+3dCCNU+2fOU+3dPHYS+2fCN+3dJianlin+20Zhu+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Oct 29, 2019 12:15 - <b><font color=red>continues</font></b> (46d 12h 9m until now) 232076 Proxies : [Wuhan] - Delegated proxy has expired 2019-10-18T09:44:02.000Z 2019-10-18T09:44:02.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Delegated proxy has expired<br><br>Duration: Oct 18, 2019 11:44 - <b><font color=red>continues</font></b> (57d 13h 40m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Unable to get delegation Failed to receive credentials. ERROR from myproxy-server: certificate chain verification failed X509_verify_cert() failed: certificate has expired authentication failed<br><br><b>Duration</b>: Oct 18, 2019 11:44 - <b><font color=red>continues</font></b> (57d 13h 40m until now) 232075 Proxies : [Wuhan] - Proxy Server has expired 2019-10-18T09:44:02.000Z 2019-10-18T09:44:02.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Proxy Server has expired<br><br>Duration: Oct 18, 2019 11:44 - <b><font color=red>continues</font></b> (57d 13h 40m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Wuhan]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': globus_gsi_gssapi: Error with GSI credential globus_gsi_gssapi: Error with gss credential handle globus_credential: Error with credential: The proxy credential: /var/lib/vobox/alice/proxy_repository/+2fC+3dCN+2fO+3dHEP+2fO+3dCCNU+2fOU+3dPHYS+2fCN+3dJianlin+20Zhu+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin with subject: /C=CN/O=HEP/O=CCNU/OU=PHYS/CN=Jianlin Zhu/CN=2031149731/CN=1453357366/CN=811364488/CN=1593813194 expired 23 minutes ago.<br><br><b>Duration</b>: Oct 18, 2019 11:44 - <b><font color=red>continues</font></b> (57d 13h 40m until now) 231986 Storages : [ALICE::Poznan::SE] - ADD test fails 2019-10-15T14:18:27.000Z 2019-10-15T14:18:27.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Poznan::SE]</b><br>ADD test fails<br><br>Duration: Oct 15, 2019 16:18 - <b><font color=red>continues</font></b> (60d 9h 6m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::Poznan::SE]</b><br>Test finished at: <font color='#2A1FAA'><b>Tue Oct 15 <font color='#631BAA'><b>16:15:38</b></font> CEST 2019</b></font><br> Duration: 8s<br> /home/monalisa/xrootd/bin/xrdcp exited with exit code 51: [FATAL] Socket timeout<br> <br> Full command was:<br> export XRD_CONNECTIONWINDOW=<I>&quot;3&quot;</I><br> export XRD_CONNECTIONRETRY=<I>&quot;1&quot;</I><br> export XRD_TIMEOUTRESOLUTION=<I>&quot;1&quot;</I><br> export XRD_PREFERIPV4=<I>&quot;1&quot;</I><br> export XRD_REQUESTTIMEOUT=<I>&quot;60&quot;</I><br> /home/monalisa/xrootd/bin/xrdcp --nopbar --path --verbose --force --posc /home/monalisa/MLrepository/bin/setesting/testfile &apos;-ODauthz=-----BEGIN SEALED CIPHER-----<br> iK5wEbQDRibxm6wUeCiish864bMObMcaHD2cDRgBZQGP2E7Jb2cz44w1o0Trd2FXZ+iLUeWGCuuQ<br> Lg44GGfftloCDGiN7tDJER6yiXumoG1BK8sRVntHJke4lfPi5aFu8+6Nva7CaAL0opSsmHtr0mbZ<br> 8IyxLW+WCj0pkj2DzRg=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgBVnVntsb7fy9Vqon73pkSHMELMIRRZqjTOXjXCQh0Dn7Loa2VC2lrpsWknLFWlN9GWqP2ND<br> 7RG27JUy5iMA6pJ4NJPGJTZggCVy1VzIQ80ve0Ejbqp3tKeCzynjZ8Fl9FFT9ry5xxuP4PQ5PuoW<br> ISF6rvAsD1poqByNr6oF8AzYKjcuC9LwDOrsROK9MzGblYGbOWEHJMude81pKQvt6WLv2C97VGMq<br> 1u40XBl03j+7Q2oIarTBsVQZEQ-aISkSUizGkk8j-RTtCMyJqPa7yYtL-6ojFOg2C7c8BUwBSxZm<br> zTlICE1-qFLu4RkZUcezXj-Z1yQIPKfUWi+r4ZEqOeN3a8LE2DBBKPwfEhhell61eUOxUEIRdP9p<br> JlFHbDzN+kXhddOJj4dFTBhdfN0OeewrrEwoTR-OKewkn0uF+SduNNT0fJDocxtd7-oZ1QjqWtoJ<br> 6FIDrAZKysVwpY7tmbyZCWk7Pt7D0FJQ122-91eBpXVBRxvgUYOMX6l2rcuktVGeYHQgm5cEiDlo<br> 3XVaDY0dbwBkjvE5dx9B9W2uhlYnL8Do7p82ZYD2WwpfHfE7vqnzQEI-dp9yHg5Fr9fHW7d9IFaG<br> 3zEWFsoZn355qBspAOViq0v+8nfB+OaTKIQ3cFeD2HXzdORVrabTAUCG2gRFfK7h8Rz1tDnkwdud<br> TiDZg1ALVidaj+t0ji7JM8JVFoahPizbJYdGNqzGYM7qJcTfgk-L4d4Bmy5er3jgUKlijSVR9kJH<br> okeO9kYt5RCuUHdH-85Z9Oi-Z3Ddzse6lHHBVJFZido18V26f6pWKPSLRba+PdLBx-wozo8LT7AK<br> UJjpA-MyZL96OuzgJnD71oBLFkokBzG0dmKp-EmqJsSYG9DCQUhGvzVpF+nsmE93+cwI0-zY89qk<br> 8SqK8QuG59-QtOBtc-jrxUC+oLMx6vlWK57EXC8ELEGbFCJaSqI2-q-y7T2dOxnaxD7O0Iv+vwov<br> SpjyDJucqfu+JOES7mfb-ed-bASGuLLgUZ7KsLiqVniWPdGOUj404xk6PZcGU0oLwvYqSOTPfQ==<br> -----END SEALED ENVELOPE-----<br> &apos; <a target=_blank href='root://xrootd.reef.man.poznan.pl:1094//04/35680/3e589750-ef56-11e9-8110-0242a3ceac7a'>root://<span title='150.254.198.29:xrootd'><b>xrootd.reef.man.poznan.pl:1094</b></span>//04/35680/3e589750-ef56-11e9-8110-0242a3ceac7a</a><br><br><br><b>Duration</b>: Oct 15, 2019 16:18 - <b><font color=red>continues</font></b> (60d 9h 6m until now) 231186 Site services : [COMSATS] - MonALISA is down 2019-09-21T06:39:30.000Z 2019-09-21T06:39:30.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[COMSATS]</b><br>MonALISA is down<br><br>Duration: Sep 21, 2019 08:39 - <b><font color=red>continues</font></b> (84d 16h 45m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[COMSATS]</b><br>MonALISA is not running<br><br><b>Duration</b>: Sep 21, 2019 08:39 - <b><font color=red>continues</font></b> (84d 16h 45m until now) 231184 Site services : [COMSATS] - CE is down 2019-09-21T04:24:06.000Z 2019-09-21T04:24:06.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[COMSATS]</b><br>CE is down<br><br>Duration: Sep 21, 2019 06:24 - <b><font color=red>continues</font></b> (84d 19h until now) <b><i><font size=+1>Site services</font></i></b><br><b>[COMSATS]</b><br>cern-56-24-242.comsats.edu.pkDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Sep 21, 2019 06:24 - <b><font color=red>continues</font></b> (84d 19h until now) 231173 Site services : [COMSATS] - Monitor is down 2019-09-21T01:07:09.000Z 2019-09-21T01:07:09.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[COMSATS]</b><br>Monitor is down<br><br>Duration: Sep 21, 2019 03:07 - <b><font color=red>continues</font></b> (84d 22h 17m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[COMSATS]</b><br>cern-56-24-242.comsats.edu.pkPinging service ClusterMonitor... The service is running at cern-56-24-242.comsats.edu.pk:8084, uri ClusterMonitor Attempt 1 (Sat Sep 21 06:05:53 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 2 (Sat Sep 21 06:05:59 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 3 (Sat Sep 21 06:06:04 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to cern-56-24-242.comsats.edu.pk:8084 (connect: Connection refused) at (eval 103) line 1 ). Exit code 1<br><br><b>Duration</b>: Sep 21, 2019 03:07 - <b><font color=red>continues</font></b> (84d 22h 17m until now) 231172 Site services : [COMSATS] - CMreport is down 2019-09-21T01:07:09.000Z 2019-09-21T01:07:09.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[COMSATS]</b><br>CMreport is down<br><br>Duration: Sep 21, 2019 03:07 - <b><font color=red>continues</font></b> (84d 22h 17m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[COMSATS]</b><br>Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Sep 21, 2019 03:07 - <b><font color=red>continues</font></b> (84d 22h 17m until now) 231171 Proxies : [COMSATS] - Alien proxy has expired 2019-09-21T01:03:58.000Z 2019-09-21T01:03:58.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[COMSATS]</b><br>Alien proxy has expired<br><br>Duration: Sep 21, 2019 03:03 - <b><font color=red>continues</font></b> (84d 22h 20m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[COMSATS]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fDC+3dch+2fDC+3dcern+2fOU+3dOrganic+20Units+2fOU+3dUsers+2fCN+3dlbetev+2fCN+3d374855+2fCN+3dLatchezar+20Betev+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Sep 21, 2019 03:03 - <b><font color=red>continues</font></b> (84d 22h 20m until now) 231170 Proxies : [COMSATS] - Delegated proxy has expired 2019-09-21T01:02:58.000Z 2019-09-21T01:02:58.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[COMSATS]</b><br>Delegated proxy has expired<br><br>Duration: Sep 21, 2019 03:02 - <b><font color=red>continues</font></b> (84d 22h 21m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[COMSATS]</b><br>Cannot read X509_USER_PROXY<br><br><b>Duration</b>: Sep 21, 2019 03:02 - <b><font color=red>continues</font></b> (84d 22h 21m until now) 231169 Proxies : [COMSATS] - Proxy Server has expired 2019-09-21T01:02:58.000Z 2019-09-21T01:02:58.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[COMSATS]</b><br>Proxy Server has expired<br><br>Duration: Sep 21, 2019 03:02 - <b><font color=red>continues</font></b> (84d 22h 21m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[COMSATS]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': Attempt 2 globus_credential: Error reading proxy credential globus_sysconfig: Could not find a valid proxy certificate file location globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fDC+3dch+2fDC+3dcern+2fOU+3dOrganic+20Units+2fOU+3dUsers+2fCN+3dlbetev+2fCN+3d374855+2fCN+3d<br><br><b>Duration</b>: Sep 21, 2019 03:02 - <b><font color=red>continues</font></b> (84d 22h 21m until now) 231118 Site services : [SPbSU-CC] - MonALISA is down 2019-09-19T15:57:24.000Z 2019-09-19T15:57:24.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[SPbSU-CC]</b><br>MonALISA is down<br><br>Duration: Sep 19, 2019 17:57 - <b><font color=red>continues</font></b> (86d 7h 27m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[SPbSU-CC]</b><br>MonALISA is not running<br><br><b>Duration</b>: Sep 19, 2019 17:57 - <b><font color=red>continues</font></b> (86d 7h 27m until now) 231031 Proxies : [Grenoble] - Delegated proxy has expired 2019-09-18T08:40:55.000Z 2019-09-18T08:40:55.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Grenoble]</b><br>Delegated proxy has expired<br><br>Duration: Sep 18, 2019 10:40 - <b><font color=red>continues</font></b> (87d 14h 43m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Grenoble]</b><br>Cannot read X509_USER_PROXY<br><br><b>Duration</b>: Sep 18, 2019 10:40 - <b><font color=red>continues</font></b> (87d 14h 43m until now) 231030 Proxies : [Grenoble] - Proxy Server has expired 2019-09-18T08:40:55.000Z 2019-09-18T08:40:55.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Grenoble]</b><br>Proxy Server has expired<br><br>Duration: Sep 18, 2019 10:40 - <b><font color=red>continues</font></b> (87d 14h 43m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Grenoble]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': Attempt 2 globus_credential: Error reading proxy credential globus_sysconfig: Could not find a valid proxy certificate file location globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: +2fDC+3dch+2fDC+3dcern+2fOU+3dOrganic+20Units+2fOU+3dUsers+2fCN+3dmmmartin+2fCN+3d697178+2fCN+3dMiguel+20Martinez+20Pedreira+2fCN+3d<br><br><b>Duration</b>: Sep 18, 2019 10:40 - <b><font color=red>continues</font></b> (87d 14h 43m until now) 231029 Proxies : [Grenoble] - Alien proxy has expired 2019-09-18T08:40:54.000Z 2019-09-18T08:40:54.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Grenoble]</b><br>Alien proxy has expired<br><br>Duration: Sep 18, 2019 10:40 - <b><font color=red>continues</font></b> (87d 14h 43m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Grenoble]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: +2fDC+3dch+2fDC+3dcern+2fOU+3dOrganic+20Units+2fOU+3dUsers+2fCN+3dmmmartin+2fCN+3d697178+2fCN+3dMiguel+20Martinez+20Pedreira+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Sep 18, 2019 10:40 - <b><font color=red>continues</font></b> (87d 14h 43m until now) 230433 Site services : [alitraintest3.cern.ch] - Problem with CACHE 2019-09-02T12:46:58.000Z 2019-09-02T12:46:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Problem with CACHE<br><br>Duration: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (103d 10h 37m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Path: , usage: 100%, monitoring status: ok<br><br><b>Duration</b>: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (103d 10h 37m until now) 230432 Site services : [alitraintest3.cern.ch] - Problem with LOG 2019-09-02T12:46:58.000Z 2019-09-02T12:46:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Problem with LOG<br><br>Duration: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (103d 10h 37m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Path: , usage: 100%, monitoring status: ok<br><br><b>Duration</b>: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (103d 10h 37m until now) 230431 Site services : [alitraintest3.cern.ch] - Problem with TMP 2019-09-02T12:46:58.000Z 2019-09-02T12:46:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Problem with TMP<br><br>Duration: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (103d 10h 37m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[alitraintest3.cern.ch]</b><br>Path: , usage: 100%, monitoring status: ok<br><br><b>Duration</b>: Sep 02, 2019 14:46 - <b><font color=red>continues</font></b> (103d 10h 37m until now) 230278 Site services : [CORI] - MonALISA is down 2019-08-29T18:36:18.000Z 2019-08-29T18:36:18.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>MonALISA is down<br><br>Duration: Aug 29, 2019 20:36 - <b><font color=red>continues</font></b> (107d 4h 48m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 29, 2019 20:36 - <b><font color=red>continues</font></b> (107d 4h 48m until now) 229669 Site services : [CERN_HLT] - CMreport is down 2019-08-11T03:54:23.000Z 2019-08-11T03:54:23.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>CMreport is down<br><br>Duration: Aug 11, 2019 05:54 - <b><font color=red>continues</font></b> (125d 19h 30m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Cannot execute /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/bin/alien<br><br><b>Duration</b>: Aug 11, 2019 05:54 - <b><font color=red>continues</font></b> (125d 19h 30m until now) 229668 Site services : [CERN_HLT] - MonALISA is down 2019-08-11T03:48:43.000Z 2019-08-11T03:48:43.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>MonALISA is down<br><br>Duration: Aug 11, 2019 05:48 - <b><font color=red>continues</font></b> (125d 19h 36m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 11, 2019 05:48 - <b><font color=red>continues</font></b> (125d 19h 36m until now) 229251 Site services : [CORI] - Monitor is down 2019-07-30T17:06:38.000Z 2019-07-30T17:06:38.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>Monitor is down<br><br>Duration: Jul 30, 2019 19:06 - <b><font color=red>continues</font></b> (137d 6h 18m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. Jul 30 09:53:32 info Reading the configuration file from /global/homes/a/alicepro/.alien/alice.conf Jul 30 09:53:32 info Error reading the config file /global/homes/a/alicepro/.alien/alice.conf: Error in config file /global/homes/a/alicepro/.alien/alice.conf, line 2: unable to parse line at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 162 Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. cori21-224.nersc.govPinging service ClusterMonitor... The service is running at cori21-224.nersc.gov:8084, uri ClusterMonitor Attempt 1 (Tue Jul 30 09:53:32 2019) Use of uninitialized value in pattern match (m//) at /global/homes/a/alicepro/alien.v2-19.446_new/scripts/pingService.pl line 115. Attempt 2 (Tue Jul 30 09:53:37 2019) Use of uninitialized value in pattern match (m//) at /global/homes/a/alicepro/alien.v2-19.446_new/scripts/pingService.pl line 115. Attempt 3 (Tue Jul 30 09:53:42 2019) Use of uninitialized value in pattern match (m//) at /global/homes/a/alicepro/alien.v2-19.446_new/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to cori21-224.nersc.gov:8084 (connect: Connection refused) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Jul 30, 2019 19:06 - <b><font color=red>continues</font></b> (137d 6h 18m until now) 229087 Proxies : [Torino] - Proxy Server has expired 2019-07-26T08:38:26.000Z 2019-07-26T08:38:26.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Torino]</b><br>Proxy Server has expired<br><br>Duration: Jul 26, 2019 10:38 - <b><font color=red>continues</font></b> (141d 14h 46m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Torino]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': Attempt 2 globus_credential: Error reading proxy credential globus_sysconfig: Could not find a valid proxy certificate file location globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fC+3dIT+2fO+3dINFN+2fOU+3dPersonal+20Certificate+2fL+3dTorino+2fCN+3dStefano+20Lusso+2fCN+3d<br><br><b>Duration</b>: Jul 26, 2019 10:38 - <b><font color=red>continues</font></b> (141d 14h 46m until now) 228737 Site services : [CORI] - CE is down 2019-07-17T17:47:58.000Z 2019-07-17T17:47:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>CE is down<br><br>Duration: Jul 17, 2019 19:47 - <b><font color=red>continues</font></b> (150d 5h 36m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>/bin/bash: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/bash) /bin/bash: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/bash) /bin/sh: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/sh) Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. /bin/bash: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/bash) /bin/sh: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/sh) Jul 17 10:45:57 info Reading the configuration file from /global/homes/a/alicepro/.alien/alice.conf Jul 17 10:45:57 info Error reading the config file /global/homes/a/alicepro/.alien/alice.conf: Error in config file /global/homes/a/alicepro/.alien/alice.conf, line 2: unable to parse line at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 162 Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. cori21-224.nersc.govDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Jul 17, 2019 19:47 - <b><font color=red>continues</font></b> (150d 5h 36m until now) 228579 Site services : [NIPNE] - MonALISA is down 2019-07-11T06:37:20.000Z 2019-07-11T06:37:20.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[NIPNE]</b><br>MonALISA is down<br><br>Duration: Jul 11, 2019 08:37 - <b><font color=red>continues</font></b> (156d 16h 47m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[NIPNE]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jul 11, 2019 08:37 - <b><font color=red>continues</font></b> (156d 16h 47m until now) 228380 Site services : [Kosice] - MonALISA is down 2019-07-02T16:34:57.000Z 2019-07-02T16:34:57.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Kosice]</b><br>MonALISA is down<br><br>Duration: Jul 02, 2019 18:34 - <b><font color=red>continues</font></b> (165d 6h 49m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Kosice]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jul 02, 2019 18:34 - <b><font color=red>continues</font></b> (165d 6h 49m until now) 228074 Site services : [Pikachu] - MonALISA is down 2019-06-27T14:54:30.000Z 2019-06-27T14:54:30.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Pikachu]</b><br>MonALISA is down<br><br>Duration: Jun 27, 2019 16:54 - <b><font color=red>continues</font></b> (170d 8h 30m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Pikachu]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jun 27, 2019 16:54 - <b><font color=red>continues</font></b> (170d 8h 30m until now) 228015 Central services : [aliendb06f.cern.ch] - mysql at aliendb06f.cern.ch is down 2019-06-25T07:49:17.000Z 2019-06-25T07:49:17.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06f.cern.ch]</b><br>mysql at aliendb06f.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06f.cern.ch]</b><br>mysql at aliendb06f.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) 228014 Central services : [aliendb06f.cern.ch] - mysql2 at aliendb06f.cern.ch is down 2019-06-25T07:49:17.000Z 2019-06-25T07:49:17.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06f.cern.ch]</b><br>mysql2 at aliendb06f.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06f.cern.ch]</b><br>mysql2 at aliendb06f.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) 228013 Central services : [aliendb06g.cern.ch] - mysql at aliendb06g.cern.ch is down 2019-06-25T07:49:17.000Z 2019-06-25T07:49:17.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06g.cern.ch]</b><br>mysql at aliendb06g.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06g.cern.ch]</b><br>mysql at aliendb06g.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) 228012 Central services : [aliendb06g.cern.ch] - mysql3 at aliendb06g.cern.ch is down 2019-06-25T07:49:17.000Z 2019-06-25T07:49:17.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06g.cern.ch]</b><br>mysql3 at aliendb06g.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06g.cern.ch]</b><br>mysql3 at aliendb06g.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) 228011 Central services : [aliendb06h.cern.ch] - mysql at aliendb06h.cern.ch is down 2019-06-25T07:49:16.000Z 2019-06-25T07:49:16.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06h.cern.ch]</b><br>mysql at aliendb06h.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06h.cern.ch]</b><br>mysql at aliendb06h.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) 228010 Central services : [aliendb06h.cern.ch] - mysql2 at aliendb06h.cern.ch is down 2019-06-25T07:49:16.000Z 2019-06-25T07:49:16.000Z <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06h.cern.ch]</b><br>mysql2 at aliendb06h.cern.ch is down<br><br>Duration: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) <b><i><font size=+1>Central services</font></i></b><br><b>[aliendb06h.cern.ch]</b><br>mysql2 at aliendb06h.cern.ch is down<br><br><b>Duration</b>: Jun 25, 2019 09:49 - <b><font color=red>continues</font></b> (172d 15h 35m until now) 227880 Site services : [CERN_HLT] - Problem with TMP 2019-06-19T07:36:49.000Z 2019-06-19T07:36:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Problem with TMP<br><br>Duration: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (178d 15h 48m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Path: /var/lib/aliprod/ALICE/tmp, usage: 95%, monitoring status: ok<br><br><b>Duration</b>: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (178d 15h 48m until now) 227879 Site services : [CERN_HLT] - Problem with LOG 2019-06-19T07:36:49.000Z 2019-06-19T07:36:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Problem with LOG<br><br>Duration: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (178d 15h 48m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Path: /var/lib/aliprod/ALICE/log, usage: 95%, monitoring status: ok<br><br><b>Duration</b>: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (178d 15h 48m until now) 227878 Site services : [CERN_HLT] - Problem with CACHE 2019-06-19T07:36:48.000Z 2019-06-19T07:36:48.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Problem with CACHE<br><br>Duration: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (178d 15h 48m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Path: /var/lib/aliprod/ALICE/cache, usage: 95%, monitoring status: ok<br><br><b>Duration</b>: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (178d 15h 48m until now) 227710 Site services : [CERN_HLTDEV] - MonALISA is down 2019-06-11T08:31:26.000Z 2019-06-11T08:31:26.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLTDEV]</b><br>MonALISA is down<br><br>Duration: Jun 11, 2019 10:31 - <b><font color=red>continues</font></b> (186d 14h 53m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLTDEV]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jun 11, 2019 10:31 - <b><font color=red>continues</font></b> (186d 14h 53m until now) 227229 Storages : [ALICE::ICM::SE] - ADD test fails 2019-05-29T07:34:32.000Z 2019-05-29T07:34:32.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ICM::SE]</b><br>ADD test fails<br><br>Duration: May 29, 2019 09:34 - <b><font color=red>continues</font></b> (199d 15h 50m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::ICM::SE]</b><br>ADD test fails<br><br><b>Duration</b>: May 29, 2019 09:34 - <b><font color=red>continues</font></b> (199d 15h 50m until now) 227176 Site services : [GRIF_IRFU_ARC] - MonALISA is down 2019-05-27T16:39:07.000Z 2019-05-27T16:39:07.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU_ARC]</b><br>MonALISA is down<br><br>Duration: May 27, 2019 18:39 - <b><font color=red>continues</font></b> (201d 6h 45m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU_ARC]</b><br>MonALISA is not running<br><br><b>Duration</b>: May 27, 2019 18:39 - <b><font color=red>continues</font></b> (201d 6h 45m until now) 226934 Site services : [UNAM] - MonALISA is down 2019-05-21T10:34:15.000Z 2019-05-21T10:34:15.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM]</b><br>MonALISA is down<br><br>Duration: May 21, 2019 12:34 - <b><font color=red>continues</font></b> (207d 12h 50m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM]</b><br>MonALISA is not running<br><br><b>Duration</b>: May 21, 2019 12:34 - <b><font color=red>continues</font></b> (207d 12h 50m until now) 226712 Proxies : [MEPHI] - Alien proxy has expired 2019-05-20T12:19:10.000Z 2019-05-20T12:19:10.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Alien proxy has expired<br><br>Duration: May 20, 2019 14:19 - <b><font color=red>continues</font></b> (208d 11h 5m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fC+3dRU+2fO+3dRDIG+2fOU+3dusers+2fOU+3dspbu+2eru+2fCN+3dAndrey+20Zarochentsev+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: May 20, 2019 14:19 - <b><font color=red>continues</font></b> (208d 11h 5m until now) 226171 Site services : [MEPHI] - Monitor is down 2019-05-03T21:40:30.000Z 2019-05-03T21:40:30.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>Monitor is down<br><br>Duration: May 03, 2019 23:40 - <b><font color=red>continues</font></b> (225d 1h 44m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' Syntax: pingService.pl <serviceName> <logDir>. Exit code 1<br><br><b>Duration</b>: May 03, 2019 23:40 - <b><font color=red>continues</font></b> (225d 1h 44m until now) 226169 Proxies : [MEPHI] - Delegated proxy has expired 2019-05-03T21:36:03.000Z 2019-05-03T21:36:03.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Delegated proxy has expired<br><br>Duration: May 03, 2019 23:36 - <b><font color=red>continues</font></b> (225d 1h 48m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Unable to get delegation Unknown host "myproxy.cern.ch" Unable to connect to myproxy.cern.ch<br><br><b>Duration</b>: May 03, 2019 23:36 - <b><font color=red>continues</font></b> (225d 1h 48m until now) 226168 Proxies : [MEPHI] - Proxy Server has expired 2019-05-03T21:36:03.000Z 2019-05-03T21:36:03.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Proxy Server has expired<br><br>Duration: May 03, 2019 23:36 - <b><font color=red>continues</font></b> (225d 1h 48m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[MEPHI]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': Unknown host "myproxy.cern.ch" Unable to connect to myproxy.cern.ch<br><br><b>Duration</b>: May 03, 2019 23:36 - <b><font color=red>continues</font></b> (225d 1h 48m until now) 225650 Site services : [HPCS] - MonALISA is down 2019-04-11T20:04:59.000Z 2019-04-11T20:04:59.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[HPCS]</b><br>MonALISA is down<br><br>Duration: Apr 11, 2019 22:04 - <b><font color=red>continues</font></b> (247d 3h 19m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[HPCS]</b><br>MonALISA is not running<br><br><b>Duration</b>: Apr 11, 2019 22:04 - <b><font color=red>continues</font></b> (247d 3h 19m until now) 225502 Site services : [LBL] - MonALISA is down 2019-04-03T21:15:32.000Z 2019-04-03T21:15:32.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[LBL]</b><br>MonALISA is down<br><br>Duration: Apr 03, 2019 23:15 - <b><font color=red>continues</font></b> (255d 2h 9m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[LBL]</b><br>MonALISA is not running<br><br><b>Duration</b>: Apr 03, 2019 23:15 - <b><font color=red>continues</font></b> (255d 2h 9m until now) 225400 Storages : [ALICE::MEPHI::EOS] - ADD test fails 2019-03-30T02:16:59.000Z 2019-03-30T02:16:59.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::MEPHI::EOS]</b><br>ADD test fails<br><br>Duration: Mar 30, 2019 03:16 - <b><font color=red>continues</font></b> (259d 21h 7m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::MEPHI::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Sat Mar 30 <font color='#631BAA'><b>03:13:10</b></font> CET 2019</b></font><br> Duration: 0s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3009] Unable to get free physical space /eos/alice/grid/02/16883/5d5f1a00-5291-11e9-8f73-0242266c4d21; No space left on device</font><br> <br> Full command was:<br> [/home/monalisa/xrootd/bin/xrdcp, -DIFirstConnectMaxCnt, 2, -DITransactionTimeout, 60, -DIRequestTimeout, 60, -DIReadCacheSize, 0, -N, -p, -v, -f, -P, /home/monalisa/MLrepository/bin/setesting/testfile, -ODauthz=-----BEGIN SEALED CIPHER-----<br> HJCztPNi9E+QKiVZogsp-5sdhYPEEythXN8X7wYS5rwJwdsx2G9+ShYnDqXxZPH25jOyHVU8CT5q<br> zT1HtL2aDOuCg4YhiRmn8OYId2eiyl6ZKjGvSf-1uOLuaJoz+FZtrdOVWzSYOBbV-UjaUmj1LPM-<br> SLdjzqoo+gIWvxSrs3U=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgDb0O2U3t541LGvTz+CBZtRcI897F7RWfvdtZCG1qseokpnHaIdABgJI9oX87GMJWd5Y9fEK<br> btw7RRsoyDbkQF4qPsDpZDtS6pzrrkOaDYWrk+qvJHfzZ7SpcNnXtwg0eHokGJ2yf6+udWiG+iez<br> r5yYnUyRPm4Ra+v+CSyb8SdRVmpx2d8kBT4cxINLeo9qE6ZXpfvT6jYQXzMQOKGDrJ1mYGJZ2gUa<br> SnLdol-r3hO+FqbSCKEJ9D-NGSpI2MbKRPKoQDLvFBjaZuzC3s6NR9s5TKkGSDWNo1qP9r5ZJqYW<br> N4REihpz9npttcph-5udexWFTrExmiCPNMozOizq3R+cR3SHNr9JJVgyNLVwfU-kFV3T-hE0miKg<br> GINzf2+bK-SpeU3g6vouLtCcy+q1lgg9CrDFt7UYJMVofjbJrcMgSV0I120zue98GGcrDsu4pZlg<br> HCGxwg43-ORuv01O3Zd5h7I5MJeNq78GoMrFfkxNAiMgKfnOJuHKa5WxFcpxPXAwyTTdmoM2kqGH<br> zh2GgbcVs69BRWiFwuaF7sAeAI-9kR8OZmftiHsqH01cFtgAmlalsS4RFnR+jc9fU7j4AgAEGlxh<br> +MUhZdvaOAhWBZSGoSi2YWMAQM57pMGOU1YY7YpWh9ayenUviJ6Of+HhX3rRhpKc6DN-UhNpL-1g<br> nkhjVccKUd8ftNhITHs8a9wQvsQxA9r9wGYI3Kpur0nfiz6PWfHGojBRKHVlcQRdsD1q5D0CVL-Z<br> DrDuZDPbi-1UDfBk6UI+BQ1AELCdedUkWw0ecl+GueAp+983gV7ylmBCWHbdEnPWv-ve6eZyAzsu<br> 86Sc8N3-I0Jn1B-cYFXiJJCZDX4F1KmIs+nQGQ6LaZo+8B6INDJfISRDRhm+tpiB7B+HypNpVhnw<br> q7hq8BZ3+4LMgTMTq+9d7-ZE56nK+bGtEXyjCUakLN9ArOpxYJsdwR5DQk86AHtEjE2YjPu0FHbE<br> rCxZIgUloHgTh8OCt27SbXJ3aIgtR6zoQgk3QdEFtqjhiUjSkRciBiiw46NlHCo=<br> -----END SEALED ENVELOPE-----<br> , <a target=_blank href='root://se10.lxfarm.mephi.ru:1094//02/16883/5d5f1a00-5291-11e9-8f73-0242266c4d21'>root://<span title='85.143.115.44:xrootd'><b>se10.lxfarm.mephi.ru:1094</b></span>//02/16883/5d5f1a00-5291-11e9-8f73-0242266c4d21</a>]<br><br><br><b>Duration</b>: Mar 30, 2019 03:16 - <b><font color=red>continues</font></b> (259d 21h 7m until now) 225304 Storages : [ALICE::LBL::EOS] - ADD test fails 2019-03-28T05:40:42.000Z 2019-03-28T05:40:42.000Z <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::LBL::EOS]</b><br>ADD test fails<br><br>Duration: Mar 28, 2019 06:40 - <b><font color=red>continues</font></b> (261d 17h 44m until now) <b><i><font size=+1>Storages</font></i></b><br><b>[ALICE::LBL::EOS]</b><br>Test finished at: <font color='#2A1FAA'><b>Thu Mar 28 <font color='#631BAA'><b>06:38:50</b></font> CET 2019</b></font><br> Duration: 1s<br> <font color='#C31010'>/home/monalisa/xrootd/bin/xrdcp exited with exit code 54: [ERROR] Server responded with an error: [3009] Unable to get free physical space /eos/alice/grid/00/60059/c3558780-511b-11e9-a27c-0242266c4d21; No space left on device</font><br> <br> Full command was:<br> [/home/monalisa/xrootd/bin/xrdcp, -DIFirstConnectMaxCnt, 2, -DITransactionTimeout, 60, -DIRequestTimeout, 60, -DIReadCacheSize, 0, -N, -p, -v, -f, -P, /home/monalisa/MLrepository/bin/setesting/testfile, -ODauthz=-----BEGIN SEALED CIPHER-----<br> qEBkqvD9WoBJPobQHaBTG9AnCUnmOYIiMiGjU+pplxKiOg0OxNx3fjoMFlpP6QmeC9AYj3xJ5z58<br> 9hYleMn3PCPd7cFn+rAMTSicVGF9q8X-aAb7-QWwWxT01URSmQTLIT3QKbnU1E-faHWtA1XcPHAi<br> Y17DZt-0QxmvTXxpU60=<br> -----END SEALED CIPHER-----<br> -----BEGIN SEALED ENVELOPE-----<br> AAAAgH5e27jEA2eKSR6zrAwg3nYL00onv+cfFv-qVejF8O+vs0fSenVcXWu1+jN1gfIzV6V2nazR<br> XH6xzdlBNjveFSix2zDDXHA4gxbs6cJxKomhSt1JvYAunLfYR3y8NYLnCvY7+hjLLS6N7gQnlwP4<br> H9CBU+EkRCm1MBDP03gOP874xduKlnyF5-X-+wnrWtm0mRommmlTuVN-fTaMHAbFwFuk-krh4pjq<br> Cs8MVo76WOGDz2BoPfqT5wfvrslA2nLkBzDchEchbYJeVL5nFDHmybGo8VUQYbbcfDsQvmX7mRjm<br> YHZUHTMjYnQpE1SAzDbVGTN23qewmjUOdn9ql4G6DDPxfhbRldvHXzmHpWSdQpAJq-sm7pAaexrb<br> +kN+SONXaTZy+K-xF9Sq9Di-huiJfYLNrvy+Lyp-qdvFEQTKlSJuk8-4YfRCsUC5xQzx-kXoluTi<br> c1DRmxtuF8MOROkIfEE2jPIttZkDLlhTGxqzEKDyjWkBd1NfYH6kFoSgHVEzNvg0Fks2qTCB79Hd<br> R6+4kzTLv7aF16QpA9h1usMVC5Su5yEGf4niTcF0awrV6EKPH2S7u12UGQYsNjqfrtLZwVZ5uNFl<br> PMcB2LHGlWx-K33JZWVq07mM5wnIInpkWIqsSlGU38W-sEp7vEElGVPWRC5vLiQBcNdb3WssuXkc<br> EcBVMvNV0p5uYwyX98JHJIbZLs1DfrCZ+8NnnQAtyvLdF803yuNibjbdHMeTTg1W7oC8IUitjrdc<br> 8WVs2qPlKxGaUWUgtyK7lVv9Uv4cZ-PVm9jO+o+wu1v5rOJPuVcZTRz5NH4OW2unMdaD9buQxV9X<br> siLcy67C4Z6oD8Sfr1Ik4aS1YqvvYsDxRMEj6HqaZheFLjB78aEvvw066M0C0zbw2NnK1cuCTEwY<br> A0oWm2B4hkfjyGgJGq5-iUu1zRsQmgtPql6FYZBd4B73LSUHGWZ2bddtejmNKpveHQY6ZXfbRZK0<br> tRBolz83T-qNCsDRxTbutJKf8svVR9dETIJwlzIquUiR-rKeWh3Q<br> -----END SEALED ENVELOPE-----<br> , <a target=_blank href='root://eosalice.nersc.gov:1094//00/60059/c3558780-511b-11e9-a27c-0242266c4d21'>root://<span title='128.55.160.182:xrootd'><b>eosalice.nersc.gov:1094</b></span>//00/60059/c3558780-511b-11e9-a27c-0242266c4d21</a>]<br><br><br><b>Duration</b>: Mar 28, 2019 06:40 - <b><font color=red>continues</font></b> (261d 17h 44m until now) 225205 Site services : [Cyfronet] - Problem with TMP 2019-03-27T00:06:39.000Z 2019-03-27T00:06:39.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Problem with TMP<br><br>Duration: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (262d 23h 18m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Path: /home/alicesgm/ALICE/tmp, usage: -1%, monitoring status: ok<br><br><b>Duration</b>: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (262d 23h 18m until now) 225204 Site services : [Cyfronet] - Problem with LOG 2019-03-27T00:06:39.000Z 2019-03-27T00:06:39.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Problem with LOG<br><br>Duration: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (262d 23h 18m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Path: /home/alicesgm/ALICE/alien-logs, usage: -1%, monitoring status: ok<br><br><b>Duration</b>: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (262d 23h 18m until now) 225203 Site services : [Cyfronet] - Problem with CACHE 2019-03-27T00:06:38.000Z 2019-03-27T00:06:38.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Problem with CACHE<br><br>Duration: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (262d 23h 18m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Path: /home/alicesgm/ALICE/cache, usage: -1%, monitoring status: ok<br><br><b>Duration</b>: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (262d 23h 18m until now) 221532 Site services : [Prague] - MonALISA is down 2019-01-23T19:07:31.000Z 2019-01-23T19:07:31.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2019 20:07 - <b><font color=red>continues</font></b> (325d 4h 17m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2019 20:07 - <b><font color=red>continues</font></b> (325d 4h 17m until now) 221412 Site services : [Prague] - CE is down 2019-01-18T15:04:12.000Z 2019-01-18T15:04:12.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>CE is down<br><br>Duration: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (330d 8h 20m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>Jan 18 15:55:08 info Hello ALICE::Prague::Disk2 Jan 18 15:55:08 info Reading the configuration file from /home/alicesgm/.alien/alice.conf Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 18 15:55:08 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 18 15:55:08 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://alicebox.farm.particle.cz' (a variable that is not in the standard configuration) alicebox.farm.particle.czDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (330d 8h 20m until now) 221411 Site services : [Prague] - Monitor is down 2019-01-18T15:04:11.000Z 2019-01-18T15:04:11.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>Monitor is down<br><br>Duration: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (330d 8h 20m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>Jan 18 15:54:56 info Hello ALICE::Prague::Disk2 Jan 18 15:54:56 info Reading the configuration file from /home/alicesgm/.alien/alice.conf Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 18 15:54:56 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 18 15:54:56 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://alicebox.farm.particle.cz' (a variable that is not in the standard configuration) alicebox.farm.particle.czPinging service ClusterMonitor... The service is running at alicebox.farm.particle.cz:8084, uri ClusterMonitor Attempt 1 (Fri Jan 18 15:54:56 2019) Attempt 2 (Fri Jan 18 15:55:01 2019) Attempt 3 (Fri Jan 18 15:55:06 2019) ERROR: Could not contact service. (Error 500 Can't connect to alicebox.farm.particle.cz:8084 (connect: Connection refused) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (330d 8h 20m until now) 221410 Site services : [Prague] - CMreport is down 2019-01-18T15:04:11.000Z 2019-01-18T15:04:11.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>CMreport is down<br><br>Duration: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (330d 8h 20m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>Jan 18 15:55:22 info Hello ALICE::Prague::Disk2 Jan 18 15:55:22 info Reading the configuration file from /home/alicesgm/.alien/alice.conf Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 18 15:55:22 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 18 15:55:22 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://alicebox.farm.particle.cz' (a variable that is not in the standard configuration) Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (330d 8h 20m until now) 221286 Proxies : [Prague] - Alien proxy has expired 2019-01-10T08:53:49.000Z 2019-01-10T08:53:49.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Prague]</b><br>Alien proxy has expired<br><br>Duration: Jan 10, 2019 09:53 - <b><font color=red>continues</font></b> (338d 14h 31m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Prague]</b><br>Failed with exit code: 1. Last lines were: globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fDC+3dcz+2fDC+3dcesnet-ca+2fO+3dNuclear+20Physics+20Institute+20of+20the+20Academy+20of+20Sciences+20of+20the+20CR+2fCN+3ddagmar+20adamova+2fCN+3dproxy-voms+20alice+3a+2falice+2fRole+3dlcgadmin is not a valid file Use -debug for further information.<br><br><b>Duration</b>: Jan 10, 2019 09:53 - <b><font color=red>continues</font></b> (338d 14h 31m until now) 221206 Proxies : [Prague] - Proxy Server has expired 2019-01-09T12:00:00.000Z 2019-01-09T12:00:00.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Prague]</b><br>Proxy Server has expired<br><br>Duration: Jan 09, 2019 13:00 - <b><font color=red>continues</font></b> (339d 11h 24m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Prague]</b><br>Failed to execute 'myproxy-info -d 2> /dev/null': Attempt 2 globus_credential: Error reading proxy credential globus_sysconfig: Could not find a valid proxy certificate file location globus_sysconfig: Error with key filename globus_sysconfig: File does not exist: /var/lib/vobox/alice/proxy_repository/+2fDC+3dcz+2fDC+3dcesnet-ca+2fO+3dNuclear+20Physics+20Institute+20of+20the+20Academy+20of+20Sc<br><br><b>Duration</b>: Jan 09, 2019 13:00 - <b><font color=red>continues</font></b> (339d 11h 24m until now) 221174 Proxies : [Prague] - Delegated proxy has expired 2019-01-07T12:41:01.000Z 2019-01-07T12:41:01.000Z <b><i><font size=+1>Proxies</font></i></b><br><b>[Prague]</b><br>Delegated proxy has expired<br><br>Duration: Jan 07, 2019 13:41 - <b><font color=red>continues</font></b> (341d 10h 43m until now) <b><i><font size=+1>Proxies</font></i></b><br><b>[Prague]</b><br>Unable to get delegation Failed to receive credentials. ERROR from myproxy-server: "<anonymous>" not authorized by server's default trusted_retrievers policy "<anonymous>" not authorized by server's authorized_retrievers policy "<anonymous>" not authorized by server's authorized_renewers policy<br><br><b>Duration</b>: Jan 07, 2019 13:41 - <b><font color=red>continues</font></b> (341d 10h 43m until now)