ALICE ML Repos - Site services http://alimonitor.cern.ch/ml2.jpg http://alimonitor.cern.ch/mona.jpg 2019-08-20T17:10:54.000Z Costin Grigoras Costin.Grigoras@cern.ch http://alimonitor.cern.ch/stats?page=services_status All events recorded by MonALISA 229931 Site services : [Hiroshima] - Monitor is down 2019-08-20T16:40:44.000Z 2019-08-20T17:10:54.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Hiroshima]</b><br>Monitor is down<br><br>Duration: Aug 20, 2019 18:40 - Aug 20, 2019 19:10 (30 min) <b><i><font size=+1>Site services</font></i></b><br><b>[Hiroshima]</b><br>Aug 20 16:29:01 info Reading the configuration file from /home/sgmali01/.alien/alice.conf Aug 20 16:29:01 info The local configuration is not allowed to define services Aug 20 16:29:01 info The local configuration is not allowed to define services Aug 20 16:29:01 info The local configuration is not allowed to define services Aug 20 16:29:01 info The local configuration is not allowed to define services Aug 20 16:29:01 info The local configuration is not allowed to define services Aug 20 16:29:01 info The local configuration is not allowed to define services Aug 20 16:29:01 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Aug 20 16:29:01 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://grid01.hepl.hiroshima-u.ac.jp' (a variable that is not in the standard configuration) grid01.hepl.hiroshima-u.ac.jpPinging service ClusterMonitor... The service is running at grid01.hepl.hiroshima-u.ac.jp:8084, uri ClusterMonitor Attempt 1 (Tue Aug 20 16:29:01 2019) Attempt 2 (Tue Aug 20 16:29:06 2019) Attempt 3 (Tue Aug 20 16:29:11 2019) ERROR: Could not contact service. (Error 500 Can't connect to grid01.hepl.hiroshima-u.ac.jp:8084 (connect: Connection refused) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Aug 20, 2019 18:40 - Aug 20, 2019 19:10 (30 min) 229930 Site services : [LBL_HPCS] - Monitor is down 2019-08-20T16:25:41.000Z 2019-08-20T16:40:43.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[LBL_HPCS]</b><br>Monitor is down<br><br>Duration: Aug 20, 2019 18:25 - Aug 20, 2019 18:40 (15 min) <b><i><font size=+1>Site services</font></i></b><br><b>[LBL_HPCS]</b><br>Use of uninitialized value within %ENV in substitution iterator at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 435. Use of uninitialized value in concatenation (.) or string at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 436. Warning! not able to use /cache as cache dir Use of uninitialized value within %ENV in substitution iterator at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 435. Use of uninitialized value in concatenation (.) or string at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 436. Warning! not able to use /cache as cache dir Aug 20 09:04:58 info Hello ALICE::LBL_HPCS::EOS Aug 20 09:05:01 info Reading the configuration file from /global/home/users/rjporter/.alien/alice.conf alice-vobox.lbl.govPinging service ClusterMonitor... The service is running at alice-vobox.lbl.gov:8084, uri ClusterMonitor Attempt 1 (Tue Aug 20 09:05:05 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 2 (Tue Aug 20 09:05:20 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 3 (Tue Aug 20 09:05:42 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to alice-vobox.lbl.gov:8084 (connect: timeout) at (eval 111) line 1 ). Exit code 1<br><br><b>Duration</b>: Aug 20, 2019 18:25 - Aug 20, 2019 18:40 (15 min) 229928 Site services : [LBL_HPCS] - MonALISA is down 2019-08-20T12:57:50.000Z 2019-08-20T15:55:09.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[LBL_HPCS]</b><br>MonALISA is down<br><br>Duration: Aug 20, 2019 14:57 - Aug 20, 2019 17:55 (2h 57m) <b><i><font size=+1>Site services</font></i></b><br><b>[LBL_HPCS]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 20, 2019 14:57 - Aug 20, 2019 17:55 (2h 57m) 229922 Site services : [UNAM_T1] - Monitor is down 2019-08-20T05:19:11.000Z 2019-08-20T06:19:33.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM_T1]</b><br>Monitor is down<br><br>Duration: Aug 20, 2019 07:19 - Aug 20, 2019 08:19 (1h) <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM_T1]</b><br>Aug 19 23:57:42 info Reading the configuration file from /scratch/local/sgmali01/.alien/alice.conf Aug 19 23:57:42 info The local configuration is not allowed to define services Aug 19 23:57:42 info The local configuration is not allowed to define services Aug 19 23:57:42 info The local configuration is not allowed to define services Aug 19 23:57:42 info The local configuration is not allowed to define services Aug 19 23:57:42 info The local configuration is not allowed to define services Aug 19 23:57:42 info The local configuration is not allowed to define services Aug 19 23:57:42 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Aug 19 23:57:42 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Aug 19 23:57:42 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://tuul.grid.unam.mx' (a variable that is not in the standard configuration) tuul.grid.unam.mxPinging service ClusterMonitor... The service is running at tuul.grid.unam.mx:8084, uri ClusterMonitor Attempt 1 (Mon Aug 19 23:57:43 2019) Attempt 2 (Mon Aug 19 23:57:48 2019) Attempt 3 (Mon Aug 19 23:57:53 2019) ERROR: Could not contact service. (Error 500 Can't connect to tuul.grid.unam.mx:8084 (connect: Connection refused) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Aug 20, 2019 07:19 - Aug 20, 2019 08:19 (1h) 229921 Site services : [UNAM_T1] - CMreport is down 2019-08-20T05:19:11.000Z 2019-08-20T06:19:33.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM_T1]</b><br>CMreport is down<br><br>Duration: Aug 20, 2019 07:19 - Aug 20, 2019 08:19 (1h) <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM_T1]</b><br>Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' Syntax: pingService.pl <serviceName> <logDir>. Exit code 1<br><br><b>Duration</b>: Aug 20, 2019 07:19 - Aug 20, 2019 08:19 (1h) 229920 Site services : [UNAM_T1] - CE is down 2019-08-20T05:04:05.000Z 2019-08-20T06:04:25.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM_T1]</b><br>CE is down<br><br>Duration: Aug 20, 2019 07:04 - Aug 20, 2019 08:04 (1h) <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM_T1]</b><br>ERROR: Could not get Config. (Error Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' ). Exit code 1<br><br><b>Duration</b>: Aug 20, 2019 07:04 - Aug 20, 2019 08:04 (1h) 229917 Site services : [MEPHI] - CE is down 2019-08-20T03:03:04.000Z 2019-08-20T03:03:04.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>CE is down<br><br>Duration: Aug 20, 2019 05:03 - <b><font color=red>continues</font></b> (1d 8h 5m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>alice02.lxfarm.mephi.ruDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Aug 20, 2019 05:03 - <b><font color=red>continues</font></b> (1d 8h 5m until now) 229910 Site services : [UiB_LHC] - CMreport is down 2019-08-19T18:39:54.000Z 2019-08-19T22:57:44.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UiB_LHC]</b><br>CMreport is down<br><br>Duration: Aug 19, 2019 20:39 - Aug 20, 2019 00:57 (4h 17m) <b><i><font size=+1>Site services</font></i></b><br><b>[UiB_LHC]</b><br>Aug 19 20:24:35 info Hello ALICE::NDGF::DCACHE Aug 19 20:24:35 info Hello ALICE::SNIC::DCACHE Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Aug 19, 2019 20:39 - Aug 20, 2019 00:57 (4h 17m) 229908 Site services : [UNAM_T1] - MonALISA is down 2019-08-19T16:46:54.000Z 2019-08-19T16:58:17.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM_T1]</b><br>MonALISA is down<br><br>Duration: Aug 19, 2019 18:46 - Aug 19, 2019 18:58 (11 min) <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM_T1]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 19, 2019 18:46 - Aug 19, 2019 18:58 (11 min) 229906 Site services : [GRIF_IRFU] - Monitor is down 2019-08-19T16:38:52.000Z 2019-08-19T16:53:56.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>Monitor is down<br><br>Duration: Aug 19, 2019 18:38 - Aug 19, 2019 18:53 (15 min) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU]</b><br>Aug 19 17:51:42 info Reading the configuration file from /home/sgmalice/.alien/alice.conf Aug 19 17:51:42 info The local configuration is not allowed to define services Aug 19 17:51:42 info The local configuration is not allowed to define services Aug 19 17:51:42 info The local configuration is not allowed to define services Aug 19 17:51:42 info The local configuration is not allowed to define services Aug 19 17:51:42 info The local configuration is not allowed to define services Aug 19 17:51:42 info The local configuration is not allowed to define services Aug 19 17:51:42 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Aug 19 17:51:42 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://node14.datagrid.cea.fr' (a variable that is not in the standard configuration) node14.datagrid.cea.frPinging service ClusterMonitor... The service is running at node14.datagrid.cea.fr:8084, uri ClusterMonitor Attempt 1 (Mon Aug 19 17:51:42 2019) Attempt 2 (Mon Aug 19 17:51:57 2019) Attempt 3 (Mon Aug 19 17:52:12 2019) ERROR: Could not contact service. (Error 500 read timeout at (eval 111) line 1 ). Exit code 1<br><br><b>Duration</b>: Aug 19, 2019 18:38 - Aug 19, 2019 18:53 (15 min) 229901 Site services : [UiB_LHC] - CE is down 2019-08-19T11:20:10.000Z 2019-08-19T22:42:33.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UiB_LHC]</b><br>CE is down<br><br>Duration: Aug 19, 2019 13:20 - Aug 20, 2019 00:42 (11h 22m) <b><i><font size=+1>Site services</font></i></b><br><b>[UiB_LHC]</b><br>Aug 19 13:07:48 info Hello ALICE::NDGF::DCACHE Aug 19 13:07:48 info Hello ALICE::SNIC::DCACHE alien.bccs.uib.noDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Aug 19, 2019 13:20 - Aug 20, 2019 00:42 (11h 22m) 229900 Site services : [UiB_LHC] - Monitor is down 2019-08-19T11:20:10.000Z 2019-08-19T22:42:33.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UiB_LHC]</b><br>Monitor is down<br><br>Duration: Aug 19, 2019 13:20 - Aug 20, 2019 00:42 (11h 22m) <b><i><font size=+1>Site services</font></i></b><br><b>[UiB_LHC]</b><br>Aug 19 13:07:35 info Hello ALICE::NDGF::DCACHE Aug 19 13:07:35 info Hello ALICE::SNIC::DCACHE alice-master.lhc.uib.noPinging service ClusterMonitor... The service is running at alice-master.lhc.uib.no:8084, uri ClusterMonitor Attempt 1 (Mon Aug 19 13:07:36 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 2 (Mon Aug 19 13:07:41 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. Attempt 3 (Mon Aug 19 13:07:46 2019) Use of uninitialized value in pattern match (m//) at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to alice-master.lhc.uib.no:8084 (connect: Connection refused) at (eval 103) line 1 ). Exit code 1<br><br><b>Duration</b>: Aug 19, 2019 13:20 - Aug 20, 2019 00:42 (11h 22m) 229899 Site services : [UiB_LHC] - CMreport is down 2019-08-19T11:20:10.000Z 2019-08-19T17:54:43.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UiB_LHC]</b><br>CMreport is down<br><br>Duration: Aug 19, 2019 13:20 - Aug 19, 2019 19:54 (6h 34m) <b><i><font size=+1>Site services</font></i></b><br><b>[UiB_LHC]</b><br>Aug 19 13:08:03 info Hello ALICE::NDGF::DCACHE Aug 19 13:08:03 info Hello ALICE::SNIC::DCACHE Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Aug 19, 2019 13:20 - Aug 19, 2019 19:54 (6h 34m) 229896 Site services : [MEPHI] - CE is down 2019-08-19T08:33:27.000Z 2019-08-20T02:16:55.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>CE is down<br><br>Duration: Aug 19, 2019 10:33 - Aug 20, 2019 04:16 (17h 43m) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>alice02.lxfarm.mephi.ruDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Aug 19, 2019 10:33 - Aug 20, 2019 04:16 (17h 43m) 229884 Site services : [Catania-VF] - MonALISA is down 2019-08-18T23:23:13.000Z 2019-08-19T10:39:57.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Catania-VF]</b><br>MonALISA is down<br><br>Duration: Aug 19, 2019 01:23 - Aug 19, 2019 12:39 (11h 16m) <b><i><font size=+1>Site services</font></i></b><br><b>[Catania-VF]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 19, 2019 01:23 - Aug 19, 2019 12:39 (11h 16m) 229883 Site services : [TriGrid_Catania] - MonALISA is down 2019-08-18T23:23:13.000Z 2019-08-19T10:39:57.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[TriGrid_Catania]</b><br>MonALISA is down<br><br>Duration: Aug 19, 2019 01:23 - Aug 19, 2019 12:39 (11h 16m) <b><i><font size=+1>Site services</font></i></b><br><b>[TriGrid_Catania]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 19, 2019 01:23 - Aug 19, 2019 12:39 (11h 16m) 229765 Site services : [MEPHI] - CMreport is down 2019-08-14T23:40:00.000Z 2019-08-14T23:40:00.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>CMreport is down<br><br>Duration: Aug 15, 2019 01:40 - <b><font color=red>continues</font></b> (6d 11h 28m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Aug 15, 2019 01:40 - <b><font color=red>continues</font></b> (6d 11h 28m until now) 229669 Site services : [CERN_HLT] - CMreport is down 2019-08-11T03:54:23.000Z 2019-08-11T03:54:23.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>CMreport is down<br><br>Duration: Aug 11, 2019 05:54 - <b><font color=red>continues</font></b> (10d 7h 13m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Cannot execute /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/bin/alien<br><br><b>Duration</b>: Aug 11, 2019 05:54 - <b><font color=red>continues</font></b> (10d 7h 13m until now) 229668 Site services : [CERN_HLT] - MonALISA is down 2019-08-11T03:48:43.000Z 2019-08-11T03:48:43.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>MonALISA is down<br><br>Duration: Aug 11, 2019 05:48 - <b><font color=red>continues</font></b> (10d 7h 19m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 11, 2019 05:48 - <b><font color=red>continues</font></b> (10d 7h 19m until now) 229610 Site services : [CNAF-HTC] - MonALISA is down 2019-08-09T13:15:03.000Z 2019-08-09T13:15:03.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CNAF-HTC]</b><br>MonALISA is down<br><br>Duration: Aug 09, 2019 15:15 - <b><font color=red>continues</font></b> (11d 21h 53m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CNAF-HTC]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 09, 2019 15:15 - <b><font color=red>continues</font></b> (11d 21h 53m until now) 229603 Site services : [CNAF] - MonALISA is down 2019-08-09T12:18:43.000Z 2019-08-09T12:18:43.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CNAF]</b><br>MonALISA is down<br><br>Duration: Aug 09, 2019 14:18 - <b><font color=red>continues</font></b> (11d 22h 49m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CNAF]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 09, 2019 14:18 - <b><font color=red>continues</font></b> (11d 22h 49m until now) 229602 Site services : [CNAF-DUE] - MonALISA is down 2019-08-09T12:18:43.000Z 2019-08-09T12:18:43.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CNAF-DUE]</b><br>MonALISA is down<br><br>Duration: Aug 09, 2019 14:18 - <b><font color=red>continues</font></b> (11d 22h 49m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CNAF-DUE]</b><br>MonALISA is not running<br><br><b>Duration</b>: Aug 09, 2019 14:18 - <b><font color=red>continues</font></b> (11d 22h 49m until now) 229251 Site services : [CORI] - Monitor is down 2019-07-30T17:06:38.000Z 2019-07-30T17:06:38.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>Monitor is down<br><br>Duration: Jul 30, 2019 19:06 - <b><font color=red>continues</font></b> (21d 18h 1m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. Jul 30 09:53:32 info Reading the configuration file from /global/homes/a/alicepro/.alien/alice.conf Jul 30 09:53:32 info Error reading the config file /global/homes/a/alicepro/.alien/alice.conf: Error in config file /global/homes/a/alicepro/.alien/alice.conf, line 2: unable to parse line at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 162 Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. cori21-224.nersc.govPinging service ClusterMonitor... The service is running at cori21-224.nersc.gov:8084, uri ClusterMonitor Attempt 1 (Tue Jul 30 09:53:32 2019) Use of uninitialized value in pattern match (m//) at /global/homes/a/alicepro/alien.v2-19.446_new/scripts/pingService.pl line 115. Attempt 2 (Tue Jul 30 09:53:37 2019) Use of uninitialized value in pattern match (m//) at /global/homes/a/alicepro/alien.v2-19.446_new/scripts/pingService.pl line 115. Attempt 3 (Tue Jul 30 09:53:42 2019) Use of uninitialized value in pattern match (m//) at /global/homes/a/alicepro/alien.v2-19.446_new/scripts/pingService.pl line 115. ERROR: Could not contact service. (Error 500 Can't connect to cori21-224.nersc.gov:8084 (connect: Connection refused) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Jul 30, 2019 19:06 - <b><font color=red>continues</font></b> (21d 18h 1m until now) 229069 Site services : [pcalienstorage3.cern.ch] - MonALISA is down 2019-07-25T14:08:44.000Z 2019-07-25T14:08:44.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[pcalienstorage3.cern.ch]</b><br>MonALISA is down<br><br>Duration: Jul 25, 2019 16:08 - <b><font color=red>continues</font></b> (26d 20h 59m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[pcalienstorage3.cern.ch]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jul 25, 2019 16:08 - <b><font color=red>continues</font></b> (26d 20h 59m until now) 228737 Site services : [CORI] - CE is down 2019-07-17T17:47:58.000Z 2019-07-17T17:47:58.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>CE is down<br><br>Duration: Jul 17, 2019 19:47 - <b><font color=red>continues</font></b> (34d 17h 20m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CORI]</b><br>/bin/bash: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/bash) /bin/bash: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/bash) /bin/sh: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/sh) Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. /bin/bash: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/bash) /bin/sh: /global/homes/a/alicepro/alien.v2-19.446_new/lib/libreadline.so.6: no version information available (required by /bin/sh) Jul 17 10:45:57 info Reading the configuration file from /global/homes/a/alicepro/.alien/alice.conf Jul 17 10:45:57 info Error reading the config file /global/homes/a/alicepro/.alien/alice.conf: Error in config file /global/homes/a/alicepro/.alien/alice.conf, line 2: unable to parse line at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 162 Use of uninitialized value within %ENV in substitution iterator at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 133. Use of uninitialized value in concatenation (.) or string at /global/homes/a/alicepro/alien.v2-19.446_new/lib/perl5/site_perl/5.10.1/AliEn/Config.pm line 134. cori21-224.nersc.govDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Jul 17, 2019 19:47 - <b><font color=red>continues</font></b> (34d 17h 20m until now) 228579 Site services : [NIPNE] - MonALISA is down 2019-07-11T06:37:20.000Z 2019-07-11T06:37:20.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[NIPNE]</b><br>MonALISA is down<br><br>Duration: Jul 11, 2019 08:37 - <b><font color=red>continues</font></b> (41d 4h 30m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[NIPNE]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jul 11, 2019 08:37 - <b><font color=red>continues</font></b> (41d 4h 30m until now) 228380 Site services : [Kosice] - MonALISA is down 2019-07-02T16:34:57.000Z 2019-07-02T16:34:57.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Kosice]</b><br>MonALISA is down<br><br>Duration: Jul 02, 2019 18:34 - <b><font color=red>continues</font></b> (49d 18h 33m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Kosice]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jul 02, 2019 18:34 - <b><font color=red>continues</font></b> (49d 18h 33m until now) 228074 Site services : [Pikachu] - MonALISA is down 2019-06-27T14:54:30.000Z 2019-06-27T14:54:30.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Pikachu]</b><br>MonALISA is down<br><br>Duration: Jun 27, 2019 16:54 - <b><font color=red>continues</font></b> (54d 20h 13m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Pikachu]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jun 27, 2019 16:54 - <b><font color=red>continues</font></b> (54d 20h 13m until now) 227880 Site services : [CERN_HLT] - Problem with TMP 2019-06-19T07:36:49.000Z 2019-06-19T07:36:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Problem with TMP<br><br>Duration: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (63d 3h 31m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Path: /var/lib/aliprod/ALICE/tmp, usage: 95%, monitoring status: ok<br><br><b>Duration</b>: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (63d 3h 31m until now) 227879 Site services : [CERN_HLT] - Problem with LOG 2019-06-19T07:36:49.000Z 2019-06-19T07:36:49.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Problem with LOG<br><br>Duration: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (63d 3h 31m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Path: /var/lib/aliprod/ALICE/log, usage: 95%, monitoring status: ok<br><br><b>Duration</b>: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (63d 3h 31m until now) 227878 Site services : [CERN_HLT] - Problem with CACHE 2019-06-19T07:36:48.000Z 2019-06-19T07:36:48.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Problem with CACHE<br><br>Duration: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (63d 3h 31m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLT]</b><br>Path: /var/lib/aliprod/ALICE/cache, usage: 95%, monitoring status: ok<br><br><b>Duration</b>: Jun 19, 2019 09:36 - <b><font color=red>continues</font></b> (63d 3h 31m until now) 227710 Site services : [CERN_HLTDEV] - MonALISA is down 2019-06-11T08:31:26.000Z 2019-06-11T08:31:26.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLTDEV]</b><br>MonALISA is down<br><br>Duration: Jun 11, 2019 10:31 - <b><font color=red>continues</font></b> (71d 2h 36m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[CERN_HLTDEV]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jun 11, 2019 10:31 - <b><font color=red>continues</font></b> (71d 2h 36m until now) 227176 Site services : [GRIF_IRFU_ARC] - MonALISA is down 2019-05-27T16:39:07.000Z 2019-05-27T16:39:07.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU_ARC]</b><br>MonALISA is down<br><br>Duration: May 27, 2019 18:39 - <b><font color=red>continues</font></b> (85d 18h 28m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[GRIF_IRFU_ARC]</b><br>MonALISA is not running<br><br><b>Duration</b>: May 27, 2019 18:39 - <b><font color=red>continues</font></b> (85d 18h 28m until now) 226934 Site services : [UNAM] - MonALISA is down 2019-05-21T10:34:15.000Z 2019-05-21T10:34:15.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM]</b><br>MonALISA is down<br><br>Duration: May 21, 2019 12:34 - <b><font color=red>continues</font></b> (92d 0h 33m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[UNAM]</b><br>MonALISA is not running<br><br><b>Duration</b>: May 21, 2019 12:34 - <b><font color=red>continues</font></b> (92d 0h 33m until now) 226547 Site services : [Capella] - MonALISA is down 2019-05-17T14:01:20.000Z 2019-05-17T14:01:20.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Capella]</b><br>MonALISA is down<br><br>Duration: May 17, 2019 16:01 - <b><font color=red>continues</font></b> (95d 21h 6m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Capella]</b><br>MonALISA is not running<br><br><b>Duration</b>: May 17, 2019 16:01 - <b><font color=red>continues</font></b> (95d 21h 6m until now) 226171 Site services : [MEPHI] - Monitor is down 2019-05-03T21:40:30.000Z 2019-05-03T21:40:30.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>Monitor is down<br><br>Duration: May 03, 2019 23:40 - <b><font color=red>continues</font></b> (109d 13h 27m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[MEPHI]</b><br>Error contacting LDAP in alice-ldap.cern.ch:8389 IO::Socket::INET: Bad hostname 'alice-ldap.cern.ch' Syntax: pingService.pl <serviceName> <logDir>. Exit code 1<br><br><b>Duration</b>: May 03, 2019 23:40 - <b><font color=red>continues</font></b> (109d 13h 27m until now) 225650 Site services : [HPCS] - MonALISA is down 2019-04-11T20:04:59.000Z 2019-04-11T20:04:59.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[HPCS]</b><br>MonALISA is down<br><br>Duration: Apr 11, 2019 22:04 - <b><font color=red>continues</font></b> (131d 15h 3m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[HPCS]</b><br>MonALISA is not running<br><br><b>Duration</b>: Apr 11, 2019 22:04 - <b><font color=red>continues</font></b> (131d 15h 3m until now) 225502 Site services : [LBL] - MonALISA is down 2019-04-03T21:15:32.000Z 2019-04-03T21:15:32.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[LBL]</b><br>MonALISA is down<br><br>Duration: Apr 03, 2019 23:15 - <b><font color=red>continues</font></b> (139d 13h 52m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[LBL]</b><br>MonALISA is not running<br><br><b>Duration</b>: Apr 03, 2019 23:15 - <b><font color=red>continues</font></b> (139d 13h 52m until now) 225205 Site services : [Cyfronet] - Problem with TMP 2019-03-27T00:06:39.000Z 2019-03-27T00:06:39.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Problem with TMP<br><br>Duration: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (147d 11h 1m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Path: /home/alicesgm/ALICE/tmp, usage: -1%, monitoring status: ok<br><br><b>Duration</b>: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (147d 11h 1m until now) 225204 Site services : [Cyfronet] - Problem with LOG 2019-03-27T00:06:39.000Z 2019-03-27T00:06:39.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Problem with LOG<br><br>Duration: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (147d 11h 1m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Path: /home/alicesgm/ALICE/alien-logs, usage: -1%, monitoring status: ok<br><br><b>Duration</b>: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (147d 11h 1m until now) 225203 Site services : [Cyfronet] - Problem with CACHE 2019-03-27T00:06:38.000Z 2019-03-27T00:06:38.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Problem with CACHE<br><br>Duration: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (147d 11h 1m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Cyfronet]</b><br>Path: /home/alicesgm/ALICE/cache, usage: -1%, monitoring status: ok<br><br><b>Duration</b>: Mar 27, 2019 01:06 - <b><font color=red>continues</font></b> (147d 11h 1m until now) 221532 Site services : [Prague] - MonALISA is down 2019-01-23T19:07:31.000Z 2019-01-23T19:07:31.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2019 20:07 - <b><font color=red>continues</font></b> (209d 16h until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2019 20:07 - <b><font color=red>continues</font></b> (209d 16h until now) 221527 Site services : [Regulus] - MonALISA is down 2019-01-23T13:52:57.000Z 2019-01-23T13:52:57.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Regulus]</b><br>MonALISA is down<br><br>Duration: Jan 23, 2019 14:52 - <b><font color=red>continues</font></b> (209d 21h 15m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Regulus]</b><br>MonALISA is not running<br><br><b>Duration</b>: Jan 23, 2019 14:52 - <b><font color=red>continues</font></b> (209d 21h 15m until now) 221412 Site services : [Prague] - CE is down 2019-01-18T15:04:12.000Z 2019-01-18T15:04:12.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>CE is down<br><br>Duration: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (214d 20h 3m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>Jan 18 15:55:08 info Hello ALICE::Prague::Disk2 Jan 18 15:55:08 info Reading the configuration file from /home/alicesgm/.alien/alice.conf Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration is not allowed to define services Jan 18 15:55:08 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 18 15:55:08 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 18 15:55:08 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://alicebox.farm.particle.cz' (a variable that is not in the standard configuration) alicebox.farm.particle.czDoing PID-only check for CE... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (214d 20h 3m until now) 221411 Site services : [Prague] - Monitor is down 2019-01-18T15:04:11.000Z 2019-01-18T15:04:11.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>Monitor is down<br><br>Duration: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (214d 20h 3m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>Jan 18 15:54:56 info Hello ALICE::Prague::Disk2 Jan 18 15:54:56 info Reading the configuration file from /home/alicesgm/.alien/alice.conf Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration is not allowed to define services Jan 18 15:54:56 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 18 15:54:56 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 18 15:54:56 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://alicebox.farm.particle.cz' (a variable that is not in the standard configuration) alicebox.farm.particle.czPinging service ClusterMonitor... The service is running at alicebox.farm.particle.cz:8084, uri ClusterMonitor Attempt 1 (Fri Jan 18 15:54:56 2019) Attempt 2 (Fri Jan 18 15:55:01 2019) Attempt 3 (Fri Jan 18 15:55:06 2019) ERROR: Could not contact service. (Error 500 Can't connect to alicebox.farm.particle.cz:8084 (connect: Connection refused) at (eval 104) line 1 ). Exit code 1<br><br><b>Duration</b>: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (214d 20h 3m until now) 221410 Site services : [Prague] - CMreport is down 2019-01-18T15:04:11.000Z 2019-01-18T15:04:11.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>CMreport is down<br><br>Duration: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (214d 20h 3m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[Prague]</b><br>Jan 18 15:55:22 info Hello ALICE::Prague::Disk2 Jan 18 15:55:22 info Reading the configuration file from /home/alicesgm/.alien/alice.conf Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration is not allowed to define services Jan 18 15:55:22 info The local configuration defines 'CLUSTERMONITOR_SOAPTYPE=httpd' (a variable that is not in the standard configuration) Jan 18 15:55:22 info The local configuration is not allowed to override JOB_MANAGER_ADDRESS Jan 18 15:55:22 info The local configuration defines 'CLUSTERMONITOR_ADDRESS=http://alicebox.farm.particle.cz' (a variable that is not in the standard configuration) Use of uninitialized value $host in print at /cvmfs/alice.cern.ch/x86_64-2.6-gnu-4.1.2/Packages/AliEn/v2-19-395/scripts/pingService.pl line 44. Doing PID-only check for CMreport... DEAD. Exit code 1<br><br><b>Duration</b>: Jan 18, 2019 16:04 - <b><font color=red>continues</font></b> (214d 20h 3m until now) 220500 Site services : [PAKGRID] - MonALISA is down 2018-11-27T08:27:53.000Z 2018-11-27T08:27:53.000Z <b><i><font size=+1>Site services</font></i></b><br><b>[PAKGRID]</b><br>MonALISA is down<br><br>Duration: Nov 27, 2018 09:27 - <b><font color=red>continues</font></b> (267d 2h 40m until now) <b><i><font size=+1>Site services</font></i></b><br><b>[PAKGRID]</b><br>MonALISA is not running<br><br><b>Duration</b>: Nov 27, 2018 09:27 - <b><font color=red>continues</font></b> (267d 2h 40m until now)