The cntlmon API on gateway at LDAS_MIT

Legend:
green ball Normal status or debugging message
yellow ball Notable condition which may be a non-fatal error
orange ball Error condition not fatal to job
red ball Error condition fatal to job
blue ball Notable condition which is not an error
purple ball Currently undefined
email Condition requires email notification of the responsible administrator of this API
telephone Condition requires phone notification of the responsible administrator of this API

Link: API Status Page for LDAS_MIT

01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP archiveLog file "/ldas_outgoing/logs/LDAScntlmon.log.html" already closed. (archived as /ldas_outgoing/logs/archive/cntlmonAPI/LDAScntlmon.911941322)
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP execOverload overloaded exec
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP bgLoop Looping process cntlmon_expiredCertTest started
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP openListenSock port 10022 (operator) opened on gateway as sock6
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP openListenSock port 10023 (emergency) opened on gateway as sock7
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP setResourceLimit vmemoryuse=unlimited; core=unlimited; datasize=unlimited; descriptors=65536; getRLimit on maxproc error:'Invalid or unsupported resource name: maxproc'; cputime=unlimited; filesize=unlimited; getRLimit on memorylocked error:'Invalid or unsupported resource name: memorylocked'
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP leakLogger inital size of cntlmon API: 27424 kB
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP bgLoop Looping process etchosts started
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP cntlmon Trying API
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP cntlmon API yes
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP cntlmon Trying LDAS_SYSTEM
01/12/09-00:22:28 EST 01/12/09-05:22:28 GMT 915772963 STARTUP cntlmon LDAS_SYSTEM yes
01/12/09-00:22:29 EST 01/12/09-05:22:29 GMT 915772964 IDLE bgLoop Looping process statpagefile started
01/12/09-00:22:29 EST 01/12/09-05:22:29 GMT 915772964 IDLE bgLoop Looping process killedjobreaper started
01/12/09-00:22:29 EST 01/12/09-05:22:29 GMT 915772964 IDLE bgLoop Looping process logrotate started
01/12/09-00:22:29 EST 01/12/09-05:22:29 GMT 915772964 IDLE cntlmon::cleanupLDASoutput next cleanup at 1231748549 secs
01/12/09-00:22:30 EST 01/12/09-05:22:30 GMT 915772965 IDLE cntlmon::initVars mpiAPI is not active
01/12/09-00:22:31 EST 01/12/09-05:22:31 GMT 915772966 IDLE setFTPandHTTPinfo (::FTPURL 'ftp://18.120.0.97') (::FTPDIR '') (::HTTPURL 'http://18.120.0.97/ldas_outgoing/jobs') (::HTTPDIR '/ldas_outgoing/jobs') (::GRIDFTPURL 'gridftp:/usr1/grid/ldas') (::GRIDFTPDIR '/usr1/grid/ldas') (::LDAS_GATEWAY 'ldas 18.120.0.97') (::LDAS_SYSTEM 'ldas-mit') (::RUNCODE 'LDAS-MIT')
01/12/09-00:22:34 EST 01/12/09-05:22:34 GMT 915772969 IDLE cntlmon::bootlogscan logscan launched: 5817
01/12/09-00:22:34 EST 01/12/09-05:22:34 GMT 915772969 IDLE emergency_callback In the last hour, 24 emails were sent out, 0 emails blocked; so far 12165 emails were sent, 18670 unsent (throttle exceeded), 0 emails were blocked, 23 emails generated by ldas since 11/28/08-15:58:53 EST
01/12/09-00:22:35 EST 01/12/09-05:22:35 GMT 915772970 IDLE cntlmon::registerUtil logscan launched at gateway, pid 5817, port 0
01/12/09-00:22:35 EST 01/12/09-05:22:35 GMT 915772970 IDLE emergency_callback logscan 24 found 11/28/08-15:58:53 EST, resetting to 0
01/12/09-00:22:37 EST 01/12/09-05:22:37 GMT 915772972 IDLE cntlmon::bootcoreWatch coreWatch launched: 5867
01/12/09-00:22:38 EST 01/12/09-05:22:38 GMT 915772973 IDLE setFTPandHTTPinfo (::FTPURL 'ftp://18.120.0.97') (::FTPDIR '') (::HTTPURL 'http://18.120.0.97/ldas_outgoing/jobs') (::HTTPDIR '/ldas_outgoing/jobs') (::GRIDFTPURL 'gridftp:/usr1/grid/ldas') (::GRIDFTPDIR '/usr1/grid/ldas') (::LDAS_GATEWAY 'ldas 18.120.0.97') (::LDAS_SYSTEM 'ldas-mit') (::RUNCODE 'LDAS-MIT')
01/12/09-00:22:38 EST 01/12/09-05:22:38 GMT 915772973 IDLE cntlmon::registerUtil coreWatch launched at ldas.mit.edu, pid 5867, port 0
01/12/09-00:22:38 EST 01/12/09-05:22:38 GMT 915772973 IDLE cntlmon::getNodeNames Unable to get node names because mpiAPI does not exist or ::MPI_API_HOST is undefined
01/12/09-00:22:38 EST 01/12/09-05:22:38 GMT 915772973 IDLE cntlmon::updateDBtabcols Updating database tables:
01/12/09-00:22:39 EST 01/12/09-05:22:39 GMT 915772974 IDLE cntlmon::bootlogCacheUtils logCacheUtils launched: 5912
01/12/09-00:22:40 EST 01/12/09-05:22:40 GMT 915772975 IDLE cntlmon::registerUtil logCacheUtils launched at gateway, pid 5912, port 36948
01/12/09-00:22:40 EST 01/12/09-05:22:40 GMT 915772975 IDLE cleanup db2utils 11362 killed on ssh to metaserver:
01/12/09-00:22:41 EST 01/12/09-05:22:41 GMT 915772976 IDLE cleanup after cleaning prog db2utils,pid=
01/12/09-00:22:41 EST 01/12/09-05:22:41 GMT 915772976 IDLE cntlmon::bootdb2utils db2utils launched:
01/12/09-00:22:48 EST 01/12/09-05:22:48 GMT 915772983 IDLE cntlmon::GlobusChannelInit globus socket cmd 'gt_xio_socket -server cntlmon::GlobusChannelAccept -gridmap_file -myaddr gateway 10032'
01/12/09-00:22:48 EST 01/12/09-05:22:48 GMT 915772983 IDLE cntlmon::GlobusChannelInit Globus channel gtxiosock0 opened for gsi service at 10032
01/12/09-00:22:51 EST 01/12/09-05:22:51 GMT 915772986 IDLE ::getPid pids 11466 obtained from ps for /ldas/bin/db2utils
01/12/09-00:22:58 EST 01/12/09-05:22:58 GMT 915772993 IDLE cntlmon::openClientSock registry 10000
01/12/09-00:22:58 EST 01/12/09-05:22:58 GMT 915772993 IDLE cntlmon::openClientSock port 10000 (clientHandler) opened on gateway as sock12
01/12/09-00:23:08 EST 01/12/09-05:23:08 GMT 915773003 IDLE cntlmon::GlobusChannelAccept newsock gtxiosock1 addr alphard.ligo.caltech.edu port 34957
01/12/09-00:23:23 EST 01/12/09-05:23:23 GMT 915773018 IDLE cntlmon::GlobusChannelRead Error: your cmonClient version . is incompatible with cntlmonAPI server's version 1.10.1; please update your cmonClient package to 1.10.1 before connecting.; closing globus channel gtxiosock1
emaros@ligo.caltech.edu 915773018 IDLE bgerror Subject: LDAS-MIT cntlmonAPI bgerror; Body: can not find channel named "gtxiosock1" while executing "eof $sid " (procedure "cntlmon::GlobusChannelRead" line 44) invoked from within "cntlmon::GlobusChannelRead gtxiosock1"
01/12/09-00:23:32 EST 01/12/09-05:23:32 GMT 915773027 IDLE cntlmon::registerUtil db2utils launched at metaserver, pid 11466, port 0
01/12/09-00:23:45 EST 01/12/09-05:23:45 GMT 915773040 IDLE clientHandler operator error, closing fd sock13: Invalid password for user emaros; please contact Ed Maros at maros_e@ligo.caltech.edu to obtain a valid login Id
01/12/09-00:24:20 EST 01/12/09-05:24:20 GMT 915773075 IDLE cntlmon::manageUsers received cgi cmd updateUserInfo
01/12/09-00:24:20 EST 01/12/09-05:24:20 GMT 915773075 IDLE cntlmon::manageUsers puts to dev null
01/12/09-00:24:20 EST 01/12/09-05:24:20 GMT 915773075 IDLE getEmergData {; } {{managerAPI:emergency_port:executed: eval { puts $cid [ cmdSet [ list [ list mgr::updateUserInfo jgiaime c1670afef093dc32d772c8ee8eaab5d0 jgiaime@ligo.phys.lsu.edu {Joseph A. Giaime} 1-225-578-5794 2010-1-14 0 ] ] ] }}}
01/12/09-00:24:20 EST 01/12/09-05:24:20 GMT 915773075 IDLE cntlmon::manageUsers cgi request updateUserInfo for users jgiaime OK