The cntlmon API on gateway at LDAS_MIT

Legend:
green ball Normal status or debugging message
yellow ball Notable condition which may be a non-fatal error
orange ball Error condition not fatal to job
red ball Error condition fatal to job
blue ball Notable condition which is not an error
purple ball Currently undefined
email Condition requires email notification of the responsible administrator of this API
telephone Condition requires phone notification of the responsible administrator of this API

Link: API Status Page for LDAS_MIT

11/28/08-15:58:46 EST 
11/28/08-20:58:46 GMT 911941140 STARTUP archiveLog file "/ldas_outgoing/logs/LDAScntlmon.log.html" already closed. (archived as /ldas_outgoing/logs/archive/cntlmonAPI/LDAScntlmon.911272024)
11/28/08-15:58:46 EST 
11/28/08-20:58:46 GMT 911941140 STARTUP execOverload overloaded exec
11/28/08-15:58:46 EST 
11/28/08-20:58:46 GMT 911941140 STARTUP bgLoop Looping process cntlmon_expiredCertTest started
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 STARTUP openListenSock port 10022 (operator) opened on gateway as sock6
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 STARTUP openListenSock port 10023 (emergency) opened on gateway as sock7
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 STARTUP setResourceLimit vmemoryuse=unlimited; core=unlimited; datasize=unlimited; descriptors=65536; getRLimit on maxproc error:'Invalid or unsupported resource name: maxproc'; cputime=unlimited; filesize=unlimited; getRLimit on memorylocked error:'Invalid or unsupported resource name: memorylocked'
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 STARTUP leakLogger inital size of cntlmon API: 27424 kB
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 STARTUP bgLoop Looping process etchosts started
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 STARTUP cntlmon Trying API
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 STARTUP cntlmon API yes
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 STARTUP cntlmon Trying LDAS_SYSTEM
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 STARTUP cntlmon LDAS_SYSTEM yes
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 IDLE bgLoop Looping process statpagefile started
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 IDLE bgLoop Looping process killedjobreaper started
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 IDLE bgLoop Looping process logrotate started
11/28/08-15:58:47 EST 
11/28/08-20:58:47 GMT 911941141 IDLE cntlmon::cleanupLDASoutput next cleanup at 1227916727 secs
11/28/08-15:58:48 EST 
11/28/08-20:58:48 GMT 911941142 IDLE cntlmon::initVars mpiAPI is not active
11/28/08-15:58:49 EST 
11/28/08-20:58:49 GMT 911941143 IDLE setFTPandHTTPinfo (::FTPURL 'ftp://18.120.0.97') (::FTPDIR '') (::HTTPURL 'http://18.120.0.97/ldas_outgoing/jobs') (::HTTPDIR '/ldas_outgoing/jobs') (::GRIDFTPURL 'gridftp:/usr1/grid/ldas') (::GRIDFTPDIR '/usr1/grid/ldas') (::LDAS_GATEWAY 'ldas 18.120.0.97') (::LDAS_SYSTEM 'ldas-mit') (::RUNCODE 'LDAS-MIT')
11/28/08-15:58:52 EST 
11/28/08-20:58:52 GMT 911941146 IDLE cntlmon::bootlogscan logscan launched: 15808
11/28/08-15:58:53 EST 
11/28/08-20:58:53 GMT 911941147 IDLE emergency_callback In the last hour, 10 emails were sent out, 0 emails blocked; so far 12141 emails were sent, 18670 unsent (throttle exceeded), 0 emails were blocked, 620 emails generated by ldas since 11/19/08-15:10:13 EST
11/28/08-15:58:53 EST 
11/28/08-20:58:53 GMT 911941147 IDLE cntlmon::registerUtil logscan launched at gateway, pid 15808, port 0
11/28/08-15:58:53 EST 
11/28/08-20:58:53 GMT 911941147 IDLE emergency_callback logscan 621 found 11/19/08-15:10:13 EST, resetting to 0
11/28/08-15:58:54 EST 
11/28/08-20:58:54 GMT 911941148 IDLE setFTPandHTTPinfo (::FTPURL 'ftp://18.120.0.97') (::FTPDIR '') (::HTTPURL 'http://18.120.0.97/ldas_outgoing/jobs') (::HTTPDIR '/ldas_outgoing/jobs') (::GRIDFTPURL 'gridftp:/usr1/grid/ldas') (::GRIDFTPDIR '/usr1/grid/ldas') (::LDAS_GATEWAY 'ldas 18.120.0.97') (::LDAS_SYSTEM 'ldas-mit') (::RUNCODE 'LDAS-MIT')
11/28/08-15:58:56 EST 
11/28/08-20:58:56 GMT 911941150 IDLE cntlmon::bootcoreWatch coreWatch launched: 15875
11/28/08-15:58:56 EST 
11/28/08-20:58:56 GMT 911941150 IDLE cntlmon::getNodeNames Unable to get node names because mpiAPI does not exist or ::MPI_API_HOST is undefined
11/28/08-15:58:57 EST 
11/28/08-20:58:57 GMT 911941151 IDLE cntlmon::updateDBtabcols Updating database tables:
11/28/08-15:58:57 EST 
11/28/08-20:58:57 GMT 911941151 IDLE cntlmon::registerUtil coreWatch launched at ldas.mit.edu, pid 15875, port 0
11/28/08-15:58:57 EST 
11/28/08-20:58:57 GMT 911941151 IDLE cntlmon::bootlogCacheUtils logCacheUtils launched: 15898
11/28/08-15:58:58 EST 
11/28/08-20:58:58 GMT 911941152 IDLE cntlmon::registerUtil logCacheUtils launched at gateway, pid 15898, port 53698
11/28/08-15:58:58 EST 
11/28/08-20:58:58 GMT 911941152 IDLE cleanup db2utils 26375 killed on ssh to metaserver:
11/28/08-15:58:59 EST 
11/28/08-20:58:59 GMT 911941153 IDLE cleanup after cleaning prog db2utils,pid=
11/28/08-15:58:59 EST 
11/28/08-20:58:59 GMT 911941153 IDLE cntlmon::bootdb2utils db2utils launched:
11/28/08-15:59:06 EST 
11/28/08-20:59:06 GMT 911941160 IDLE cntlmon::GlobusChannelInit globus socket cmd 'gt_xio_socket -server cntlmon::GlobusChannelAccept -gridmap_file -myaddr gateway 10032'
11/28/08-15:59:06 EST 
11/28/08-20:59:06 GMT 911941160 IDLE cntlmon::GlobusChannelInit Globus channel gtxiosock0 opened for gsi service at 10032
11/28/08-15:59:09 EST 
11/28/08-20:59:09 GMT 911941163 IDLE ::getPid pids 26483 obtained from ps for /ldas/bin/db2utils
11/28/08-15:59:16 EST 
11/28/08-20:59:16 GMT 911941170 IDLE cntlmon::openClientSock registry 10000
11/28/08-15:59:16 EST 
11/28/08-20:59:16 GMT 911941170 IDLE cntlmon::openClientSock port 10000 (clientHandler) opened on gateway as sock12
11/28/08-15:59:31 EST 
11/28/08-20:59:31 GMT 911941185 IDLE cntlmon::manageUsers received cgi cmd updateUserInfo
11/28/08-15:59:31 EST 
11/28/08-20:59:31 GMT 911941185 IDLE cntlmon::manageUsers puts to dev null
11/28/08-15:59:31 EST 
11/28/08-20:59:31 GMT 911941185 IDLE getEmergData {; } {{managerAPI:emergency_port:executed: eval { puts $cid [ cmdSet [ list [ list mgr::updateUserInfo evang e986b12562b97463fbbcea853932acdf egoetz@umich.edu {Evan Goetz} 734-764-5146 2009-12-4 0 ] ] ] }}}
11/28/08-15:59:31 EST 
11/28/08-20:59:31 GMT 911941185 IDLE cntlmon::manageUsers cgi request updateUserInfo for users evang OK
11/28/08-15:59:42 EST 
11/28/08-20:59:42 GMT 911941196 IDLE cntlmon::registerUtil db2utils launched at metaserver, pid 26483, port 0
11/28/08-16:01:14 EST 
11/28/08-21:01:14 GMT 911941288 IDLE cntlmon::GlobusChannelAccept newsock gtxiosock1 addr alphard.ligo.caltech.edu port 56199
11/28/08-16:01:24 EST 
11/28/08-21:01:24 GMT 911941298 IDLE cntlmon::GlobusChannelRead Error: your cmonClient version ..8.....9.8.5.3.2./.f.e.d.c.b.a.`............. is incompatible with cntlmonAPI server's version 1.10.1; please update your cmonClient package to 1.10.1 before connecting.; closing globus channel gtxiosock1
emaros@ligo.caltech.edu 911941298 IDLE bgerror Subject: LDAS-MIT cntlmonAPI bgerror; Body: can not find channel named "gtxiosock1" while executing "eof $sid " (procedure "cntlmon::GlobusChannelRead" line 44) invoked from within "cntlmon::GlobusChannelRead gtxiosock1"
11/28/08-16:01:47 EST 
11/28/08-21:01:47 GMT 911941321 IDLE clientHandler operator error, closing fd sock13: Invalid password for user emaros; please contact Ed Maros at maros_e@ligo.caltech.edu to obtain a valid login Id