Oracle Database 11g Clusterware Release 11.2.0.3.0 - Production Copyright 1996, 2011 Oracle. All rights reserved.
2017-06-28 19:15:51.706: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:15:52.222: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:15:52.506: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006847, LATS 114117494, lastSeqNo 127006846, uniqueness 1469772618, timestamp 1498662951/3163632128
2017-06-28 19:15:53.224: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:15:53.508: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006848, LATS 114118494, lastSeqNo 127006847, uniqueness 1469772618, timestamp 1498662952/3163633128
2017-06-28 19:15:54.226: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:15:54.510: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006849, LATS 114119494, lastSeqNo 127006848, uniqueness 1469772618, timestamp 1498662953/3163634128
2017-06-28 19:15:54.738: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:15:54.738: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:15:55.228: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:15:55.446: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:15:55.446: [    CSSD][1085458752]clssgmAllocProc: (0x191e7d90) allocated
2017-06-28 19:15:55.446: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e7d90 - 1,2,3,4,5
2017-06-28 19:15:55.446: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x472f) proc(0x191e7d90) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:15:55.446: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:15:55.448: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e7d90
2017-06-28 19:15:55.448: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e7d90
2017-06-28 19:15:55.448: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e7d90), client(1/0x191bf380)
2017-06-28 19:15:55.448: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191bf380 with con 0x475e, requested num -1, flags 0x4000e00
2017-06-28 19:15:55.448: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:15:55.448: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x475e
2017-06-28 19:15:55.449: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e7d90
2017-06-28 19:15:55.449: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e7d90) con(0x472f) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:15:55.449: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x472f
2017-06-28 19:15:55.513: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006850, LATS 114120504, lastSeqNo 127006849, uniqueness 1469772618, timestamp 1498662954/3163635138
2017-06-28 19:15:56.230: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:15:56.515: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006851, LATS 114121504, lastSeqNo 127006850, uniqueness 1469772618, timestamp 1498662955/3163636138
2017-06-28 19:15:57.232: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:15:57.518: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006852, LATS 114122504, lastSeqNo 127006851, uniqueness 1469772618, timestamp 1498662956/3163637138
2017-06-28 19:15:58.234: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:15:58.520: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006853, LATS 114123504, lastSeqNo 127006852, uniqueness 1469772618, timestamp 1498662957/3163638138
2017-06-28 19:15:58.720: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:15:58.720: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:15:58.720: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114123704) for my node
2017-06-28 19:15:58.720: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:15:58.720: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:15:58.720: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:15:58.746: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:15:58.746: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:15:59.236: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:15:59.522: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006854, LATS 114124504, lastSeqNo 127006853, uniqueness 1469772618, timestamp 1498662958/3163639148
2017-06-28 19:16:00.238: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:00.454: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:00.454: [    CSSD][1085458752]clssgmAllocProc: (0x191d1ee0) allocated
2017-06-28 19:16:00.455: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191d1ee0 - 1,2,3,4,5
2017-06-28 19:16:00.455: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x47f7) proc(0x191d1ee0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:00.455: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:00.456: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191d1ee0
2017-06-28 19:16:00.456: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191d1ee0
2017-06-28 19:16:00.456: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191d1ee0), client(1/0x191887e0)
2017-06-28 19:16:00.456: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191887e0 with con 0x4826, requested num -1, flags 0x4000e00
2017-06-28 19:16:00.456: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:00.456: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4826
2017-06-28 19:16:00.457: [    CSSD][1085458752]clssgmDeadProc: proc 0x191d1ee0
2017-06-28 19:16:00.457: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191d1ee0) con(0x47f7) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:00.457: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x47f7
2017-06-28 19:16:00.525: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006855, LATS 114125514, lastSeqNo 127006854, uniqueness 1469772618, timestamp 1498662959/3163640148
2017-06-28 19:16:01.240: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:01.528: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006856, LATS 114126514, lastSeqNo 127006855, uniqueness 1469772618, timestamp 1498662960/3163641148
2017-06-28 19:16:02.242: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:02.532: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006857, LATS 114127514, lastSeqNo 127006856, uniqueness 1469772618, timestamp 1498662961/3163642158
2017-06-28 19:16:03.244: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:03.534: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006858, LATS 114128524, lastSeqNo 127006857, uniqueness 1469772618, timestamp 1498662962/3163643158
2017-06-28 19:16:03.756: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:03.756: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:16:04.246: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:04.537: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006859, LATS 114129524, lastSeqNo 127006858, uniqueness 1469772618, timestamp 1498662963/3163644158
2017-06-28 19:16:05.248: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:05.462: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:05.462: [    CSSD][1085458752]clssgmAllocProc: (0x191e55c0) allocated
2017-06-28 19:16:05.462: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e55c0 - 1,2,3,4,5
2017-06-28 19:16:05.462: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x48cd) proc(0x191e55c0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:05.462: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:05.464: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e55c0
2017-06-28 19:16:05.464: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e55c0
2017-06-28 19:16:05.464: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e55c0), client(1/0x191e5730)
2017-06-28 19:16:05.464: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191e5730 with con 0x48fc, requested num -1, flags 0x4000e00
2017-06-28 19:16:05.464: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:05.464: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x48fc
2017-06-28 19:16:05.465: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e55c0
2017-06-28 19:16:05.465: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e55c0) con(0x48cd) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:05.465: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x48cd
2017-06-28 19:16:05.540: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006860, LATS 114130524, lastSeqNo 127006859, uniqueness 1469772618, timestamp 1498662964/3163645158
2017-06-28 19:16:05.734: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:16:05.734: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:16:05.734: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114130724) for my node
2017-06-28 19:16:05.734: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:16:05.734: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:16:05.734: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:16:06.250: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:06.543: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006861, LATS 114131534, lastSeqNo 127006860, uniqueness 1469772618, timestamp 1498662965/3163646168
2017-06-28 19:16:07.252: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:07.546: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006862, LATS 114132534, lastSeqNo 127006861, uniqueness 1469772618, timestamp 1498662966/3163647168
2017-06-28 19:16:08.254: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:08.549: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006863, LATS 114133534, lastSeqNo 127006862, uniqueness 1469772618, timestamp 1498662967/3163648178
2017-06-28 19:16:08.766: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:08.766: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:16:09.256: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:09.552: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006864, LATS 114134534, lastSeqNo 127006863, uniqueness 1469772618, timestamp 1498662968/3163649178
2017-06-28 19:16:10.258: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:10.470: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:10.470: [    CSSD][1085458752]clssgmAllocProc: (0x19169890) allocated
2017-06-28 19:16:10.470: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x19169890 - 1,2,3,4,5
2017-06-28 19:16:10.471: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x4995) proc(0x19169890) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:10.471: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:10.472: [    CSSD][1085458752]clssscSelect: cookie accept request 0x19169890
2017-06-28 19:16:10.472: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x19169890
2017-06-28 19:16:10.472: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x19169890), client(1/0x191bf380)
2017-06-28 19:16:10.472: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191bf380 with con 0x49c4, requested num -1, flags 0x4000e00
2017-06-28 19:16:10.472: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:10.472: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x49c4
2017-06-28 19:16:10.473: [    CSSD][1085458752]clssgmDeadProc: proc 0x19169890
2017-06-28 19:16:10.473: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x19169890) con(0x4995) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:10.473: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4995
2017-06-28 19:16:10.555: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006865, LATS 114135544, lastSeqNo 127006864, uniqueness 1469772618, timestamp 1498662969/3163650178
2017-06-28 19:16:11.260: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:11.558: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006866, LATS 114136544, lastSeqNo 127006865, uniqueness 1469772618, timestamp 1498662970/3163651178
2017-06-28 19:16:12.262: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:12.561: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006867, LATS 114137544, lastSeqNo 127006866, uniqueness 1469772618, timestamp 1498662971/3163652188
2017-06-28 19:16:12.748: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:16:12.748: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:16:12.748: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114137734) for my node
2017-06-28 19:16:12.748: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:16:12.748: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:16:12.748: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:16:12.774: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:12.774: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:16:13.264: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:13.564: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006868, LATS 114138554, lastSeqNo 127006867, uniqueness 1469772618, timestamp 1498662972/3163653188
2017-06-28 19:16:14.266: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:14.567: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006869, LATS 114139554, lastSeqNo 127006868, uniqueness 1469772618, timestamp 1498662973/3163654188
2017-06-28 19:16:15.268: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:15.478: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:15.478: [    CSSD][1085458752]clssgmAllocProc: (0x19169890) allocated
2017-06-28 19:16:15.479: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x19169890 - 1,2,3,4,5
2017-06-28 19:16:15.479: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x4a6b) proc(0x19169890) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:15.479: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:15.480: [    CSSD][1085458752]clssscSelect: cookie accept request 0x19169890
2017-06-28 19:16:15.480: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x19169890
2017-06-28 19:16:15.480: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x19169890), client(1/0x191bf380)
2017-06-28 19:16:15.480: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191bf380 with con 0x4a9a, requested num -1, flags 0x4000e00
2017-06-28 19:16:15.480: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:15.480: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4a9a
2017-06-28 19:16:15.481: [    CSSD][1085458752]clssgmDeadProc: proc 0x19169890
2017-06-28 19:16:15.481: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x19169890) con(0x4a6b) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:15.481: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4a6b
2017-06-28 19:16:15.570: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006870, LATS 114140554, lastSeqNo 127006869, uniqueness 1469772618, timestamp 1498662974/3163655198
2017-06-28 19:16:16.270: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:16.573: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006871, LATS 114141554, lastSeqNo 127006870, uniqueness 1469772618, timestamp 1498662975/3163656198
2017-06-28 19:16:16.782: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:16.782: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:16:17.272: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:17.576: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006872, LATS 114142564, lastSeqNo 127006871, uniqueness 1469772618, timestamp 1498662976/3163657198
2017-06-28 19:16:18.274: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:18.579: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006873, LATS 114143564, lastSeqNo 127006872, uniqueness 1469772618, timestamp 1498662977/3163658198
2017-06-28 19:16:19.276: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:19.582: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006874, LATS 114144564, lastSeqNo 127006873, uniqueness 1469772618, timestamp 1498662978/3163659198
2017-06-28 19:16:19.762: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:16:19.762: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:16:19.762: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114144744) for my node
2017-06-28 19:16:19.762: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:16:19.762: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:16:19.762: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:16:20.278: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:20.486: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:20.486: [    CSSD][1085458752]clssgmAllocProc: (0x191ddfe0) allocated
2017-06-28 19:16:20.487: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191ddfe0 - 1,2,3,4,5
2017-06-28 19:16:20.487: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x4b33) proc(0x191ddfe0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:20.487: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:20.488: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191ddfe0
2017-06-28 19:16:20.488: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191ddfe0
2017-06-28 19:16:20.488: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191ddfe0), client(1/0x191bf380)
2017-06-28 19:16:20.488: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191bf380 with con 0x4b62, requested num -1, flags 0x4000e00
2017-06-28 19:16:20.488: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:20.488: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4b62
2017-06-28 19:16:20.489: [    CSSD][1085458752]clssgmDeadProc: proc 0x191ddfe0
2017-06-28 19:16:20.489: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191ddfe0) con(0x4b33) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:20.489: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4b33
2017-06-28 19:16:20.585: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006875, LATS 114145564, lastSeqNo 127006874, uniqueness 1469772618, timestamp 1498662979/3163660208
2017-06-28 19:16:20.790: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:20.790: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:16:21.280: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:21.588: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006876, LATS 114146574, lastSeqNo 127006875, uniqueness 1469772618, timestamp 1498662980/3163661208
2017-06-28 19:16:22.282: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:22.591: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006877, LATS 114147574, lastSeqNo 127006876, uniqueness 1469772618, timestamp 1498662981/3163662208
2017-06-28 19:16:23.284: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:23.594: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006878, LATS 114148574, lastSeqNo 127006877, uniqueness 1469772618, timestamp 1498662982/3163663208
2017-06-28 19:16:24.286: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:24.597: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006879, LATS 114149584, lastSeqNo 127006878, uniqueness 1469772618, timestamp 1498662983/3163664208
2017-06-28 19:16:25.288: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:25.494: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:25.494: [    CSSD][1085458752]clssgmAllocProc: (0x191df490) allocated
2017-06-28 19:16:25.495: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191df490 - 1,2,3,4,5
2017-06-28 19:16:25.495: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x4bfb) proc(0x191df490) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:25.495: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:25.496: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191df490
2017-06-28 19:16:25.496: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191df490
2017-06-28 19:16:25.496: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191df490), client(1/0x191d1c90)
2017-06-28 19:16:25.496: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191d1c90 with con 0x4c2a, requested num -1, flags 0x4000e00
2017-06-28 19:16:25.496: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:25.497: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4c2a
2017-06-28 19:16:25.497: [    CSSD][1085458752]clssgmDeadProc: proc 0x191df490
2017-06-28 19:16:25.497: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191df490) con(0x4bfb) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:25.497: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4bfb
2017-06-28 19:16:25.719: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006880, LATS 114150704, lastSeqNo 127006879, uniqueness 1469772618, timestamp 1498662984/3163665218
2017-06-28 19:16:25.800: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:25.800: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:16:26.290: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:26.722: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006881, LATS 114151704, lastSeqNo 127006880, uniqueness 1469772618, timestamp 1498662985/3163666218
2017-06-28 19:16:26.776: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:16:26.776: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:16:26.776: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114151764) for my node
2017-06-28 19:16:26.776: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:16:26.776: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:16:26.776: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:16:27.292: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:27.725: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006882, LATS 114152704, lastSeqNo 127006881, uniqueness 1469772618, timestamp 1498662986/3163667218
2017-06-28 19:16:28.294: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:28.728: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006883, LATS 114153714, lastSeqNo 127006882, uniqueness 1469772618, timestamp 1498662987/3163668218
2017-06-28 19:16:29.296: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:29.731: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006884, LATS 114154714, lastSeqNo 127006883, uniqueness 1469772618, timestamp 1498662988/3163669218
2017-06-28 19:16:30.298: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:30.503: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:30.503: [    CSSD][1085458752]clssgmAllocProc: (0x191e0740) allocated
2017-06-28 19:16:30.503: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e0740 - 1,2,3,4,5
2017-06-28 19:16:30.504: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x4cd1) proc(0x191e0740) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:30.504: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:30.505: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e0740
2017-06-28 19:16:30.505: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e0740
2017-06-28 19:16:30.505: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e0740), client(1/0x190adfa0)
2017-06-28 19:16:30.505: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x190adfa0 with con 0x4d00, requested num -1, flags 0x4000e00
2017-06-28 19:16:30.505: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:30.505: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4d00
2017-06-28 19:16:30.506: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e0740
2017-06-28 19:16:30.506: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e0740) con(0x4cd1) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:30.506: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4cd1
2017-06-28 19:16:30.734: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006885, LATS 114155714, lastSeqNo 127006884, uniqueness 1469772618, timestamp 1498662989/3163670228
2017-06-28 19:16:30.810: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:30.810: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:16:31.300: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:31.737: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006886, LATS 114156724, lastSeqNo 127006885, uniqueness 1469772618, timestamp 1498662990/3163671228
2017-06-28 19:16:32.302: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:32.740: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006887, LATS 114157724, lastSeqNo 127006886, uniqueness 1469772618, timestamp 1498662991/3163672228
2017-06-28 19:16:33.304: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:33.743: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006888, LATS 114158724, lastSeqNo 127006887, uniqueness 1469772618, timestamp 1498662992/3163673228
2017-06-28 19:16:33.790: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:16:33.790: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:16:33.790: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114158774) for my node
2017-06-28 19:16:33.790: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:16:33.790: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:16:33.791: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:16:34.307: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:34.746: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006889, LATS 114159724, lastSeqNo 127006888, uniqueness 1469772618, timestamp 1498662993/3163674238
2017-06-28 19:16:35.309: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:35.512: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:35.512: [    CSSD][1085458752]clssgmAllocProc: (0x191e0740) allocated
2017-06-28 19:16:35.513: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e0740 - 1,2,3,4,5
2017-06-28 19:16:35.513: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x4d99) proc(0x191e0740) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:35.513: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:35.514: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e0740
2017-06-28 19:16:35.514: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e0740
2017-06-28 19:16:35.514: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e0740), client(1/0x190adfa0)
2017-06-28 19:16:35.514: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x190adfa0 with con 0x4dc8, requested num -1, flags 0x4000e00
2017-06-28 19:16:35.514: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:35.514: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4dc8
2017-06-28 19:16:35.515: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e0740
2017-06-28 19:16:35.515: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e0740) con(0x4d99) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:35.515: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4d99
2017-06-28 19:16:35.749: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006890, LATS 114160734, lastSeqNo 127006889, uniqueness 1469772618, timestamp 1498662994/3163675238
2017-06-28 19:16:35.821: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:35.821: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:16:36.311: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:36.751: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006891, LATS 114161734, lastSeqNo 127006890, uniqueness 1469772618, timestamp 1498662995/3163676238
2017-06-28 19:16:37.314: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:37.753: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006892, LATS 114162734, lastSeqNo 127006891, uniqueness 1469772618, timestamp 1498662996/3163677248
2017-06-28 19:16:38.316: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:38.756: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006893, LATS 114163734, lastSeqNo 127006892, uniqueness 1469772618, timestamp 1498662997/3163678248
2017-06-28 19:16:39.318: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:39.758: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006894, LATS 114164744, lastSeqNo 127006893, uniqueness 1469772618, timestamp 1498662998/3163679248
2017-06-28 19:16:39.833: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:39.833: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:16:40.320: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:40.520: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:40.520: [    CSSD][1085458752]clssgmAllocProc: (0x191e0740) allocated
2017-06-28 19:16:40.521: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e0740 - 1,2,3,4,5
2017-06-28 19:16:40.521: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x4e61) proc(0x191e0740) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:40.521: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:40.522: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e0740
2017-06-28 19:16:40.522: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e0740
2017-06-28 19:16:40.522: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e0740), client(1/0x190adfa0)
2017-06-28 19:16:40.522: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x190adfa0 with con 0x4e90, requested num -1, flags 0x4000e00
2017-06-28 19:16:40.522: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:40.522: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4e90
2017-06-28 19:16:40.523: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e0740
2017-06-28 19:16:40.523: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e0740) con(0x4e61) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:40.523: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4e61
2017-06-28 19:16:40.760: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006895, LATS 114165744, lastSeqNo 127006894, uniqueness 1469772618, timestamp 1498662999/3163680248
2017-06-28 19:16:40.808: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:16:40.808: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:16:40.808: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114165784) for my node
2017-06-28 19:16:40.808: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:16:40.808: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:16:40.809: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:16:41.322: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:41.762: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006896, LATS 114166744, lastSeqNo 127006895, uniqueness 1469772618, timestamp 1498663000/3163681258
2017-06-28 19:16:42.324: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:42.764: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006897, LATS 114167744, lastSeqNo 127006896, uniqueness 1469772618, timestamp 1498663001/3163682258
2017-06-28 19:16:43.326: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:43.766: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006898, LATS 114168744, lastSeqNo 127006897, uniqueness 1469772618, timestamp 1498663002/3163683258
2017-06-28 19:16:43.842: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:43.842: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:16:44.328: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:44.768: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006899, LATS 114169744, lastSeqNo 127006898, uniqueness 1469772618, timestamp 1498663003/3163684258
2017-06-28 19:16:45.330: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:45.528: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:45.528: [    CSSD][1085458752]clssgmAllocProc: (0x191e0740) allocated
2017-06-28 19:16:45.529: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e0740 - 1,2,3,4,5
2017-06-28 19:16:45.529: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x4f29) proc(0x191e0740) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:45.529: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:45.530: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e0740
2017-06-28 19:16:45.530: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e0740
2017-06-28 19:16:45.530: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e0740), client(1/0x191e08b0)
2017-06-28 19:16:45.530: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191e08b0 with con 0x4f58, requested num -1, flags 0x4000e00
2017-06-28 19:16:45.530: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:45.530: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4f58
2017-06-28 19:16:45.531: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e0740
2017-06-28 19:16:45.531: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e0740) con(0x4f29) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:45.531: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4f29
2017-06-28 19:16:45.770: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006900, LATS 114170754, lastSeqNo 127006899, uniqueness 1469772618, timestamp 1498663004/3163685258
2017-06-28 19:16:46.332: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:46.772: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006901, LATS 114171754, lastSeqNo 127006900, uniqueness 1469772618, timestamp 1498663005/3163686258
2017-06-28 19:16:47.334: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:47.774: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006902, LATS 114172754, lastSeqNo 127006901, uniqueness 1469772618, timestamp 1498663006/3163687268
2017-06-28 19:16:47.822: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:16:47.822: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:16:47.822: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114172804) for my node
2017-06-28 19:16:47.822: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:16:47.822: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:16:47.823: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:16:48.336: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:48.776: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006903, LATS 114173754, lastSeqNo 127006902, uniqueness 1469772618, timestamp 1498663007/3163688268
2017-06-28 19:16:48.852: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:48.852: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:16:49.338: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:49.778: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006904, LATS 114174754, lastSeqNo 127006903, uniqueness 1469772618, timestamp 1498663008/3163689268
2017-06-28 19:16:50.340: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:50.536: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:50.536: [    CSSD][1085458752]clssgmAllocProc: (0x191e0740) allocated
2017-06-28 19:16:50.537: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e0740 - 1,2,3,4,5
2017-06-28 19:16:50.537: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x4ff1) proc(0x191e0740) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:50.537: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:50.538: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e0740
2017-06-28 19:16:50.538: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e0740
2017-06-28 19:16:50.538: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e0740), client(1/0x191d9540)
2017-06-28 19:16:50.538: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191d9540 with con 0x5020, requested num -1, flags 0x4000e00
2017-06-28 19:16:50.538: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:50.539: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5020
2017-06-28 19:16:50.539: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e0740
2017-06-28 19:16:50.539: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e0740) con(0x4ff1) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:50.539: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x4ff1
2017-06-28 19:16:50.780: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006905, LATS 114175764, lastSeqNo 127006904, uniqueness 1469772618, timestamp 1498663009/3163690268
2017-06-28 19:16:51.342: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:51.782: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006906, LATS 114176764, lastSeqNo 127006905, uniqueness 1469772618, timestamp 1498663010/3163691268
2017-06-28 19:16:52.344: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:52.784: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006907, LATS 114177764, lastSeqNo 127006906, uniqueness 1469772618, timestamp 1498663011/3163692278
2017-06-28 19:16:53.346: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:53.786: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006908, LATS 114178764, lastSeqNo 127006907, uniqueness 1469772618, timestamp 1498663012/3163693278
2017-06-28 19:16:53.862: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:53.862: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:16:54.348: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:54.788: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006909, LATS 114179764, lastSeqNo 127006908, uniqueness 1469772618, timestamp 1498663013/3163694278
2017-06-28 19:16:54.836: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:16:54.836: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:16:54.836: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114179814) for my node
2017-06-28 19:16:54.836: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:16:54.836: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:16:54.837: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:16:55.350: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:55.544: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:16:55.544: [    CSSD][1085458752]clssgmAllocProc: (0x18f1c750) allocated
2017-06-28 19:16:55.545: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x18f1c750 - 1,2,3,4,5
2017-06-28 19:16:55.545: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x50b9) proc(0x18f1c750) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:16:55.545: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:16:55.546: [    CSSD][1085458752]clssscSelect: cookie accept request 0x18f1c750
2017-06-28 19:16:55.546: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x18f1c750
2017-06-28 19:16:55.546: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x18f1c750), client(1/0x191bf380)
2017-06-28 19:16:55.546: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191bf380 with con 0x50e8, requested num -1, flags 0x4000e00
2017-06-28 19:16:55.546: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:16:55.546: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x50e8
2017-06-28 19:16:55.547: [    CSSD][1085458752]clssgmDeadProc: proc 0x18f1c750
2017-06-28 19:16:55.547: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x18f1c750) con(0x50b9) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:16:55.547: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x50b9
2017-06-28 19:16:55.790: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006910, LATS 114180764, lastSeqNo 127006909, uniqueness 1469772618, timestamp 1498663014/3163695278
2017-06-28 19:16:56.352: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:56.792: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006911, LATS 114181774, lastSeqNo 127006910, uniqueness 1469772618, timestamp 1498663015/3163696278
2017-06-28 19:16:57.354: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:57.794: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006912, LATS 114182774, lastSeqNo 127006911, uniqueness 1469772618, timestamp 1498663016/3163697278
2017-06-28 19:16:58.356: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:58.796: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006913, LATS 114183774, lastSeqNo 127006912, uniqueness 1469772618, timestamp 1498663017/3163698288
2017-06-28 19:16:58.872: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:16:58.872: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:16:59.358: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:16:59.798: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006914, LATS 114184774, lastSeqNo 127006913, uniqueness 1469772618, timestamp 1498663018/3163699288
2017-06-28 19:17:00.360: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:00.553: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:00.553: [    CSSD][1085458752]clssgmAllocProc: (0x18f1c750) allocated
2017-06-28 19:17:00.553: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x18f1c750 - 1,2,3,4,5
2017-06-28 19:17:00.553: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5184) proc(0x18f1c750) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:00.553: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:00.554: [    CSSD][1085458752]clssscSelect: cookie accept request 0x18f1c750
2017-06-28 19:17:00.554: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x18f1c750
2017-06-28 19:17:00.554: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x18f1c750), client(1/0x191bf380)
2017-06-28 19:17:00.555: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191bf380 with con 0x51b3, requested num -1, flags 0x4000e00
2017-06-28 19:17:00.555: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:00.555: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x51b3
2017-06-28 19:17:00.555: [    CSSD][1085458752]clssgmDeadProc: proc 0x18f1c750
2017-06-28 19:17:00.555: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x18f1c750) con(0x5184) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:00.555: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5184
2017-06-28 19:17:00.800: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006915, LATS 114185774, lastSeqNo 127006914, uniqueness 1469772618, timestamp 1498663019/3163700288
2017-06-28 19:17:01.362: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:01.802: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006916, LATS 114186784, lastSeqNo 127006915, uniqueness 1469772618, timestamp 1498663020/3163701288
2017-06-28 19:17:01.850: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:17:01.850: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:17:01.850: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114186824) for my node
2017-06-28 19:17:01.850: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:17:01.850: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:17:01.851: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:17:02.364: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:02.804: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006917, LATS 114187784, lastSeqNo 127006916, uniqueness 1469772618, timestamp 1498663021/3163702288
2017-06-28 19:17:02.880: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:02.880: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:17:03.366: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:03.807: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006918, LATS 114188784, lastSeqNo 127006917, uniqueness 1469772618, timestamp 1498663022/3163703298
2017-06-28 19:17:04.368: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:04.809: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006919, LATS 114189784, lastSeqNo 127006918, uniqueness 1469772618, timestamp 1498663023/3163704298
2017-06-28 19:17:05.370: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:05.560: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:05.560: [    CSSD][1085458752]clssgmAllocProc: (0x19169890) allocated
2017-06-28 19:17:05.561: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x19169890 - 1,2,3,4,5
2017-06-28 19:17:05.561: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x524c) proc(0x19169890) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:05.561: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:05.562: [    CSSD][1085458752]clssscSelect: cookie accept request 0x19169890
2017-06-28 19:17:05.562: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x19169890
2017-06-28 19:17:05.562: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x19169890), client(1/0x191bf380)
2017-06-28 19:17:05.562: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191bf380 with con 0x527b, requested num -1, flags 0x4000e00
2017-06-28 19:17:05.562: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:05.563: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x527b
2017-06-28 19:17:05.563: [    CSSD][1085458752]clssgmDeadProc: proc 0x19169890
2017-06-28 19:17:05.563: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x19169890) con(0x524c) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:05.563: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x524c
2017-06-28 19:17:05.812: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006920, LATS 114190794, lastSeqNo 127006919, uniqueness 1469772618, timestamp 1498663024/3163705298
2017-06-28 19:17:06.372: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:06.814: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006921, LATS 114191794, lastSeqNo 127006920, uniqueness 1469772618, timestamp 1498663025/3163706298
2017-06-28 19:17:06.888: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:06.888: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:17:07.374: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:07.816: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006922, LATS 114192794, lastSeqNo 127006921, uniqueness 1469772618, timestamp 1498663026/3163707308
2017-06-28 19:17:08.376: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:08.818: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006923, LATS 114193794, lastSeqNo 127006922, uniqueness 1469772618, timestamp 1498663027/3163708308
2017-06-28 19:17:08.864: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:17:08.864: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:17:08.864: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114193844) for my node
2017-06-28 19:17:08.864: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:17:08.864: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:17:08.865: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:17:09.378: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:09.820: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006924, LATS 114194794, lastSeqNo 127006923, uniqueness 1469772618, timestamp 1498663028/3163709318
2017-06-28 19:17:10.380: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:10.569: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:10.569: [    CSSD][1085458752]clssgmAllocProc: (0x190ae660) allocated
2017-06-28 19:17:10.569: [    CSSD][1085458752]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 7760 msecs
2017-06-28 19:17:10.569: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x190ae660 - 1,2,3,4,5
2017-06-28 19:17:10.569: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5317) proc(0x190ae660) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:10.569: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:10.570: [    CSSD][1085458752]clssscSelect: cookie accept request 0x190ae660
2017-06-28 19:17:10.570: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x190ae660
2017-06-28 19:17:10.570: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x190ae660), client(1/0x191bf380)
2017-06-28 19:17:10.571: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191bf380 with con 0x5346, requested num -1, flags 0x4000e00
2017-06-28 19:17:10.571: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:10.571: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5346
2017-06-28 19:17:10.571: [    CSSD][1085458752]clssgmDeadProc: proc 0x190ae660
2017-06-28 19:17:10.571: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x190ae660) con(0x5317) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:10.571: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5317
2017-06-28 19:17:10.822: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006925, LATS 114195794, lastSeqNo 127006924, uniqueness 1469772618, timestamp 1498663029/3163710318
2017-06-28 19:17:10.896: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:10.896: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:17:11.382: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:12.384: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:13.386: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:14.388: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:15.390: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:15.577: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:15.577: [    CSSD][1085458752]clssgmAllocProc: (0x190ae660) allocated
2017-06-28 19:17:15.577: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x190ae660 - 1,2,3,4,5
2017-06-28 19:17:15.577: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x53e2) proc(0x190ae660) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:15.577: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:15.578: [    CSSD][1085458752]clssscSelect: cookie accept request 0x190ae660
2017-06-28 19:17:15.579: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x190ae660
2017-06-28 19:17:15.579: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x190ae660), client(1/0x19159e10)
2017-06-28 19:17:15.579: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x19159e10 with con 0x5411, requested num -1, flags 0x4000e00
2017-06-28 19:17:15.579: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:15.579: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5411
2017-06-28 19:17:15.579: [    CSSD][1085458752]clssgmDeadProc: proc 0x190ae660
2017-06-28 19:17:15.579: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x190ae660) con(0x53e2) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:15.579: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x53e2
2017-06-28 19:17:15.878: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:17:15.878: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:17:15.878: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114200854) for my node
2017-06-28 19:17:15.878: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:17:15.878: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:17:15.879: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:17:15.906: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:15.906: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:17:16.392: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:17.394: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:18.396: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:18.737: [    CSSD][1085458752]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 15930 msecs
2017-06-28 19:17:19.398: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:20.400: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:20.585: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:20.585: [    CSSD][1085458752]clssgmAllocProc: (0x190ae660) allocated
2017-06-28 19:17:20.585: [    CSSD][1085458752]clssscMonitorThreads clssnmvWorkerThread not scheduled for 8760 msecs
2017-06-28 19:17:20.585: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x190ae660 - 1,2,3,4,5
2017-06-28 19:17:20.585: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x54b8) proc(0x190ae660) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:20.585: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:20.586: [    CSSD][1085458752]clssscSelect: cookie accept request 0x190ae660
2017-06-28 19:17:20.586: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x190ae660
2017-06-28 19:17:20.586: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x190ae660), client(1/0x191bf380)
2017-06-28 19:17:20.586: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191bf380 with con 0x54e7, requested num -1, flags 0x4000e00
2017-06-28 19:17:20.587: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:20.587: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x54e7
2017-06-28 19:17:20.587: [    CSSD][1085458752]clssgmDeadProc: proc 0x190ae660
2017-06-28 19:17:20.587: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x190ae660) con(0x54b8) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:20.587: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x54b8
2017-06-28 19:17:20.916: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:20.916: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:17:21.402: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:22.404: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:22.892: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:17:22.892: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:17:22.892: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114207864) for my node
2017-06-28 19:17:22.892: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:17:22.892: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:17:22.893: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:17:23.406: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:24.408: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:24.924: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:24.924: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:17:25.410: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:25.593: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:25.593: [    CSSD][1085458752]clssgmAllocProc: (0x190ae660) allocated
2017-06-28 19:17:25.593: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x190ae660 - 1,2,3,4,5
2017-06-28 19:17:25.593: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5580) proc(0x190ae660) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:25.593: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:25.595: [    CSSD][1085458752]clssscSelect: cookie accept request 0x190ae660
2017-06-28 19:17:25.595: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x190ae660
2017-06-28 19:17:25.595: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x190ae660), client(1/0x190ae7d0)
2017-06-28 19:17:25.595: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x190ae7d0 with con 0x55af, requested num -1, flags 0x4000e00
2017-06-28 19:17:25.595: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:25.595: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x55af
2017-06-28 19:17:25.596: [    CSSD][1085458752]clssgmDeadProc: proc 0x190ae660
2017-06-28 19:17:25.596: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x190ae660) con(0x5580) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:25.596: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5580
2017-06-28 19:17:26.412: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:27.414: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:28.416: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:28.747: [    CSSD][1085458752]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 25940 msecs
2017-06-28 19:17:28.747: [    CSSD][1085458752]clssscMonitorThreads clssnmvWorkerThread not scheduled for 16920 msecs
2017-06-28 19:17:28.932: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:28.932: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:17:29.418: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:29.906: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:17:29.906: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:17:29.906: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114214884) for my node
2017-06-28 19:17:29.906: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:17:29.906: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:17:29.907: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:17:30.420: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:30.602: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:30.602: [    CSSD][1085458752]clssgmAllocProc: (0x190ae660) allocated
2017-06-28 19:17:30.602: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x190ae660 - 1,2,3,4,5
2017-06-28 19:17:30.602: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5656) proc(0x190ae660) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:30.602: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:30.604: [    CSSD][1085458752]clssscSelect: cookie accept request 0x190ae660
2017-06-28 19:17:30.604: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x190ae660
2017-06-28 19:17:30.604: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x190ae660), client(1/0x191e8050)
2017-06-28 19:17:30.604: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191e8050 with con 0x5685, requested num -1, flags 0x4000e00
2017-06-28 19:17:30.604: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:30.604: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5685
2017-06-28 19:17:30.605: [    CSSD][1085458752]clssgmDeadProc: proc 0x190ae660
2017-06-28 19:17:30.605: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x190ae660) con(0x5656) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:30.605: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5656
2017-06-28 19:17:31.422: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:32.424: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:32.940: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:32.940: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:17:33.426: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:34.428: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:35.430: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:35.610: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:35.610: [    CSSD][1085458752]clssgmAllocProc: (0x190ae660) allocated
2017-06-28 19:17:35.610: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x190ae660 - 1,2,3,4,5
2017-06-28 19:17:35.610: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x571e) proc(0x190ae660) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:35.610: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:35.612: [    CSSD][1085458752]clssscSelect: cookie accept request 0x190ae660
2017-06-28 19:17:35.612: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x190ae660
2017-06-28 19:17:35.612: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x190ae660), client(1/0x190ae7d0)
2017-06-28 19:17:35.612: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x190ae7d0 with con 0x574d, requested num -1, flags 0x4000e00
2017-06-28 19:17:35.612: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:35.612: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x574d
2017-06-28 19:17:35.612: [    CSSD][1085458752]clssgmDeadProc: proc 0x190ae660
2017-06-28 19:17:35.613: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x190ae660) con(0x571e) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:35.613: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x571e
2017-06-28 19:17:36.432: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:36.920: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:17:36.920: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:17:36.920: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114221894) for my node
2017-06-28 19:17:36.920: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:17:36.920: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:17:36.921: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:17:37.434: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:37.950: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:37.950: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:17:38.436: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:38.757: [    CSSD][1085458752]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 35950 msecs
2017-06-28 19:17:38.757: [    CSSD][1085458752]clssscMonitorThreads clssnmvWorkerThread not scheduled for 26930 msecs
2017-06-28 19:17:39.438: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:40.440: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:40.619: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:40.619: [    CSSD][1085458752]clssgmAllocProc: (0x191f9300) allocated
2017-06-28 19:17:40.619: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191f9300 - 1,2,3,4,5
2017-06-28 19:17:40.619: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x57f4) proc(0x191f9300) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:40.619: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:40.621: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191f9300
2017-06-28 19:17:40.621: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191f9300
2017-06-28 19:17:40.621: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191f9300), client(1/0x191e8050)
2017-06-28 19:17:40.621: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191e8050 with con 0x5823, requested num -1, flags 0x4000e00
2017-06-28 19:17:40.621: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:40.621: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5823
2017-06-28 19:17:40.622: [    CSSD][1085458752]clssgmDeadProc: proc 0x191f9300
2017-06-28 19:17:40.622: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191f9300) con(0x57f4) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:40.622: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x57f4
2017-06-28 19:17:41.442: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:42.444: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:42.960: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:42.960: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:17:43.446: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:43.934: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:17:43.934: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:17:43.934: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114228904) for my node
2017-06-28 19:17:43.934: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:17:43.934: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:17:43.935: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:17:44.448: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:45.450: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:45.627: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:45.627: [    CSSD][1085458752]clssgmAllocProc: (0x19298a90) allocated
2017-06-28 19:17:45.627: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x19298a90 - 1,2,3,4,5
2017-06-28 19:17:45.627: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x58bc) proc(0x19298a90) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:45.627: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:45.629: [    CSSD][1085458752]clssscSelect: cookie accept request 0x19298a90
2017-06-28 19:17:45.629: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x19298a90
2017-06-28 19:17:45.629: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x19298a90), client(1/0x19298c00)
2017-06-28 19:17:45.629: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x19298c00 with con 0x58eb, requested num -1, flags 0x4000e00
2017-06-28 19:17:45.629: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:45.629: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x58eb
2017-06-28 19:17:45.630: [    CSSD][1085458752]clssgmDeadProc: proc 0x19298a90
2017-06-28 19:17:45.630: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x19298a90) con(0x58bc) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:45.630: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x58bc
2017-06-28 19:17:46.452: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:47.454: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:47.970: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:47.970: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:17:48.456: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:48.777: [    CSSD][1085458752]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 45960 msecs
2017-06-28 19:17:48.777: [    CSSD][1085458752]clssscMonitorThreads clssnmvWorkerThread not scheduled for 36940 msecs
2017-06-28 19:17:49.458: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:50.460: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:50.636: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:50.636: [    CSSD][1085458752]clssgmAllocProc: (0x191697d0) allocated
2017-06-28 19:17:50.636: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191697d0 - 1,2,3,4,5
2017-06-28 19:17:50.636: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5984) proc(0x191697d0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:50.636: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:50.638: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191697d0
2017-06-28 19:17:50.638: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191697d0
2017-06-28 19:17:50.638: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191697d0), client(1/0x191e7e80)
2017-06-28 19:17:50.638: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191e7e80 with con 0x59b3, requested num -1, flags 0x4000e00
2017-06-28 19:17:50.638: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:50.638: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x59b3
2017-06-28 19:17:50.639: [    CSSD][1085458752]clssgmDeadProc: proc 0x191697d0
2017-06-28 19:17:50.639: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191697d0) con(0x5984) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:50.639: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5984
2017-06-28 19:17:50.948: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:17:50.948: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:17:50.948: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114235924) for my node
2017-06-28 19:17:50.948: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:17:50.949: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:17:50.949: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:17:51.463: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:51.979: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:51.979: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:17:52.465: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:53.468: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:54.470: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:55.472: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:55.645: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:17:55.645: [    CSSD][1085458752]clssgmAllocProc: (0x191697d0) allocated
2017-06-28 19:17:55.645: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191697d0 - 1,2,3,4,5
2017-06-28 19:17:55.645: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5a5a) proc(0x191697d0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:17:55.645: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:17:55.647: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191697d0
2017-06-28 19:17:55.647: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191697d0
2017-06-28 19:17:55.647: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191697d0), client(1/0x191e7e80)
2017-06-28 19:17:55.647: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191e7e80 with con 0x5a89, requested num -1, flags 0x4000e00
2017-06-28 19:17:55.647: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:17:55.647: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5a89
2017-06-28 19:17:55.648: [    CSSD][1085458752]clssgmDeadProc: proc 0x191697d0
2017-06-28 19:17:55.648: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191697d0) con(0x5a5a) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:17:55.648: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5a5a
2017-06-28 19:17:55.990: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:17:55.990: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:17:56.475: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:57.478: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:57.965: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:17:57.965: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:17:57.965: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114242934) for my node
2017-06-28 19:17:57.965: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:17:57.966: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:17:57.966: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:17:58.480: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:17:58.781: [    CSSD][1085458752]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 55970 msecs
2017-06-28 19:17:58.781: [    CSSD][1085458752]clssscMonitorThreads clssnmvWorkerThread not scheduled for 46950 msecs
2017-06-28 19:17:59.482: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:00.000: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:00.000: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:18:00.484: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:00.654: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:00.654: [    CSSD][1085458752]clssgmAllocProc: (0x191697d0) allocated
2017-06-28 19:18:00.655: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191697d0 - 1,2,3,4,5
2017-06-28 19:18:00.655: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5b22) proc(0x191697d0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:00.655: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:00.656: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191697d0
2017-06-28 19:18:00.656: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191697d0
2017-06-28 19:18:00.656: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191697d0), client(1/0x191d3ca0)
2017-06-28 19:18:00.656: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191d3ca0 with con 0x5b51, requested num -1, flags 0x4000e00
2017-06-28 19:18:00.656: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:00.656: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5b51
2017-06-28 19:18:00.657: [    CSSD][1085458752]clssgmDeadProc: proc 0x191697d0
2017-06-28 19:18:00.657: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191697d0) con(0x5b22) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:00.657: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5b22
2017-06-28 19:18:01.486: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:02.488: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:03.490: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:03.808: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006978, LATS 114248774, lastSeqNo 127006925, uniqueness 1469772618, timestamp 1498663082/3163763448
2017-06-28 19:18:04.008: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:04.008: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:18:04.492: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:04.811: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006979, LATS 114249784, lastSeqNo 127006978, uniqueness 1469772618, timestamp 1498663083/3163764448
2017-06-28 19:18:04.979: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:18:04.979: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:18:04.979: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114249944) for my node
2017-06-28 19:18:04.980: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:18:04.980: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:18:04.980: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:18:05.494: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:05.662: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:05.662: [    CSSD][1085458752]clssgmAllocProc: (0x19299d20) allocated
2017-06-28 19:18:05.662: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x19299d20 - 1,2,3,4,5
2017-06-28 19:18:05.662: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5bea) proc(0x19299d20) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:05.662: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:05.664: [    CSSD][1085458752]clssscSelect: cookie accept request 0x19299d20
2017-06-28 19:18:05.664: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x19299d20
2017-06-28 19:18:05.664: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x19299d20), client(1/0x191d39b0)
2017-06-28 19:18:05.664: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191d39b0 with con 0x5c19, requested num -1, flags 0x4000e00
2017-06-28 19:18:05.664: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:05.664: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5c19
2017-06-28 19:18:05.665: [    CSSD][1085458752]clssgmDeadProc: proc 0x19299d20
2017-06-28 19:18:05.665: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x19299d20) con(0x5bea) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:05.665: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5bea
2017-06-28 19:18:05.813: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006980, LATS 114250784, lastSeqNo 127006979, uniqueness 1469772618, timestamp 1498663084/3163765448
2017-06-28 19:18:06.496: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:06.881: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006981, LATS 114251844, lastSeqNo 127006980, uniqueness 1469772618, timestamp 1498663085/3163766448
2017-06-28 19:18:07.498: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:07.884: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006982, LATS 114252854, lastSeqNo 127006981, uniqueness 1469772618, timestamp 1498663086/3163767448
2017-06-28 19:18:08.016: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:08.016: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:18:08.500: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:08.886: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006983, LATS 114253854, lastSeqNo 127006982, uniqueness 1469772618, timestamp 1498663087/3163768458
2017-06-28 19:18:09.502: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:09.888: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006984, LATS 114254854, lastSeqNo 127006983, uniqueness 1469772618, timestamp 1498663088/3163769458
2017-06-28 19:18:10.504: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:10.670: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:10.670: [    CSSD][1085458752]clssgmAllocProc: (0x191e1a70) allocated
2017-06-28 19:18:10.670: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e1a70 - 1,2,3,4,5
2017-06-28 19:18:10.670: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5cb2) proc(0x191e1a70) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:10.670: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:10.672: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e1a70
2017-06-28 19:18:10.672: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e1a70
2017-06-28 19:18:10.672: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e1a70), client(1/0x191e1be0)
2017-06-28 19:18:10.672: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191e1be0 with con 0x5ce1, requested num -1, flags 0x4000e00
2017-06-28 19:18:10.672: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:10.672: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5ce1
2017-06-28 19:18:10.673: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e1a70
2017-06-28 19:18:10.673: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e1a70) con(0x5cb2) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:10.673: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5cb2
2017-06-28 19:18:10.890: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006985, LATS 114255854, lastSeqNo 127006984, uniqueness 1469772618, timestamp 1498663089/3163770458
2017-06-28 19:18:11.506: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:11.892: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006986, LATS 114256864, lastSeqNo 127006985, uniqueness 1469772618, timestamp 1498663090/3163771458
2017-06-28 19:18:11.993: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:18:11.994: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:18:11.994: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114256964) for my node
2017-06-28 19:18:11.994: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:18:11.994: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:18:11.994: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:18:12.024: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:12.024: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:18:12.508: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:12.894: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006987, LATS 114257864, lastSeqNo 127006986, uniqueness 1469772618, timestamp 1498663091/3163772468
2017-06-28 19:18:13.510: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:13.896: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006988, LATS 114258864, lastSeqNo 127006987, uniqueness 1469772618, timestamp 1498663092/3163773468
2017-06-28 19:18:14.512: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:14.898: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006989, LATS 114259864, lastSeqNo 127006988, uniqueness 1469772618, timestamp 1498663093/3163774468
2017-06-28 19:18:15.514: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:15.678: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:15.678: [    CSSD][1085458752]clssgmAllocProc: (0x191e1a70) allocated
2017-06-28 19:18:15.678: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e1a70 - 1,2,3,4,5
2017-06-28 19:18:15.678: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5d7a) proc(0x191e1a70) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:15.678: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:15.680: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e1a70
2017-06-28 19:18:15.680: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e1a70
2017-06-28 19:18:15.680: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e1a70), client(1/0x191722f0)
2017-06-28 19:18:15.680: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191722f0 with con 0x5da9, requested num -1, flags 0x4000e00
2017-06-28 19:18:15.680: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:15.680: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5da9
2017-06-28 19:18:15.681: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e1a70
2017-06-28 19:18:15.681: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e1a70) con(0x5d7a) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:15.681: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5d7a
2017-06-28 19:18:15.900: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006990, LATS 114260864, lastSeqNo 127006989, uniqueness 1469772618, timestamp 1498663094/3163775468
2017-06-28 19:18:16.516: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:16.902: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006991, LATS 114261864, lastSeqNo 127006990, uniqueness 1469772618, timestamp 1498663095/3163776468
2017-06-28 19:18:17.034: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:17.034: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:18:17.518: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:17.904: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006992, LATS 114262874, lastSeqNo 127006991, uniqueness 1469772618, timestamp 1498663096/3163777478
2017-06-28 19:18:18.520: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:18.906: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006993, LATS 114263874, lastSeqNo 127006992, uniqueness 1469772618, timestamp 1498663097/3163778478
2017-06-28 19:18:19.008: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:18:19.008: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:18:19.008: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114263974) for my node
2017-06-28 19:18:19.008: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:18:19.008: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:18:19.008: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:18:19.522: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:19.908: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006994, LATS 114264874, lastSeqNo 127006993, uniqueness 1469772618, timestamp 1498663098/3163779478
2017-06-28 19:18:20.524: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:20.686: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:20.686: [    CSSD][1085458752]clssgmAllocProc: (0x191e1a70) allocated
2017-06-28 19:18:20.686: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e1a70 - 1,2,3,4,5
2017-06-28 19:18:20.686: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5e42) proc(0x191e1a70) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:20.686: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:20.688: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e1a70
2017-06-28 19:18:20.688: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e1a70
2017-06-28 19:18:20.688: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e1a70), client(1/0x191b3500)
2017-06-28 19:18:20.688: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191b3500 with con 0x5e71, requested num -1, flags 0x4000e00
2017-06-28 19:18:20.688: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:20.688: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5e71
2017-06-28 19:18:20.689: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e1a70
2017-06-28 19:18:20.689: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e1a70) con(0x5e42) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:20.689: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5e42
2017-06-28 19:18:20.910: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006995, LATS 114265874, lastSeqNo 127006994, uniqueness 1469772618, timestamp 1498663099/3163780478
2017-06-28 19:18:21.526: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:21.912: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006996, LATS 114266874, lastSeqNo 127006995, uniqueness 1469772618, timestamp 1498663100/3163781478
2017-06-28 19:18:22.044: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:22.044: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:18:22.528: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:22.914: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006997, LATS 114267884, lastSeqNo 127006996, uniqueness 1469772618, timestamp 1498663101/3163782488
2017-06-28 19:18:23.530: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:23.916: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006998, LATS 114268884, lastSeqNo 127006997, uniqueness 1469772618, timestamp 1498663102/3163783488
2017-06-28 19:18:24.532: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:24.918: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127006999, LATS 114269884, lastSeqNo 127006998, uniqueness 1469772618, timestamp 1498663103/3163784488
2017-06-28 19:18:25.534: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:25.694: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:25.694: [    CSSD][1085458752]clssgmAllocProc: (0x191eb850) allocated
2017-06-28 19:18:25.694: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191eb850 - 1,2,3,4,5
2017-06-28 19:18:25.694: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5f0a) proc(0x191eb850) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:25.694: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:25.696: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191eb850
2017-06-28 19:18:25.696: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191eb850
2017-06-28 19:18:25.696: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191eb850), client(1/0x191e7aa0)
2017-06-28 19:18:25.696: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191e7aa0 with con 0x5f39, requested num -1, flags 0x4000e00
2017-06-28 19:18:25.696: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:25.696: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5f39
2017-06-28 19:18:25.697: [    CSSD][1085458752]clssgmDeadProc: proc 0x191eb850
2017-06-28 19:18:25.697: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191eb850) con(0x5f0a) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:25.697: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5f0a
2017-06-28 19:18:25.920: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007000, LATS 114270884, lastSeqNo 127006999, uniqueness 1469772618, timestamp 1498663104/3163785488
2017-06-28 19:18:26.022: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:18:26.022: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:18:26.022: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114270984) for my node
2017-06-28 19:18:26.022: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:18:26.022: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:18:26.022: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:18:26.052: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:26.053: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:18:26.536: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:26.922: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007001, LATS 114271884, lastSeqNo 127007000, uniqueness 1469772618, timestamp 1498663105/3163786498
2017-06-28 19:18:27.538: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:27.924: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007002, LATS 114272884, lastSeqNo 127007001, uniqueness 1469772618, timestamp 1498663106/3163787498
2017-06-28 19:18:28.540: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:28.926: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007003, LATS 114273894, lastSeqNo 127007002, uniqueness 1469772618, timestamp 1498663107/3163788498
2017-06-28 19:18:29.542: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:29.928: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007004, LATS 114274894, lastSeqNo 127007003, uniqueness 1469772618, timestamp 1498663108/3163789498
2017-06-28 19:18:30.060: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:30.061: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:18:30.544: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:30.702: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:30.702: [    CSSD][1085458752]clssgmAllocProc: (0x192996b0) allocated
2017-06-28 19:18:30.702: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x192996b0 - 1,2,3,4,5
2017-06-28 19:18:30.702: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x5fe0) proc(0x192996b0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:30.702: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:30.704: [    CSSD][1085458752]clssscSelect: cookie accept request 0x192996b0
2017-06-28 19:18:30.704: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x192996b0
2017-06-28 19:18:30.704: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x192996b0), client(1/0x19299820)
2017-06-28 19:18:30.704: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x19299820 with con 0x600f, requested num -1, flags 0x4000e00
2017-06-28 19:18:30.704: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:30.704: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x600f
2017-06-28 19:18:30.705: [    CSSD][1085458752]clssgmDeadProc: proc 0x192996b0
2017-06-28 19:18:30.705: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x192996b0) con(0x5fe0) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:30.705: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x5fe0
2017-06-28 19:18:30.930: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007005, LATS 114275894, lastSeqNo 127007004, uniqueness 1469772618, timestamp 1498663109/3163790508
2017-06-28 19:18:31.546: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:31.932: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007006, LATS 114276894, lastSeqNo 127007005, uniqueness 1469772618, timestamp 1498663110/3163791508
2017-06-28 19:18:32.549: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:32.934: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007007, LATS 114277894, lastSeqNo 127007006, uniqueness 1469772618, timestamp 1498663111/3163792508
2017-06-28 19:18:33.036: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:18:33.036: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:18:33.036: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114278004) for my node
2017-06-28 19:18:33.036: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:18:33.036: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:18:33.036: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:18:33.550: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:33.936: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007008, LATS 114278904, lastSeqNo 127007007, uniqueness 1469772618, timestamp 1498663113/3163793518
2017-06-28 19:18:34.069: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:34.069: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:18:34.553: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:34.938: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007009, LATS 114279904, lastSeqNo 127007008, uniqueness 1469772618, timestamp 1498663114/3163794518
2017-06-28 19:18:35.554: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:35.710: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:35.710: [    CSSD][1085458752]clssgmAllocProc: (0x191e1a70) allocated
2017-06-28 19:18:35.710: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191e1a70 - 1,2,3,4,5
2017-06-28 19:18:35.710: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x60a8) proc(0x191e1a70) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:35.710: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:35.712: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191e1a70
2017-06-28 19:18:35.712: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191e1a70
2017-06-28 19:18:35.712: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191e1a70), client(1/0x191e1c00)
2017-06-28 19:18:35.712: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191e1c00 with con 0x60d7, requested num -1, flags 0x4000e00
2017-06-28 19:18:35.712: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:35.712: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x60d7
2017-06-28 19:18:35.712: [    CSSD][1085458752]clssgmDeadProc: proc 0x191e1a70
2017-06-28 19:18:35.712: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191e1a70) con(0x60a8) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:35.712: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x60a8
2017-06-28 19:18:35.940: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007010, LATS 114280904, lastSeqNo 127007009, uniqueness 1469772618, timestamp 1498663115/3163795518
2017-06-28 19:18:36.557: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:36.943: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007011, LATS 114281904, lastSeqNo 127007010, uniqueness 1469772618, timestamp 1498663116/3163796518
2017-06-28 19:18:37.559: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:37.946: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007012, LATS 114282914, lastSeqNo 127007011, uniqueness 1469772618, timestamp 1498663117/3163797528
2017-06-28 19:18:38.561: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:38.948: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007013, LATS 114283914, lastSeqNo 127007012, uniqueness 1469772618, timestamp 1498663118/3163798528
2017-06-28 19:18:39.079: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:39.079: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:18:39.563: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:39.950: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007014, LATS 114284914, lastSeqNo 127007013, uniqueness 1469772618, timestamp 1498663119/3163799528
2017-06-28 19:18:40.050: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:18:40.050: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:18:40.050: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114285014) for my node
2017-06-28 19:18:40.050: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:18:40.050: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:18:40.050: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:18:40.565: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:40.718: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:40.718: [    CSSD][1085458752]clssgmAllocProc: (0x19298860) allocated
2017-06-28 19:18:40.719: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x19298860 - 1,2,3,4,5
2017-06-28 19:18:40.719: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x6170) proc(0x19298860) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:40.719: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:40.720: [    CSSD][1085458752]clssscSelect: cookie accept request 0x19298860
2017-06-28 19:18:40.720: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x19298860
2017-06-28 19:18:40.720: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x19298860), client(1/0x192989f0)
2017-06-28 19:18:40.720: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x192989f0 with con 0x619f, requested num -1, flags 0x4000e00
2017-06-28 19:18:40.721: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:40.721: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x619f
2017-06-28 19:18:40.721: [    CSSD][1085458752]clssgmDeadProc: proc 0x19298860
2017-06-28 19:18:40.721: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x19298860) con(0x6170) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:40.721: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x6170
2017-06-28 19:18:40.952: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007015, LATS 114285914, lastSeqNo 127007014, uniqueness 1469772618, timestamp 1498663120/3163800538
2017-06-28 19:18:41.567: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:41.955: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007016, LATS 114286914, lastSeqNo 127007015, uniqueness 1469772618, timestamp 1498663121/3163801538
2017-06-28 19:18:42.569: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:42.958: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007017, LATS 114287924, lastSeqNo 127007016, uniqueness 1469772618, timestamp 1498663122/3163802538
2017-06-28 19:18:43.571: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:43.960: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007018, LATS 114288924, lastSeqNo 127007017, uniqueness 1469772618, timestamp 1498663123/3163803538
2017-06-28 19:18:44.089: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:44.089: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:18:44.573: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:44.963: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007019, LATS 114289924, lastSeqNo 127007018, uniqueness 1469772618, timestamp 1498663124/3163804548
2017-06-28 19:18:45.575: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:45.727: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:45.727: [    CSSD][1085458752]clssgmAllocProc: (0x191b1f80) allocated
2017-06-28 19:18:45.728: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191b1f80 - 1,2,3,4,5
2017-06-28 19:18:45.728: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x6246) proc(0x191b1f80) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:45.728: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:45.729: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191b1f80
2017-06-28 19:18:45.729: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191b1f80
2017-06-28 19:18:45.729: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191b1f80), client(1/0x191d1c90)
2017-06-28 19:18:45.729: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191d1c90 with con 0x6275, requested num -1, flags 0x4000e00
2017-06-28 19:18:45.729: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:45.729: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x6275
2017-06-28 19:18:45.730: [    CSSD][1085458752]clssgmDeadProc: proc 0x191b1f80
2017-06-28 19:18:45.730: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191b1f80) con(0x6246) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:45.730: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x6246
2017-06-28 19:18:45.966: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007020, LATS 114290924, lastSeqNo 127007019, uniqueness 1469772618, timestamp 1498663125/3163805548
2017-06-28 19:18:46.577: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:46.969: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007021, LATS 114291934, lastSeqNo 127007020, uniqueness 1469772618, timestamp 1498663126/3163806548
2017-06-28 19:18:47.064: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:18:47.064: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:18:47.064: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114292024) for my node
2017-06-28 19:18:47.064: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:18:47.064: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:18:47.064: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:18:47.579: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:47.972: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007022, LATS 114292934, lastSeqNo 127007021, uniqueness 1469772618, timestamp 1498663127/3163807558
2017-06-28 19:18:48.581: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:48.975: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007023, LATS 114293934, lastSeqNo 127007022, uniqueness 1469772618, timestamp 1498663128/3163808558
2017-06-28 19:18:49.099: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:49.099: [    CSSD][1103608128]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:18:49.583: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:49.978: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007024, LATS 114294944, lastSeqNo 127007023, uniqueness 1469772618, timestamp 1498663129/3163809558
2017-06-28 19:18:50.585: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:50.735: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:50.735: [    CSSD][1085458752]clssgmAllocProc: (0x191d39b0) allocated
2017-06-28 19:18:50.736: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191d39b0 - 1,2,3,4,5
2017-06-28 19:18:50.736: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x630e) proc(0x191d39b0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:50.736: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:50.737: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191d39b0
2017-06-28 19:18:50.737: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191d39b0
2017-06-28 19:18:50.737: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191d39b0), client(1/0x191dc100)
2017-06-28 19:18:50.737: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191dc100 with con 0x633d, requested num -1, flags 0x4000e00
2017-06-28 19:18:50.737: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:50.737: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x633d
2017-06-28 19:18:50.738: [    CSSD][1085458752]clssgmDeadProc: proc 0x191d39b0
2017-06-28 19:18:50.738: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191d39b0) con(0x630e) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:50.738: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x630e
2017-06-28 19:18:50.981: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007025, LATS 114295944, lastSeqNo 127007024, uniqueness 1469772618, timestamp 1498663130/3163810558
2017-06-28 19:18:51.587: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:51.984: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007026, LATS 114296944, lastSeqNo 127007025, uniqueness 1469772618, timestamp 1498663131/3163811568
2017-06-28 19:18:52.589: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:52.987: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007027, LATS 114297944, lastSeqNo 127007026, uniqueness 1469772618, timestamp 1498663132/3163812568
2017-06-28 19:18:53.107: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:53.107: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:18:53.591: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:53.990: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007028, LATS 114298954, lastSeqNo 127007027, uniqueness 1469772618, timestamp 1498663133/3163813568
2017-06-28 19:18:54.078: [    CSSD][1105185088]clssnmRcfgMgrThread: Local Join
2017-06-28 19:18:54.078: [    CSSD][1105185088]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:18:54.078: [    CSSD][1105185088]clssnmLocalJoinEvent: set curtime (114299034) for my node
2017-06-28 19:18:54.078: [    CSSD][1105185088]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:18:54.078: [    CSSD][1105185088]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:18:54.078: [    CSSD][1105185088]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:18:54.593: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:54.993: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007029, LATS 114299954, lastSeqNo 127007028, uniqueness 1469772618, timestamp 1498663134/3163814578
2017-06-28 19:18:55.595: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:18:55.744: [    CSSD][1085458752]clssscSelect: cookie accept request 0x2aaaac029f80
2017-06-28 19:18:55.744: [    CSSD][1085458752]clssgmAllocProc: (0x191d39b0) allocated
2017-06-28 19:18:55.744: [    CSSD][1085458752]clssgmClientConnectMsg: properties of cmProc 0x191d39b0 - 1,2,3,4,5
2017-06-28 19:18:55.744: [    CSSD][1085458752]clssgmClientConnectMsg: Connect from con(0x63e4) proc(0x191d39b0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:18:55.744: [    CSSD][1085458752]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:18:55.746: [    CSSD][1085458752]clssscSelect: cookie accept request 0x191d39b0
2017-06-28 19:18:55.746: [    CSSD][1085458752]clssscevtypSHRCON: getting client with cmproc 0x191d39b0
2017-06-28 19:18:55.746: [    CSSD][1085458752]clssgmRegisterClient: proc(4/0x191d39b0), client(1/0x191d3b40)
2017-06-28 19:18:55.746: [    CSSD][1085458752]clssgmJoinGrock: global grock CRF- new client 0x191d3b40 with con 0x6413, requested num -1, flags 0x4000e00
2017-06-28 19:18:55.746: [    CSSD][1085458752]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:18:55.746: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x6413
2017-06-28 19:18:55.747: [    CSSD][1085458752]clssgmDeadProc: proc 0x191d39b0
2017-06-28 19:18:55.747: [    CSSD][1085458752]clssgmDestroyProc: cleaning up proc(0x191d39b0) con(0x63e4) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:18:55.747: [    CSSD][1085458752]clssgmDiscEndpcl: gipcDestroy 0x63e4
2017-06-28 19:18:55.996: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007030, LATS 114300954, lastSeqNo 127007029, uniqueness 1469772618, timestamp 1498663135/3163815578
2017-06-28 19:18:56.409: [    CSSD][1085458752]clssgmExecuteClientRequest: MAINT recvd from proc 2 (0x190b15f0)
2017-06-28 19:18:56.409: [    CSSD][1085458752]clssgmShutDown: Received abortive shutdown request from client.
2017-06-28 19:18:56.409: [    CSSD][1085458752]###################################
2017-06-28 19:18:56.409: [    CSSD][1085458752]clssscExit: CSSD aborting from thread GMClientListener
2017-06-28 19:18:56.409: [    CSSD][1085458752]###################################
2017-06-28 19:18:56.409: [    CSSD][1085458752](:CSSSC00012:)clssscExit: A fatal error occurred and the CSS daemon is terminating abnormally
2017-06-28 19:18:56.410: [    CSSD][1085458752]clssgmUpdateEventValue: CmInfo State  val 0, changes 1
2017-06-28 19:18:56.592: [    CSSD][1100454208]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 0 waited 820
2017-06-28 19:18:56.592: [    CSSD][1100454208]clssgmPeerListener: terminating at incarn(0)
2017-06-28 19:18:56.999: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007031, LATS 114301964, lastSeqNo 127007030, uniqueness 1469772618, timestamp 1498663136/3163816578
2017-06-28 19:18:57.084: [    CSSD][1102031168]clssnmPollingThread: state(1) clusterState(0) exit
2017-06-28 19:18:57.084: [    CSSD][1102031168]clssscExit: abort already set 0
2017-06-28 19:18:57.115: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:18:57.115: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:18:58.002: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007032, LATS 114302964, lastSeqNo 127007031, uniqueness 1469772618, timestamp 1498663137/3163817578
2017-06-28 19:18:59.005: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007033, LATS 114303964, lastSeqNo 127007032, uniqueness 1469772618, timestamp 1498663138/3163818588
2017-06-28 19:19:00.008: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007034, LATS 114304964, lastSeqNo 127007033, uniqueness 1469772618, timestamp 1498663139/3163819588
2017-06-28 19:19:01.011: [    CSSD][1097300288]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007035, LATS 114305974, lastSeqNo 127007034, uniqueness 1469772618, timestamp 1498663140/3163820588
2017-06-28 19:19:01.123: [    CSSD][1103608128]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:19:01.123: [    CSSD][1103608128]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:19:13.492: [    CSSD][144585600]clsu_load_ENV_levels: Module = CSSD, LogLevel = 2, TraceLevel = 0
2017-06-28 19:19:13.492: [    CSSD][144585600]clsu_load_ENV_levels: Module = GIPCNM, LogLevel = 2, TraceLevel = 0
2017-06-28 19:19:13.492: [    CSSD][144585600]clsu_load_ENV_levels: Module = GIPCGM, LogLevel = 2, TraceLevel = 0
2017-06-28 19:19:13.492: [    CSSD][144585600]clsu_load_ENV_levels: Module = GIPCCM, LogLevel = 2, TraceLevel = 0
2017-06-28 19:19:13.492: [    CSSD][144585600]clsu_load_ENV_levels: Module = CLSF, LogLevel = 0, TraceLevel = 0
2017-06-28 19:19:13.492: [    CSSD][144585600]clsu_load_ENV_levels: Module = SKGFD, LogLevel = 0, TraceLevel = 0
2017-06-28 19:19:13.492: [    CSSD][144585600]clsu_load_ENV_levels: Module = GPNP, LogLevel = 1, TraceLevel = 0
2017-06-28 19:19:13.492: [    CSSD][144585600]clsu_load_ENV_levels: Module = OLR, LogLevel = 0, TraceLevel = 0
[    CSSD][144585600]clsugetconf : Configuration type [4]. 
2017-06-28 19:19:13.492: [    CSSD][144585600]clssscmain: Starting CSS daemon, version 11.2.0.3.0, in (clustered) mode with uniqueness value 1498663153
2017-06-28 19:19:13.493: [    CSSD][144585600]clssscmain: Environment is production
2017-06-28 19:19:13.493: [    CSSD][144585600]clssscmain: Core file size limit extended
2017-06-28 19:19:13.498: [    CSSD][144585600]clssscmain: GIPCHA down 0
2017-06-28 19:19:13.500: [    CSSD][144585600]clssscGetParameterOLR: OLR fetch for parameter logsize (8) failed with rc 21
2017-06-28 19:19:13.500: [    CSSD][144585600]clssscExtendLimits: The current soft limit for file descriptors is 65536, hard limit is 65536
2017-06-28 19:19:13.500: [    CSSD][144585600]clssscExtendLimits: The current soft limit for locked memory is 4294967295, hard limit is 4294967295
2017-06-28 19:19:13.501: [    CSSD][144585600]clssscGetParameterOLR: OLR fetch for parameter priority (15) failed with rc 21
2017-06-28 19:19:13.501: [    CSSD][144585600]clssscSetPrivEnv: Setting priority to 4
2017-06-28 19:19:13.508: [    CSSD][144585600]clssscSetPrivEnv: Can't access local IPMI device--no device configured or driver missing/incompatible. IPMI support may be available with static IP configuration.
2017-06-28 19:19:13.513: [    CSSD][144585600]clssscmain: Running as user grid11g
2017-06-28 19:19:13.514: [    CSSD][144585600]clssscmain: RT queue setting is at default value
2017-06-28 19:19:13.515: [    CSSD][144585600]clssscGetParameterOLR: OLR fetch for parameter auth rep (9) failed with rc 21
[  clsdmt][1094138176]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=rhis-cr-0613-04DBG_CSSD))
2017-06-28 19:19:13.516: [  clsdmt][1094138176]PID for the Process [22003], connkey 4 
2017-06-28 19:19:13.516: [    CSSD][144585600]clssscGetParameterOLR: OLR fetch for parameter diagwait (14) failed with rc 21
2017-06-28 19:19:13.520: [    CSSD][144585600]clssnmInitNMInfoMin: Initializing first-reconfig to (0)
2017-06-28 19:19:13.520: [    CSSD][144585600]clssscmain: initgminfo done
2017-06-28 19:19:13.521: [    CSSD][1075976512]clssgmclientlsnr: Spawned
2017-06-28 19:19:13.521: [    CSSD][1075976512]clssgmEvtInformation: reqtype (13) cmProc ((nil)) client ((nil))
2017-06-28 19:19:13.521: [    CSSD][1075976512]clssgmEvtInformation: reqtype (13) req (0x1a189e00)
2017-06-28 19:19:13.521: [    CSSD][1075976512]clssnmQueueNotification: type (13) 0x1a189e00
2017-06-28 19:19:13.522: [    CSSD][1075976512]clssgmclientlsnr: listening on clsc://(ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rhis-cr-0613-04_)(GIPCID=00000000-00000000-22003))
2017-06-28 19:19:13.522: [    GPNP][144585600]clsgpnp_Init: [at clsgpnp0.c:585] '/oracle/grid11g/grid_infra/11.2.0' in effect as GPnP home base.
2017-06-28 19:19:13.522: [    GPNP][144585600]clsgpnp_Init: [at clsgpnp0.c:619] GPnP pid=22003, GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:ORA_DAEMON_LOGGING_LEVELS, apitl:0, complog:1, tstenv:0, devenv:0, envopt:0, flags=3
2017-06-28 19:19:13.531: [    GPNP][144585600]clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:399] Using FS Wallet Location : /oracle/grid11g/grid_infra/11.2.0/gpnp/rhis-cr-0613-04/wallets/peer/

[   CLWAL][144585600]clsw_Initialize: OLR initlevel [70000]
2017-06-28 19:19:13.565: [    GPNP][144585600]clsgpnp_profileCallUrlInt: [at clsgpnp.c:2104] get-profile call to url "ipc://GPNPD_rhis-cr-0613-04" disco "" [f=0 claimed- host: cname: seq: auth:] 
2017-06-28 19:19:13.578: [    GPNP][144585600]clsgpnp_profileCallUrlInt: [at clsgpnp.c:2234] Result: (0) CLSGPNP_OK. Successful get-profile CALL to remote "ipc://GPNPD_rhis-cr-0613-04" disco ""
2017-06-28 19:19:13.578: [    CSSD][144585600]clssscGetParameterProfile: profile fetch failed for parameter ocrid (4) with return code 5
2017-06-28 19:19:13.578: [    CSSD][144585600]clssscmain: OCRID is 0
2017-06-28 19:19:13.578: [    CSSD][144585600]clssscmain: Cluster GUID is 7950ca72a7195f5cbf305f8237eeb9b1
2017-06-28 19:19:13.578: [    CSSD][144585600]clssnmNotifyReq: type (12)
2017-06-28 19:19:13.580: [    CSSD][144585600]clssscmain: last used node number 2
2017-06-28 19:19:13.580: [    CSSD][144585600]clssnmReadDiscoveryProfile: voting file discovery string(/ORASYS1/vdisk/vdsk)
2017-06-28 19:19:13.580: [    CSSD][144585600]clssnkInit: NK generic layer initializing.
2017-06-28 19:19:13.582: [   SKGFD][1106819392]NOTE: No asm libraries found in the system

2017-06-28 19:19:13.582: [    CLSF][1106819392]Allocated CLSF context
2017-06-28 19:19:13.582: [    CSSD][1106819392]clssnmvDDiscThread: using discovery string /ORASYS1/vdisk/vdsk for initial discovery 
2017-06-28 19:19:13.583: [   SKGFD][1106819392]Discovery with str:/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:13.583: [   SKGFD][1106819392]UFS discovery with :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:13.583: [   SKGFD][1106819392]Fetching UFS disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:13.583: [   SKGFD][1106819392]OSS discovery with :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:13.583: [   SKGFD][1106819392]Handle 0x1a186540 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:13.595: [   SKGFD][1106819392]Lib :UFS:: closing handle 0x1a186540 for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:13.595: [    CSSD][1106819392]clssnmvDiskVerify: discovered a potential voting file
2017-06-28 19:19:13.595: [   SKGFD][1106819392]Handle 0x1a1860d0 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:13.596: [    CSSD][1106819392]clssnmvDiskVerify: Successful discovery for disk /ORASYS1/vdisk/vdsk, UID 87858103-c00f4f19-bf24fb10-8a4b4f9f, Pending CIN 0:1370949648:0, Committed CIN 0:1370949648:0
2017-06-28 19:19:13.604: [   SKGFD][1106819392]Lib :UFS:: closing handle 0x1a1860d0 for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:13.604: [    CSSD][1106819392]clssnmvDiskVerify: Successful discovery of 1 disks
2017-06-28 19:19:13.604: [    CSSD][1106819392]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
2017-06-28 19:19:13.604: [    CSSD][1106819392]clssnmCompleteVFDiscovery: Completing voting file discovery
2017-06-28 19:19:13.604: [    CSSD][1106819392]clssnmvDiskStateChange: state from discovered to pending disk /ORASYS1/vdisk/vdsk
2017-06-28 19:19:13.604: [    CSSD][1106819392]clssnmvDiskStateChange: state from pending to configured disk /ORASYS1/vdisk/vdsk
2017-06-28 19:19:13.604: [    CSSD][1106819392]clssnmCompleteVFDiscovery: Committed configuration for CIN 0:1370949648:0
2017-06-28 19:19:13.604: [    CSSD][1106819392]  misscount          30    reboot latency      3
2017-06-28 19:19:13.604: [    CSSD][1106819392]  long I/O timeout  200    short I/O timeout  27
2017-06-28 19:19:13.604: [    CSSD][1106819392]  diagnostic wait     0  active version 11.2.0.3.0
2017-06-28 19:19:13.604: [    CSSD][1106819392]  Listing unique IDs for 1 voting files:
2017-06-28 19:19:13.604: [    CSSD][1106819392]    voting file 1: 87858103-c00f4f19-bf24fb10-8a4b4f9f
2017-06-28 19:19:13.604: [    CSSD][144585600]clssnmOpenGIPCEndp: opening cluster listener on gipc://rhis-cr-0613-04:nm_crestel-scan
2017-06-28 19:19:13.605: [GIPCHGEN][144585600] gipchaInternalRegister: Initializing HA GIPC
2017-06-28 19:19:13.605: [GIPCHGEN][144585600] gipchaNodeCreate: adding new node 0x2aaaac1fb5e0 { host '', haName 'CSS_crestel-scan', srcLuid f92eeb87-00000000, dstLuid 00000000-00000000 numInf 0, contigSeq 0, lastAck 0, lastValidAck 0, sendSeq [0 : 0], createTime 114318564, sentRegister 0, localMonitor 0, flags 0x1 }
2017-06-28 19:19:13.605: [    GPNP][144585600]clsgpnp_Init: [at clsgpnp0.c:585] '/oracle/grid11g/grid_infra/11.2.0' in effect as GPnP home base.
2017-06-28 19:19:13.605: [    GPNP][144585600]clsgpnp_Init: [at clsgpnp0.c:619] GPnP pid=22003, GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:ORA_DAEMON_LOGGING_LEVELS, apitl:0, complog:1, tstenv:0, devenv:0, envopt:0, flags=0
2017-06-28 19:19:13.612: [    GIPC][144585600] gipcCheckInitialization: possible incompatible non-threaded init from [clsgpnp0.c : 769], original from [clsssc.c : 970]
2017-06-28 19:19:13.613: [    GPNP][144585600]clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:399] Using FS Wallet Location : /oracle/grid11g/grid_infra/11.2.0/gpnp/rhis-cr-0613-04/wallets/peer/

[   CLWAL][144585600]clsw_Initialize: OLR initlevel [30000]
2017-06-28 19:19:13.644: [    GPNP][144585600]clsgpnp_getCachedProfileEx: [at clsgpnp.c:613] Result: (26) CLSGPNP_NO_PROFILE. Can't get offline GPnP service profile: local gpnpd is up and running. Use getProfile instead.
2017-06-28 19:19:13.644: [    GPNP][144585600]clsgpnp_getCachedProfileEx: [at clsgpnp.c:623] Result: (26) CLSGPNP_NO_PROFILE. Failed to get offline GPnP service profile. 
2017-06-28 19:19:13.644: [    GPNP][144585600]clsgpnp_profileCallUrlInt: [at clsgpnp.c:2104] get-profile call to url "ipc://GPNPD_rhis-cr-0613-04" disco "" [f=1 claimed- host: cname: seq: auth:] 
2017-06-28 19:19:13.656: [    GPNP][144585600]clsgpnp_profileCallUrlInt: [at clsgpnp.c:2234] Result: (0) CLSGPNP_OK. Successful get-profile CALL to remote "ipc://GPNPD_rhis-cr-0613-04" disco ""
2017-06-28 19:19:13.656: [GIPCXCPT][144585600] gipchaInternalReadGpnp: No network info configured in GPNP, using defaults, ret gipcretFail (1)
2017-06-28 19:19:13.862: [GIPCHGEN][144585600] gipchaInternalReadGpnp: configuring default multicast addresses
2017-06-28 19:19:13.862: [GIPCHGEN][144585600] gipchaInternalReadGpnp: configuring default bootstrap communications modes
2017-06-28 19:19:13.862: [GIPCHGEN][144585600] gipchaInternalReadGpnp: configuring bootstrap communications using:  broadcast and multicast
2017-06-28 19:19:13.862: [GIPCHGEN][144585600] gipchaInternalReadGpnp: mcast address[  0 ]  224.0.0.251
2017-06-28 19:19:13.862: [GIPCHGEN][144585600] gipchaInternalReadGpnp: mcast address[  1 ]  230.0.1.0
2017-06-28 19:19:13.863: [GIPCHTHR][1102592320] gipchaWorkerThread: starting worker thread hctx 0x1a0e1390 [0000000000000010] { gipchaContext : host 'rhis-cr-0613-04', name 'CSS_crestel-scan', luid 'f92eeb87-00000000', numNode 0, numInf 0, usrFlags 0x0, flags 0x62 }
2017-06-28 19:19:13.864: [GIPCHDEM][1104169280] gipchaDaemonThread: starting daemon thread hctx 0x1a0e1390 [0000000000000010] { gipchaContext : host 'rhis-cr-0613-04', name 'CSS_crestel-scan', luid 'f92eeb87-00000000', numNode 0, numInf 0, usrFlags 0x0, flags 0x62 }
2017-06-28 19:19:13.864: [    GPNP][1104169280]clsgpnp_Init: [at clsgpnp0.c:585] '/oracle/grid11g/grid_infra/11.2.0' in effect as GPnP home base.
2017-06-28 19:19:13.864: [    GPNP][1104169280]clsgpnp_Init: [at clsgpnp0.c:619] GPnP pid=22003, GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:ORA_DAEMON_LOGGING_LEVELS, apitl:0, complog:1, tstenv:0, devenv:0, envopt:0, flags=0
2017-06-28 19:19:13.872: [    GIPC][1104169280] gipcCheckInitialization: possible incompatible non-threaded init from [clsgpnp0.c : 769], original from [clsssc.c : 970]
2017-06-28 19:19:13.873: [    GPNP][1104169280]clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:399] Using FS Wallet Location : /oracle/grid11g/grid_infra/11.2.0/gpnp/rhis-cr-0613-04/wallets/peer/

[   CLWAL][1104169280]clsw_Initialize: OLR initlevel [30000]
2017-06-28 19:19:13.904: [    GPNP][1104169280]clsgpnp_getCachedProfileEx: [at clsgpnp.c:613] Result: (26) CLSGPNP_NO_PROFILE. Can't get offline GPnP service profile: local gpnpd is up and running. Use getProfile instead.
2017-06-28 19:19:13.904: [    GPNP][1104169280]clsgpnp_getCachedProfileEx: [at clsgpnp.c:623] Result: (26) CLSGPNP_NO_PROFILE. Failed to get offline GPnP service profile. 
2017-06-28 19:19:13.905: [    GPNP][1104169280]clsgpnp_profileCallUrlInt: [at clsgpnp.c:2104] get-profile call to url "ipc://GPNPD_rhis-cr-0613-04" disco "" [f=1 claimed- host: cname: seq: auth:] 
2017-06-28 19:19:13.917: [    GPNP][1104169280]clsgpnp_profileCallUrlInt: [at clsgpnp.c:2234] Result: (0) CLSGPNP_OK. Successful get-profile CALL to remote "ipc://GPNPD_rhis-cr-0613-04" disco ""
2017-06-28 19:19:13.917: [ GIPCLIB][1104169280] gipclibGetClusterGuid: retrieved cluster guid 7950ca72a7195f5cbf305f8237eeb9b1
2017-06-28 19:19:13.979: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:13.979: [    CSSD][1075976512]clssgmAllocProc: (0x1a2d67f0) allocated
2017-06-28 19:19:13.979: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x1a2d67f0 - 1,2,3,4,5
2017-06-28 19:19:13.979: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x200) proc(0x1a2d67f0) pid(21966) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:13.979: [    CSSD][1075976512]clssgmClientConnectMsg: The CSSD monitor is process (0x1a2d67f0), number 1
2017-06-28 19:19:13.982: [    CSSD][1075976512]clssgmEvtInformation: reqtype (11) cmProc (0x1a2d67f0) client ((nil))
2017-06-28 19:19:13.982: [    CSSD][1075976512]clssgmEvtInformation: reqtype (11) req (0x1a2d60b0)
2017-06-28 19:19:13.982: [    CSSD][1075976512]clssnmQueueNotification: type (11) 0x1a2d60b0
2017-06-28 19:19:14.125: [    GPNP][1104169280] clsgpnp_Init: [at clsgpnp0.c:585] '/oracle/grid11g/grid_infra/11.2.0' in effect as GPnP home base.
2017-06-28 19:19:14.125: [    GPNP][1104169280] clsgpnp_Init: [at clsgpnp0.c:619] GPnP pid=22003, GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:ORA_DAEMON_LOGGING_LEVELS, apitl:0, complog:1, tstenv:0, devenv:0, envopt:0, flags=2003
2017-06-28 19:19:14.134: [    GPNP][1104169280] clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:399] Using FS Wallet Location : /oracle/grid11g/grid_infra/11.2.0/gpnp/rhis-cr-0613-04/wallets/peer/

[   CLWAL][1104169280]clsw_Initialize: OLR initlevel [70000]
2017-06-28 19:19:14.167: [    GPNP][1104169280] clsgpnp_profileCallUrlInt: [at clsgpnp.c:2104] get-profile call to url "ipc://GPNPD_rhis-cr-0613-04" disco "" [f=3 claimed- host: cname: seq: auth:] 
2017-06-28 19:19:14.179: [    GPNP][1104169280] clsgpnp_profileCallUrlInt: [at clsgpnp.c:2234] Result: (0) CLSGPNP_OK. Successful get-profile CALL to remote "ipc://GPNPD_rhis-cr-0613-04" disco ""
2017-06-28 19:19:14.179: [ CLSINET][1104169280] Returning NETDATA: 1 interfaces
2017-06-28 19:19:14.179: [ CLSINET][1104169280] # 0 Interface 'eth3',ip='192.168.124.61',mac='00-17-a4-77-01-02',mask='255.255.255.0',net='192.168.124.0',use='cluster_interconnect'
2017-06-28 19:19:14.180: [GIPCHGEN][1104169280] gipchaNodeAddInterface: adding interface information for inf 0x1a485e50 { host '', haName 'CSS_crestel-scan', local (nil), ip '192.168.124.61', subnet '192.168.124.0', mask '255.255.255.0', mac '00-17-a4-77-01-02', ifname 'eth3', numRef 0, numFail 0, idxBoot 0, flags 0x1841 }
2017-06-28 19:19:14.180: [GIPCHTHR][1102592320] gipchaWorkerCreateInterface: created local interface for node 'rhis-cr-0613-04', haName 'CSS_crestel-scan', inf 'udp://192.168.124.61:27270'
2017-06-28 19:19:14.181: [GIPCHTHR][1102592320] gipchaWorkerCreateInterface: created local bootstrap multicast interface for node 'rhis-cr-0613-04', haName 'CSS_crestel-scan', inf 'mcast://224.0.0.251:42424/192.168.124.61'
2017-06-28 19:19:14.181: [GIPCHTHR][1102592320] gipchaWorkerCreateInterface: created local bootstrap multicast interface for node 'rhis-cr-0613-04', haName 'CSS_crestel-scan', inf 'mcast://230.0.1.0:42424/192.168.124.61'
2017-06-28 19:19:14.181: [GIPCHTHR][1102592320] gipchaWorkerCreateInterface: created local bootstrap broadcast interface for node 'rhis-cr-0613-04', haName 'CSS_crestel-scan', inf 'udp://192.168.124.255:42424'
2017-06-28 19:19:14.181: [    CSSD][144585600]clssnmOpenGIPCEndp: listening on gipcha://rhis-cr-0613-04:nm2_crestel-scan
2017-06-28 19:19:14.183: [   SKGFD][144585600]NOTE: No asm libraries found in the system

2017-06-28 19:19:14.183: [    CLSF][144585600]Allocated CLSF context
2017-06-28 19:19:14.183: [   SKGFD][144585600]Handle 0x2aaab01028c0 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:14.184: [    CSSD][144585600]clssnmlalloccx:phyname rhis-cr-0613-04
2017-06-28 19:19:14.185: [    CSSD][144585600]clssnmvDiskAvailabilityChange: voting file /ORASYS1/vdisk/vdsk now online
2017-06-28 19:19:14.185: [    CSSD][144585600]clssnmlgetfileslot: found expired slot 2 for host rhis-cr-0613-04 leasename rhis-cr-0613-04
2017-06-28 19:19:14.186: [   SKGFD][1097746752]NOTE: No asm libraries found in the system

2017-06-28 19:19:14.186: [    CLSF][1097746752]Allocated CLSF context
2017-06-28 19:19:14.187: [   SKGFD][1097746752]Handle 0x1a4836e0 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:14.197: [   SKGFD][1097746752]Lib :UFS:: closing handle 0x1a4836e0 for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:14.236: [GIPCHGEN][1104169280] gipchaNodeAddInterface: updating interface information for host '', haName 'CSS_crestel-scan', oldIp '192.168.124.61', newIp '192.168.124.61:27270'
2017-06-28 19:19:14.471: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:14.471: [    CSSD][1075976512]clssgmAllocProc: (0x1a221110) allocated
2017-06-28 19:19:14.471: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x1a221110 - 1,2,3,4,5
2017-06-28 19:19:14.471: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x362) proc(0x1a221110) pid(21991) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:14.471: [    CSSD][1075976512]clssgmClientConnectMsg: The CSSD agent is process (0x1a221110), number 2
2017-06-28 19:19:14.474: [    CSSD][1075976512]clssgmEvtInformation: reqtype (11) cmProc (0x1a221110) client ((nil))
2017-06-28 19:19:14.474: [    CSSD][1075976512]clssgmEvtInformation: reqtype (11) req (0x1a2c1bb0)
2017-06-28 19:19:14.474: [    CSSD][1075976512]clssnmQueueNotification: type (11) 0x1a2c1bb0
2017-06-28 19:19:15.189: [   SKGFD][1097746752]NOTE: No asm libraries found in the system

2017-06-28 19:19:15.189: [    CLSF][1097746752]Allocated CLSF context
2017-06-28 19:19:15.189: [   SKGFD][1097746752]Handle 0x1a51ee70 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:15.199: [   SKGFD][1097746752]Lib :UFS:: closing handle 0x1a51ee70 for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:16.192: [   SKGFD][1097746752]NOTE: No asm libraries found in the system

2017-06-28 19:19:16.192: [    CLSF][1097746752]Allocated CLSF context
2017-06-28 19:19:16.192: [   SKGFD][1097746752]Handle 0x1a51ee70 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:16.203: [   SKGFD][1097746752]Lib :UFS:: closing handle 0x1a51ee70 for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:16.730: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:16.730: [    CSSD][1075976512]clssgmAllocProc: (0x1a582440) allocated
2017-06-28 19:19:16.732: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x1a582440 - 1,2,3,4,5
2017-06-28 19:19:16.732: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x3bd) proc(0x1a582440) pid(21467) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:16.732: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:16.732: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:16.732: [    CSSD][1075976512]clssgmAllocProc: (0x1a2d9080) allocated
2017-06-28 19:19:16.732: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x1a2d9080 - 1,2,3,4,5
2017-06-28 19:19:16.732: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x40a) proc(0x1a2d9080) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:16.732: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:16.733: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a2d9080
2017-06-28 19:19:16.733: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x1a2d9080
2017-06-28 19:19:16.733: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x1a2d9080), client(1/0x1a221280)
2017-06-28 19:19:16.734: [    CSSD][1075976512]clssgmExecuteClientRequest(): type(6) size(684) only connect and exit messages are allowed before lease acquisition proc(0x1a2d9080) client(0x1a221280)
2017-06-28 19:19:16.734: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x432
2017-06-28 19:19:17.195: [   SKGFD][1097746752]NOTE: No asm libraries found in the system

2017-06-28 19:19:17.195: [    CLSF][1097746752]Allocated CLSF context
2017-06-28 19:19:17.195: [   SKGFD][1097746752]Handle 0x1a4b71a0 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:17.204: [   SKGFD][1097746752]Lib :UFS:: closing handle 0x1a4b71a0 for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:17.736: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a2d9080
2017-06-28 19:19:17.736: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x1a2d9080
2017-06-28 19:19:17.736: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x1a2d9080), client(2/0x1a2d9be0)
2017-06-28 19:19:17.736: [    CSSD][1075976512]clssgmExecuteClientRequest(): type(6) size(684) only connect and exit messages are allowed before lease acquisition proc(0x1a2d9080) client(0x1a2d9be0)
2017-06-28 19:19:17.736: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x448
2017-06-28 19:19:18.197: [   SKGFD][1097746752]NOTE: No asm libraries found in the system

2017-06-28 19:19:18.197: [    CLSF][1097746752]Allocated CLSF context
2017-06-28 19:19:18.197: [   SKGFD][1097746752]Handle 0x1a50aa70 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:18.206: [   SKGFD][1097746752]Lib :UFS:: closing handle 0x1a50aa70 for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:18.738: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a2d9080
2017-06-28 19:19:18.738: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x1a2d9080
2017-06-28 19:19:18.738: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x1a2d9080), client(3/0x1a5819c0)
2017-06-28 19:19:18.738: [    CSSD][1075976512]clssgmExecuteClientRequest(): type(6) size(684) only connect and exit messages are allowed before lease acquisition proc(0x1a2d9080) client(0x1a5819c0)
2017-06-28 19:19:18.738: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x45e
2017-06-28 19:19:18.839: [    CSSD][1075976512]clssgmExecuteClientRequest(): type(37) size(80) only connect and exit messages are allowed before lease acquisition proc(0x1a582440) client((nil))
2017-06-28 19:19:18.839: [    CSSD][1075976512]clssgmDeadProc: proc 0x1a582440
2017-06-28 19:19:18.839: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x1a582440) con(0x3bd) skgpid  ospid 21467 with 0 clients, refcount 0
2017-06-28 19:19:18.840: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x3bd
2017-06-28 19:19:19.194: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:19.194: [    CSSD][1075976512]clssgmAllocProc: (0x1a480920) allocated
2017-06-28 19:19:19.194: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x1a480920 - 1,2,3,4,5
2017-06-28 19:19:19.194: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x4b1) proc(0x1a480920) pid(21467) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:19.194: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:19.198: [    CSSD][144585600]clssnmlfmtlease: uniqueness 1498663153, gipc addr gipcha://rhis-cr-0613-04:nm2_crestel-scan
2017-06-28 19:19:19.198: [    CSSD][144585600]clssnmvStatusBlkInit: myinfo nodename rhis-cr-0613-04, uniqueness 1498663153
2017-06-28 19:19:19.202: [    CSSD][144585600]clssnmlgetslot:lease acquisition for node rhis-cr-0613-04/slot 2 completed in 5010 msecs
2017-06-28 19:19:19.203: [    CSSD][144585600]clssnmvDHBValidateNCopy: node 1, , has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007053, LATS 114324164, lastSeqNo 0, uniqueness 1469772618, timestamp 1498663158/3163838628
2017-06-28 19:19:19.203: [    CSSD][144585600]clssnmvDHBValidateNCopy: node 2, , has a disk HB, but no network HB, DHB has rcfg 266426550, wrtcnt, 123541836, LATS 114324164, lastSeqNo 0, uniqueness 1498663153, timestamp 1498663141/114305974
2017-06-28 19:19:19.220: [   SKGFD][144585600]Lib :UFS:: closing handle 0x2aaab01028c0 for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:19.220: [    CSSD][144585600]clssnmInitNodeDB: Initializing with OCR id 0
2017-06-28 19:19:19.740: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a2d9080
2017-06-28 19:19:19.740: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x1a2d9080
2017-06-28 19:19:19.740: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x1a2d9080), client(4/0x1a5819c0)
2017-06-28 19:19:19.740: [    CSSD][1075976512]clssgmExecuteClientRequest(): type(6) size(684) only connect and exit messages are allowed before lease acquisition proc(0x1a2d9080) client(0x1a5819c0)
2017-06-28 19:19:19.740: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x4eb
2017-06-28 19:19:20.221: [    CSSD][1097746752]clssnm_skgxnmon: Compatible vendor clusterware not in use
2017-06-28 19:19:20.221: [    CSSD][144585600]clssnmNotifyReq: type (20)
2017-06-28 19:19:20.221: [    CSSD][144585600]clssnmReadNodeInfo: dynamic endp HA gipcha://rhis-cr-0613-03:nm2_crestel-scan len 41 ver 11.2.0.3.0
2017-06-28 19:19:20.221: [    CSSD][144585600]clssnmReadNodeInfo: NM endp for node 1 (rhis-cr-0613-03) - gipcha://rhis-cr-0613-03:nm2_crestel-scan
2017-06-28 19:19:20.221: [    CSSD][144585600]clssnmReadNodeInfo: added node 1 (rhis-cr-0613-03) to cluster, lease uniqueness 1469772618
2017-06-28 19:19:20.221: [    CSSD][144585600]clssnmReadNodeInfo: dynamic endp HA gipcha://rhis-cr-0613-04:nm2_crestel-scan len 41 ver 11.2.0.3.0
2017-06-28 19:19:20.223: [    GPNP][144585600] clsgpnp_Init: [at clsgpnp0.c:585] '/oracle/grid11g/grid_infra/11.2.0' in effect as GPnP home base.
2017-06-28 19:19:20.223: [    GPNP][144585600] clsgpnp_Init: [at clsgpnp0.c:619] GPnP pid=22003, GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:ORA_DAEMON_LOGGING_LEVELS, apitl:0, complog:1, tstenv:0, devenv:0, envopt:0, flags=2003
2017-06-28 19:19:20.232: [    GPNP][144585600] clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:399] Using FS Wallet Location : /oracle/grid11g/grid_infra/11.2.0/gpnp/rhis-cr-0613-04/wallets/peer/

[   CLWAL][144585600]clsw_Initialize: OLR initlevel [70000]
2017-06-28 19:19:20.265: [    GPNP][144585600] clsgpnp_profileCallUrlInt: [at clsgpnp.c:2104] get-profile call to url "ipc://GPNPD_rhis-cr-0613-04" disco "" [f=3 claimed- host: cname: seq: auth:] 
2017-06-28 19:19:20.278: [    GPNP][144585600] clsgpnp_profileCallUrlInt: [at clsgpnp.c:2234] Result: (0) CLSGPNP_OK. Successful get-profile CALL to remote "ipc://GPNPD_rhis-cr-0613-04" disco ""
2017-06-28 19:19:20.482: [    CSSD][144585600]clssnmReadNodeInfo: NM endp for node 2 (rhis-cr-0613-04) - gipcha://rhis-cr-0613-04:nm2_crestel-scan
2017-06-28 19:19:20.482: [    CSSD][144585600]clssnmReadNodeInfo: added node 2 (rhis-cr-0613-04) to cluster, lease uniqueness 1498663153
2017-06-28 19:19:20.482: [    CSSD][144585600][INFO]clssnmInitNodeDB: no vendor clusterware, IPMI allowed
[   CLWAL][144585600]clsw_Initialize: OLR initlevel [70000]
2017-06-28 19:19:20.491: [    CSSD][144585600]clssnmReadWallet: OpenWallet: CLSW-9: The cluster wallet to be operated on does not exist., returned 9
2017-06-28 19:19:20.491: [    CSSD][144585600]clssnmSetupCookie: clssnmReadWallet fails - Node not configured for NodeKill
2017-06-28 19:19:20.491: [    CSSD][144585600]clssnmInitNodeDB: failure 1 reading node kill 
2017-06-28 19:19:20.492: [   SKGFD][144585600]NOTE: No asm libraries found in the system

2017-06-28 19:19:20.492: [    CLSF][144585600]Allocated CLSF context
2017-06-28 19:19:20.492: [    CSSD][144585600]clssnmvDiskOpen: Opening /ORASYS1/vdisk/vdsk
2017-06-28 19:19:20.492: [   SKGFD][144585600]Handle 0x2aaab0121090 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:20.493: [    CSSD][144585600]clssnmvStatusBlkInit: myinfo nodename rhis-cr-0613-04, uniqueness 1498663153
2017-06-28 19:19:20.501: [   SKGFD][144585600]Lib :UFS:: closing handle 0x2aaab0121090 for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:20.502: [    CSSD][1089001792]clssnmvWorkerThread: spawned for disk /ORASYS1/vdisk/vdsk
2017-06-28 19:19:20.503: [    CSSD][144585600]clssscmain: clssnmvInit completed for node rhis-cr-0613-04, number 2, in cluster crestel-scan
2017-06-28 19:19:20.504: [    CSSD][1081014592]clssgmDeathChkThread: Spawned
2017-06-28 19:19:20.504: [    CSSD][144585600]clssnmNotifyReq: type (11)
2017-06-28 19:19:20.504: [    CSSD][144585600]clssnmNotifyReq: found 1 for type (11) 0x1a2d60b0
2017-06-28 19:19:20.504: [    CSSD][144585600]clssnmCompleteGMReq: Completed request type 11 with status 1
2017-06-28 19:19:20.504: [    CSSD][144585600]clssgmDoneQEle: re-queueing req 0x1a2c1d70 status 1
2017-06-28 19:19:20.504: [    CSSD][144585600]clssnmNotifyReq: found 1 for type (11) 0x1a2c1bb0
2017-06-28 19:19:20.504: [    CSSD][144585600]clssnmCompleteGMReq: Completed request type 11 with status 1
2017-06-28 19:19:20.504: [    CSSD][144585600]clssgmDoneQEle: re-queueing req 0x1a2d6960 status 1
2017-06-28 19:19:20.504: [    CSSD][144585600]clssnmNotifyReq: type (13)
2017-06-28 19:19:20.504: [    CSSD][144585600]clssnmNotifyReq: found 1 for type (13) 0x1a189e00
2017-06-28 19:19:20.504: [    CSSD][144585600]clssnmCompleteGMReq: Completed request type 13 with status 1
2017-06-28 19:19:20.504: [    CSSD][1075976512]clssgmCheckReqNMCompletion: Completing request type 11 for proc (0x1a221110), operation status 1, client status 0
2017-06-28 19:19:20.504: [    CSSD][144585600]clssgmDoneQEle: re-queueing req 0x1a133e80 status 1
2017-06-28 19:19:20.505: [   SKGFD][1097746752]NOTE: No asm libraries found in the system

2017-06-28 19:19:20.505: [    CLSF][1097746752]Allocated CLSF context
2017-06-28 19:19:20.505: [    CSSD][1097746752]clssnmvDiskPingThread: spawned for disk /ORASYS1/vdisk/vdsk
2017-06-28 19:19:20.505: [   SKGFD][1097746752]Handle 0x2aaaac25b730 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:20.505: [    CSSD][1085192512]clssgmPeerListener: Spawned for node
2017-06-28 19:19:20.505: [   SKGFD][1089001792]NOTE: No asm libraries found in the system

2017-06-28 19:19:20.505: [    CLSF][1089001792]Allocated CLSF context
2017-06-28 19:19:20.505: [    CSSD][1075976512]clssgmclientOpenEndp: listening on clsc://(ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLstnr_crestel-scan_2)(GIPCID=00000000-00000000-22003))
2017-06-28 19:19:20.505: [    CSSD][1085192512]clssgmPeerListener: physical hostname rhis-cr-0613-04 privname 192.168.124.61
2017-06-28 19:19:20.505: [    CSSD][1085192512]clssgmPeerListener: gipc addr gipc://rhis-cr-0613-04:gm_crestel-scan
2017-06-28 19:19:20.505: [   SKGFD][1089001792]Handle 0x2aaab00f0030 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:20.505: [    CSSD][1085192512]clssgmPeerListener: gipc addr gipcha://rhis-cr-0613-04:gm2_crestel-scan
2017-06-28 19:19:20.505: [   SKGFD][1083615552]NOTE: No asm libraries found in the system

2017-06-28 19:19:20.506: [    CLSF][1083615552]Allocated CLSF context
2017-06-28 19:19:20.506: [    CSSD][1083615552]clssnmvKillBlockThread: spawned for disk /ORASYS1/vdisk/vdsk initial sleep interval (1000)ms
2017-06-28 19:19:20.506: [   SKGFD][1083615552]Handle 0x2aaab01a4360 from lib :UFS:: for disk :/ORASYS1/vdisk/vdsk:

2017-06-28 19:19:20.506: [    CSSD][1089001792]clssnmvDHBValidateNcopy: Saving DHB uniqueness of 1469772618 for node rhis-cr-0613-03, number 1
2017-06-28 19:19:20.506: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007054, LATS 114325464, lastSeqNo 127007053, uniqueness 1469772618, timestamp 1498663159/3163839628
2017-06-28 19:19:20.506: [    CSSD][1075976512]clssgmclientOpenEndp: listening on clsc://(ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rhis-cr-0613-04_crestel-scan)(GIPCID=00000000-00000000-22003))
2017-06-28 19:19:20.506: [    CSSD][1075976512]clssgmCheckReqNMCompletion: Completing request type 11 for proc (0x1a2d67f0), operation status 1, client status 0
2017-06-28 19:19:20.507: [    CSSD][1085192512]clssgmPeerListener: listening on  gipcha://rhis-cr-0613-04:gm2_crestel-scan
2017-06-28 19:19:20.508: [    CSSD][1099323712]clssnmPollingThread: Spawned, poll interval 1000
2017-06-28 19:19:20.508: [    CSSD][1100900672]clssnmSendingThread: Spawned
2017-06-28 19:19:20.509: [    CSSD][1108396352]clssnmRcfgMgrThread: Spawned
2017-06-28 19:19:20.509: [    CSSD][1075976512]clssgmEvtInformation: reqtype (22) cmProc (0x1a221110) client ((nil))
2017-06-28 19:19:20.509: [    CSSD][1075976512]clssgmEvtInformation: reqtype (22) req (0x1a21d600)
2017-06-28 19:19:20.509: [    CSSD][1075976512]clssnmQueueNotification: type (22) 0x1a21d600
2017-06-28 19:19:20.510: [    CSSD][1075976512]clssgmEvtInformation: reqtype (22) cmProc (0x1a2d67f0) client ((nil))
2017-06-28 19:19:20.510: [    CSSD][1075976512]clssgmEvtInformation: reqtype (22) req (0x1a2d1e50)
2017-06-28 19:19:20.510: [    CSSD][1075976512]clssnmQueueNotification: type (22) 0x1a2d1e50
2017-06-28 19:19:20.510: [    CSSD][1109973312]clssnmClusterListener: Spawned
2017-06-28 19:19:20.742: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a2d9080
2017-06-28 19:19:20.742: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x1a2d9080
2017-06-28 19:19:20.742: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x1a2d9080), client(5/0x2aaab8044b90)
2017-06-28 19:19:20.742: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab8044b90 with con 0x643, requested num -1, flags 0x4000e00
2017-06-28 19:19:20.742: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:19:20.742: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x643
2017-06-28 19:19:20.743: [    CSSD][1075976512]clssgmDeadProc: proc 0x1a2d9080
2017-06-28 19:19:20.743: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x1a2d9080) con(0x40a) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:19:20.743: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x40a
2017-06-28 19:19:21.508: [    CSSD][1089001792]clssnmvDHBValidateNcopy: Setting LATS valid due to second DHB seen for node rhis-cr-0613-03, number 1
2017-06-28 19:19:21.508: [    CSSD][1089001792]clssnmvDHBValidateNcopy: Copying unique 1469772618 to node structure for node rhis-cr-0613-03, number 1; previous unique value was 0
2017-06-28 19:19:21.508: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007055, LATS 114326464, lastSeqNo 127007054, uniqueness 1469772618, timestamp 1498663160/3163840628
2017-06-28 19:19:21.508: [    CSSD][1109973312]clssnmconnect: connecting to addr gipcha://rhis-cr-0613-03:nm2_crestel-scan
2017-06-28 19:19:21.509: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:21.509: [    CSSD][1109973312]clssscConnect: endp 0x65d - cookie 0x2aaaac077810 - addr gipcha://rhis-cr-0613-03:nm2_crestel-scan
2017-06-28 19:19:21.509: [    CSSD][1109973312]clssnmconnect: connecting to node(1), endp(0x65d), flags 0x10002
2017-06-28 19:19:21.509: [GIPCHGEN][1102592320] gipchaNodeCreate: adding new node 0x2aaaac012e10 { host 'rhis-cr-0613-03', haName 'CSS_crestel-scan', srcLuid f92eeb87-8db6f75e, dstLuid 00000000-00000000 numInf 0, contigSeq 0, lastAck 0, lastValidAck 0, sendSeq [0 : 0], createTime 114326464, sentRegister 0, localMonitor 0, flags 0x0 }
2017-06-28 19:19:21.510: [GIPCHALO][1102592320] gipchaLowerSend: deffering startup of hdr 0x2aaaac1f9f28 { len 232, seq 0, type gipchaHdrTypeSend (1), lastSeq 0, lastAck 0, minAck 0, flags 0x0, srcLuid 00000000-00000000, dstLuid 00000000-00000000, msgId 0 }, node 0x2aaaac012e10 { host 'rhis-cr-0613-03', haName 'CSS_crestel-scan', srcLuid f92eeb87-8db6f75e, dstLuid 00000000-00000000 numInf 0, contigSeq 0, lastAck 0, lastValidAck 0, sendSeq [0 : 0], createTime 114326464, sentRegister 0, localMonitor 0, flags 0x0 }
2017-06-28 19:19:21.510: [GIPCHALO][1102592320] gipchaLowerProcessNode: no valid interfaces found to node for 114326464 ms, node 0x2aaaac012e10 { host 'rhis-cr-0613-03', haName 'CSS_crestel-scan', srcLuid f92eeb87-8db6f75e, dstLuid 00000000-00000000 numInf 0, contigSeq 0, lastAck 0, lastValidAck 0, sendSeq [0 : 0], createTime 114326464, sentRegister 0, localMonitor 0, flags 0x4 }
2017-06-28 19:19:22.510: [GIPCHGEN][1102592320] gipchaNodeAddInterface: adding interface information for inf 0x2aaaac1f9890 { host 'rhis-cr-0613-03', haName 'CSS_crestel-scan', local (nil), ip '192.168.124.61', subnet '192.168.124.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1842 }
2017-06-28 19:19:22.510: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007056, LATS 114327464, lastSeqNo 127007055, uniqueness 1469772618, timestamp 1498663161/3163841628
2017-06-28 19:19:22.510: [GIPCHTHR][1102592320] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rhis-cr-0613-03', haName 'CSS_crestel-scan', inf 'mcast://224.0.0.251:42424/192.168.124.61'
2017-06-28 19:19:22.510: [GIPCHTHR][1102592320] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rhis-cr-0613-03', haName 'CSS_crestel-scan', inf 'mcast://230.0.1.0:42424/192.168.124.61'
2017-06-28 19:19:22.510: [GIPCHTHR][1102592320] gipchaWorkerCreateInterface: created remote bootstrap broadcast interface for node 'rhis-cr-0613-03', haName 'CSS_crestel-scan', inf 'udp://192.168.124.255:42424'
2017-06-28 19:19:22.510: [GIPCHGEN][1102592320] gipchaWorkerAttachInterface: Interface attached inf 0x2aaaac1f9890 { host 'rhis-cr-0613-03', haName 'CSS_crestel-scan', local 0x1a485e50, ip '192.168.124.61', subnet '192.168.124.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2017-06-28 19:19:22.511: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:23.512: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007057, LATS 114328474, lastSeqNo 127007056, uniqueness 1469772618, timestamp 1498663162/3163842638
2017-06-28 19:19:23.513: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:24.514: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007058, LATS 114329474, lastSeqNo 127007057, uniqueness 1469772618, timestamp 1498663163/3163843638
2017-06-28 19:19:24.515: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:25.516: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007059, LATS 114330474, lastSeqNo 127007058, uniqueness 1469772618, timestamp 1498663164/3163844638
2017-06-28 19:19:25.517: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:25.749: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:25.749: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01ec700) allocated
2017-06-28 19:19:25.749: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01ec700 - 1,2,3,4,5
2017-06-28 19:19:25.749: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x6f8) proc(0x2aaab01ec700) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:25.749: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:25.750: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01ec700
2017-06-28 19:19:25.751: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01ec700
2017-06-28 19:19:25.751: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01ec700), client(1/0x2aaab026f670)
2017-06-28 19:19:25.751: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab026f670 with con 0x727, requested num -1, flags 0x4000e00
2017-06-28 19:19:25.751: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:19:25.751: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x727
2017-06-28 19:19:25.751: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01ec700
2017-06-28 19:19:25.751: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01ec700) con(0x6f8) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:19:25.752: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x6f8
2017-06-28 19:19:26.019: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:19:26.019: [    CSSD][1100900672]clssnmSendingThread: sent 6 join msgs to all nodes
2017-06-28 19:19:26.518: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007060, LATS 114331474, lastSeqNo 127007059, uniqueness 1469772618, timestamp 1498663165/3163845648
2017-06-28 19:19:26.519: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:27.520: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007061, LATS 114332474, lastSeqNo 127007060, uniqueness 1469772618, timestamp 1498663166/3163846648
2017-06-28 19:19:27.521: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:28.023: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:19:28.023: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:19:28.023: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114332984) for my node
2017-06-28 19:19:28.023: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:19:28.023: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:19:28.024: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:19:28.522: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007062, LATS 114333474, lastSeqNo 127007061, uniqueness 1469772618, timestamp 1498663167/3163847648
2017-06-28 19:19:28.523: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:29.524: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007063, LATS 114334484, lastSeqNo 127007062, uniqueness 1469772618, timestamp 1498663168/3163848648
2017-06-28 19:19:29.525: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:30.027: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:19:30.027: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:19:30.526: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007064, LATS 114335484, lastSeqNo 127007063, uniqueness 1469772618, timestamp 1498663169/3163849648
2017-06-28 19:19:30.527: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:30.757: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:30.757: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e7560) allocated
2017-06-28 19:19:30.757: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e7560 - 1,2,3,4,5
2017-06-28 19:19:30.757: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x7c0) proc(0x2aaab01e7560) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:30.757: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:30.758: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e7560
2017-06-28 19:19:30.758: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e7560
2017-06-28 19:19:30.758: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e7560), client(1/0x2aaab01e76d0)
2017-06-28 19:19:30.759: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01e76d0 with con 0x7ef, requested num -1, flags 0x4000e00
2017-06-28 19:19:30.759: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:19:30.759: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x7ef
2017-06-28 19:19:30.759: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e7560
2017-06-28 19:19:30.759: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e7560) con(0x7c0) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:19:30.759: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x7c0
2017-06-28 19:19:31.528: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007065, LATS 114336484, lastSeqNo 127007064, uniqueness 1469772618, timestamp 1498663170/3163850658
2017-06-28 19:19:31.529: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:32.530: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007066, LATS 114337484, lastSeqNo 127007065, uniqueness 1469772618, timestamp 1498663171/3163851658
2017-06-28 19:19:32.531: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:33.532: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007067, LATS 114338484, lastSeqNo 127007066, uniqueness 1469772618, timestamp 1498663172/3163852658
2017-06-28 19:19:33.533: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:34.534: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007068, LATS 114339494, lastSeqNo 127007067, uniqueness 1469772618, timestamp 1498663173/3163853658
2017-06-28 19:19:34.535: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:35.037: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:19:35.037: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:19:35.037: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:19:35.037: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:19:35.037: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114339994) for my node
2017-06-28 19:19:35.037: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:19:35.037: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:19:35.038: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:19:35.536: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007069, LATS 114340494, lastSeqNo 127007068, uniqueness 1469772618, timestamp 1498663174/3163854658
2017-06-28 19:19:35.537: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:35.765: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:35.765: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e16f0) allocated
2017-06-28 19:19:35.765: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e16f0 - 1,2,3,4,5
2017-06-28 19:19:35.765: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x888) proc(0x2aaab01e16f0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:35.765: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:35.766: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e16f0
2017-06-28 19:19:35.766: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e16f0
2017-06-28 19:19:35.766: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e16f0), client(1/0x2aaab0258f50)
2017-06-28 19:19:35.767: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab0258f50 with con 0x8b7, requested num -1, flags 0x4000e00
2017-06-28 19:19:35.767: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:19:35.767: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x8b7
2017-06-28 19:19:35.767: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e16f0
2017-06-28 19:19:35.767: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e16f0) con(0x888) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:19:35.767: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x888
2017-06-28 19:19:36.538: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007070, LATS 114341494, lastSeqNo 127007069, uniqueness 1469772618, timestamp 1498663175/3163855668
2017-06-28 19:19:36.539: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:37.540: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007071, LATS 114342494, lastSeqNo 127007070, uniqueness 1469772618, timestamp 1498663176/3163856668
2017-06-28 19:19:37.541: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:38.542: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007072, LATS 114343494, lastSeqNo 127007071, uniqueness 1469772618, timestamp 1498663177/3163857668
2017-06-28 19:19:38.543: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:39.544: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007073, LATS 114344494, lastSeqNo 127007072, uniqueness 1469772618, timestamp 1498663178/3163858668
2017-06-28 19:19:39.545: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:40.047: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:19:40.047: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:19:40.546: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007074, LATS 114345504, lastSeqNo 127007073, uniqueness 1469772618, timestamp 1498663179/3163859668
2017-06-28 19:19:40.547: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:40.773: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:40.773: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e16f0) allocated
2017-06-28 19:19:40.773: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e16f0 - 1,2,3,4,5
2017-06-28 19:19:40.773: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x950) proc(0x2aaab01e16f0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:40.773: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:40.775: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e16f0
2017-06-28 19:19:40.775: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e16f0
2017-06-28 19:19:40.775: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e16f0), client(1/0x2aaab01e1860)
2017-06-28 19:19:40.775: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01e1860 with con 0x97f, requested num -1, flags 0x4000e00
2017-06-28 19:19:40.775: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:19:40.775: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x97f
2017-06-28 19:19:40.776: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e16f0
2017-06-28 19:19:40.776: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e16f0) con(0x950) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:19:40.776: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x950
2017-06-28 19:19:41.548: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007075, LATS 114346504, lastSeqNo 127007074, uniqueness 1469772618, timestamp 1498663180/3163860678
2017-06-28 19:19:41.549: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:42.051: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:19:42.051: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:19:42.051: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114347004) for my node
2017-06-28 19:19:42.051: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:19:42.051: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:19:42.052: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:19:42.550: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007076, LATS 114347504, lastSeqNo 127007075, uniqueness 1469772618, timestamp 1498663181/3163861678
2017-06-28 19:19:42.551: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:43.552: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007077, LATS 114348504, lastSeqNo 127007076, uniqueness 1469772618, timestamp 1498663182/3163862678
2017-06-28 19:19:43.553: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:44.554: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007078, LATS 114349504, lastSeqNo 127007077, uniqueness 1469772618, timestamp 1498663183/3163863678
2017-06-28 19:19:44.555: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:45.057: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:19:45.057: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:19:45.556: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007079, LATS 114350514, lastSeqNo 127007078, uniqueness 1469772618, timestamp 1498663184/3163864688
2017-06-28 19:19:45.557: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:45.781: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:45.781: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e16f0) allocated
2017-06-28 19:19:45.781: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e16f0 - 1,2,3,4,5
2017-06-28 19:19:45.781: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0xa18) proc(0x2aaab01e16f0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:45.781: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:45.783: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e16f0
2017-06-28 19:19:45.783: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e16f0
2017-06-28 19:19:45.783: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e16f0), client(1/0x2aaab01cc3b0)
2017-06-28 19:19:45.783: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01cc3b0 with con 0xa47, requested num -1, flags 0x4000e00
2017-06-28 19:19:45.783: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:19:45.783: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xa47
2017-06-28 19:19:45.784: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e16f0
2017-06-28 19:19:45.784: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e16f0) con(0xa18) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:19:45.784: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xa18
2017-06-28 19:19:46.558: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007080, LATS 114351514, lastSeqNo 127007079, uniqueness 1469772618, timestamp 1498663185/3163865688
2017-06-28 19:19:46.559: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:47.560: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007081, LATS 114352514, lastSeqNo 127007080, uniqueness 1469772618, timestamp 1498663186/3163866688
2017-06-28 19:19:47.561: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:48.562: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007082, LATS 114353514, lastSeqNo 127007081, uniqueness 1469772618, timestamp 1498663187/3163867688
2017-06-28 19:19:48.563: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:49.065: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:19:49.065: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:19:49.065: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114354014) for my node
2017-06-28 19:19:49.065: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:19:49.065: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:19:49.066: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:19:49.564: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007083, LATS 114354514, lastSeqNo 127007082, uniqueness 1469772618, timestamp 1498663188/3163868688
2017-06-28 19:19:49.565: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:50.067: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:19:50.067: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:19:50.566: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007084, LATS 114355524, lastSeqNo 127007083, uniqueness 1469772618, timestamp 1498663189/3163869698
2017-06-28 19:19:50.567: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:50.790: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:50.790: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e16f0) allocated
2017-06-28 19:19:50.790: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e16f0 - 1,2,3,4,5
2017-06-28 19:19:50.790: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0xaee) proc(0x2aaab01e16f0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:50.790: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:50.792: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e16f0
2017-06-28 19:19:50.792: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e16f0
2017-06-28 19:19:50.792: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e16f0), client(1/0x2aaab00aa290)
2017-06-28 19:19:50.792: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab00aa290 with con 0xb1d, requested num -1, flags 0x4000e00
2017-06-28 19:19:50.792: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:19:50.792: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xb1d
2017-06-28 19:19:50.793: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e16f0
2017-06-28 19:19:50.793: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e16f0) con(0xaee) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:19:50.793: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xaee
2017-06-28 19:19:51.568: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007085, LATS 114356524, lastSeqNo 127007084, uniqueness 1469772618, timestamp 1498663190/3163870698
2017-06-28 19:19:51.569: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:52.570: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007086, LATS 114357524, lastSeqNo 127007085, uniqueness 1469772618, timestamp 1498663191/3163871698
2017-06-28 19:19:52.571: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:53.572: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007087, LATS 114358524, lastSeqNo 127007086, uniqueness 1469772618, timestamp 1498663192/3163872708
2017-06-28 19:19:53.573: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:54.075: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:19:54.075: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:19:54.574: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007088, LATS 114359524, lastSeqNo 127007087, uniqueness 1469772618, timestamp 1498663193/3163873708
2017-06-28 19:19:54.575: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:55.576: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007089, LATS 114360524, lastSeqNo 127007088, uniqueness 1469772618, timestamp 1498663194/3163874708
2017-06-28 19:19:55.577: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:55.798: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:19:55.798: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01dccf0) allocated
2017-06-28 19:19:55.798: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01dccf0 - 1,2,3,4,5
2017-06-28 19:19:55.798: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0xbb6) proc(0x2aaab01dccf0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:19:55.798: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:19:55.800: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01dccf0
2017-06-28 19:19:55.800: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01dccf0
2017-06-28 19:19:55.800: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01dccf0), client(1/0x2aaab01f2230)
2017-06-28 19:19:55.800: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01f2230 with con 0xbe5, requested num -1, flags 0x4000e00
2017-06-28 19:19:55.800: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:19:55.800: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xbe5
2017-06-28 19:19:55.801: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01dccf0
2017-06-28 19:19:55.801: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01dccf0) con(0xbb6) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:19:55.801: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xbb6
2017-06-28 19:19:56.079: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:19:56.079: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:19:56.079: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114361034) for my node
2017-06-28 19:19:56.079: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:19:56.079: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:19:56.080: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:19:56.578: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007090, LATS 114361534, lastSeqNo 127007089, uniqueness 1469772618, timestamp 1498663195/3163875708
2017-06-28 19:19:56.579: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:57.580: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007091, LATS 114362534, lastSeqNo 127007090, uniqueness 1469772618, timestamp 1498663196/3163876718
2017-06-28 19:19:57.581: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:58.083: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:19:58.083: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:19:58.582: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007092, LATS 114363534, lastSeqNo 127007091, uniqueness 1469772618, timestamp 1498663197/3163877718
2017-06-28 19:19:58.583: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:19:59.584: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007093, LATS 114364534, lastSeqNo 127007092, uniqueness 1469772618, timestamp 1498663198/3163878718
2017-06-28 19:19:59.585: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:00.586: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007094, LATS 114365534, lastSeqNo 127007093, uniqueness 1469772618, timestamp 1498663199/3163879728
2017-06-28 19:20:00.587: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:00.806: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:00.806: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e43d0) allocated
2017-06-28 19:20:00.806: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e43d0 - 1,2,3,4,5
2017-06-28 19:20:00.806: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0xc8c) proc(0x2aaab01e43d0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:00.806: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:00.808: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e43d0
2017-06-28 19:20:00.808: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e43d0
2017-06-28 19:20:00.808: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e43d0), client(1/0x2aaab0118510)
2017-06-28 19:20:00.808: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab0118510 with con 0xcbb, requested num -1, flags 0x4000e00
2017-06-28 19:20:00.808: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:00.808: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xcbb
2017-06-28 19:20:00.809: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e43d0
2017-06-28 19:20:00.809: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e43d0) con(0xc8c) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:00.809: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xc8c
2017-06-28 19:20:01.588: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007095, LATS 114366544, lastSeqNo 127007094, uniqueness 1469772618, timestamp 1498663200/3163880728
2017-06-28 19:20:01.589: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:02.091: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:02.091: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:20:02.590: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007096, LATS 114367544, lastSeqNo 127007095, uniqueness 1469772618, timestamp 1498663201/3163881728
2017-06-28 19:20:02.591: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:03.093: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:20:03.093: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:20:03.093: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114368044) for my node
2017-06-28 19:20:03.093: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:20:03.093: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:20:03.094: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:20:03.593: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:03.593: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007097, LATS 114368544, lastSeqNo 127007096, uniqueness 1469772618, timestamp 1498663202/3163882728
2017-06-28 19:20:04.595: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:04.595: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007098, LATS 114369544, lastSeqNo 127007097, uniqueness 1469772618, timestamp 1498663203/3163883738
2017-06-28 19:20:05.597: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:05.598: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007099, LATS 114370544, lastSeqNo 127007098, uniqueness 1469772618, timestamp 1498663204/3163884738
2017-06-28 19:20:05.815: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:05.815: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d38d0) allocated
2017-06-28 19:20:05.815: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d38d0 - 1,2,3,4,5
2017-06-28 19:20:05.815: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0xd54) proc(0x2aaab01d38d0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:05.815: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:05.817: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d38d0
2017-06-28 19:20:05.817: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d38d0
2017-06-28 19:20:05.817: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d38d0), client(1/0x2aaab01d3a40)
2017-06-28 19:20:05.817: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01d3a40 with con 0xd83, requested num -1, flags 0x4000e00
2017-06-28 19:20:05.817: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:05.817: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xd83
2017-06-28 19:20:05.818: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d38d0
2017-06-28 19:20:05.818: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d38d0) con(0xd54) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:05.818: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xd54
2017-06-28 19:20:06.599: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:06.601: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007100, LATS 114371554, lastSeqNo 127007099, uniqueness 1469772618, timestamp 1498663205/3163885738
2017-06-28 19:20:07.102: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:07.102: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:20:07.601: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:07.604: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007101, LATS 114372554, lastSeqNo 127007100, uniqueness 1469772618, timestamp 1498663206/3163886748
2017-06-28 19:20:08.603: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:08.607: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007102, LATS 114373554, lastSeqNo 127007101, uniqueness 1469772618, timestamp 1498663207/3163887748
2017-06-28 19:20:09.605: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:09.610: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007103, LATS 114374564, lastSeqNo 127007102, uniqueness 1469772618, timestamp 1498663208/3163888748
2017-06-28 19:20:10.107: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:20:10.107: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:20:10.107: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114375054) for my node
2017-06-28 19:20:10.107: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:20:10.107: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:20:10.108: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:20:10.607: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:10.613: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007104, LATS 114375564, lastSeqNo 127007103, uniqueness 1469772618, timestamp 1498663209/3163889748
2017-06-28 19:20:10.824: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:10.824: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d38b0) allocated
2017-06-28 19:20:10.824: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d38b0 - 1,2,3,4,5
2017-06-28 19:20:10.824: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0xe2a) proc(0x2aaab01d38b0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:10.824: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:10.826: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d38b0
2017-06-28 19:20:10.826: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d38b0
2017-06-28 19:20:10.826: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d38b0), client(1/0x2aaab026f670)
2017-06-28 19:20:10.826: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab026f670 with con 0xe59, requested num -1, flags 0x4000e00
2017-06-28 19:20:10.826: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:10.826: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xe59
2017-06-28 19:20:10.827: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d38b0
2017-06-28 19:20:10.827: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d38b0) con(0xe2a) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:10.827: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xe2a
2017-06-28 19:20:11.609: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:11.616: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007105, LATS 114376564, lastSeqNo 127007104, uniqueness 1469772618, timestamp 1498663210/3163890758
2017-06-28 19:20:12.112: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:12.112: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:20:12.611: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:12.619: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007106, LATS 114377574, lastSeqNo 127007105, uniqueness 1469772618, timestamp 1498663211/3163891758
2017-06-28 19:20:13.613: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:13.622: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007107, LATS 114378574, lastSeqNo 127007106, uniqueness 1469772618, timestamp 1498663212/3163892758
2017-06-28 19:20:14.615: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:14.626: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007108, LATS 114379574, lastSeqNo 127007107, uniqueness 1469772618, timestamp 1498663213/3163893768
2017-06-28 19:20:15.617: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:15.628: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007109, LATS 114380574, lastSeqNo 127007108, uniqueness 1469772618, timestamp 1498663214/3163894768
2017-06-28 19:20:15.833: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:15.833: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d3590) allocated
2017-06-28 19:20:15.833: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d3590 - 1,2,3,4,5
2017-06-28 19:20:15.833: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0xef2) proc(0x2aaab01d3590) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:15.833: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:15.835: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d3590
2017-06-28 19:20:15.835: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d3590
2017-06-28 19:20:15.835: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d3590), client(1/0x2aaab026f670)
2017-06-28 19:20:15.835: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab026f670 with con 0xf21, requested num -1, flags 0x4000e00
2017-06-28 19:20:15.835: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:15.835: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xf21
2017-06-28 19:20:15.836: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d3590
2017-06-28 19:20:15.836: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d3590) con(0xef2) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:15.836: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xef2
2017-06-28 19:20:16.619: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:16.632: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007110, LATS 114381584, lastSeqNo 127007109, uniqueness 1469772618, timestamp 1498663215/3163895778
2017-06-28 19:20:17.121: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:20:17.121: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:20:17.121: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114382074) for my node
2017-06-28 19:20:17.121: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:20:17.121: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:20:17.122: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:20:17.122: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:17.122: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:20:17.621: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:17.635: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007111, LATS 114382584, lastSeqNo 127007110, uniqueness 1469772618, timestamp 1498663216/3163896788
2017-06-28 19:20:18.623: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:18.638: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007112, LATS 114383584, lastSeqNo 127007111, uniqueness 1469772618, timestamp 1498663217/3163897788
2017-06-28 19:20:19.625: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:19.641: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007113, LATS 114384594, lastSeqNo 127007112, uniqueness 1469772618, timestamp 1498663218/3163898788
2017-06-28 19:20:20.627: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:20.644: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007114, LATS 114385594, lastSeqNo 127007113, uniqueness 1469772618, timestamp 1498663219/3163899788
2017-06-28 19:20:20.842: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:20.842: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01f0c30) allocated
2017-06-28 19:20:20.843: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01f0c30 - 1,2,3,4,5
2017-06-28 19:20:20.843: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0xfba) proc(0x2aaab01f0c30) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:20.843: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:20.844: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01f0c30
2017-06-28 19:20:20.844: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01f0c30
2017-06-28 19:20:20.844: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01f0c30), client(1/0x2aaab01f0da0)
2017-06-28 19:20:20.844: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01f0da0 with con 0xfe9, requested num -1, flags 0x4000e00
2017-06-28 19:20:20.844: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:20.844: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xfe9
2017-06-28 19:20:20.845: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01f0c30
2017-06-28 19:20:20.845: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01f0c30) con(0xfba) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:20.845: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0xfba
2017-06-28 19:20:21.629: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:21.647: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007115, LATS 114386594, lastSeqNo 127007114, uniqueness 1469772618, timestamp 1498663220/3163900798
2017-06-28 19:20:22.132: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:22.132: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:20:22.631: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:22.650: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007116, LATS 114387594, lastSeqNo 127007115, uniqueness 1469772618, timestamp 1498663221/3163901798
2017-06-28 19:20:23.633: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:23.653: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007117, LATS 114388604, lastSeqNo 127007116, uniqueness 1469772618, timestamp 1498663222/3163902798
2017-06-28 19:20:24.135: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:20:24.135: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:20:24.135: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114389084) for my node
2017-06-28 19:20:24.135: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:20:24.135: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:20:24.136: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:20:24.636: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:24.656: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007118, LATS 114389604, lastSeqNo 127007117, uniqueness 1469772618, timestamp 1498663223/3163903798
2017-06-28 19:20:25.638: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:25.659: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007119, LATS 114390604, lastSeqNo 127007118, uniqueness 1469772618, timestamp 1498663224/3163904798
2017-06-28 19:20:25.851: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:25.851: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e0d20) allocated
2017-06-28 19:20:25.851: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e0d20 - 1,2,3,4,5
2017-06-28 19:20:25.851: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1090) proc(0x2aaab01e0d20) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:25.851: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:25.853: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e0d20
2017-06-28 19:20:25.853: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e0d20
2017-06-28 19:20:25.853: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e0d20), client(1/0x2aaab01f7b90)
2017-06-28 19:20:25.853: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01f7b90 with con 0x10bf, requested num -1, flags 0x4000e00
2017-06-28 19:20:25.853: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:25.853: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x10bf
2017-06-28 19:20:25.854: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e0d20
2017-06-28 19:20:25.854: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e0d20) con(0x1090) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:25.854: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1090
2017-06-28 19:20:26.140: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:26.140: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:20:26.640: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:26.662: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007120, LATS 114391614, lastSeqNo 127007119, uniqueness 1469772618, timestamp 1498663225/3163905808
2017-06-28 19:20:27.642: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:27.665: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007121, LATS 114392614, lastSeqNo 127007120, uniqueness 1469772618, timestamp 1498663226/3163906808
2017-06-28 19:20:28.645: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:28.668: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007122, LATS 114393614, lastSeqNo 127007121, uniqueness 1469772618, timestamp 1498663227/3163907808
2017-06-28 19:20:29.648: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:29.671: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007123, LATS 114394614, lastSeqNo 127007122, uniqueness 1469772618, timestamp 1498663228/3163908808
2017-06-28 19:20:30.148: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:30.148: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:20:30.651: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:30.674: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007124, LATS 114395624, lastSeqNo 127007123, uniqueness 1469772618, timestamp 1498663229/3163909808
2017-06-28 19:20:30.861: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:30.861: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e0d20) allocated
2017-06-28 19:20:30.861: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e0d20 - 1,2,3,4,5
2017-06-28 19:20:30.861: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1158) proc(0x2aaab01e0d20) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:30.861: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:30.863: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e0d20
2017-06-28 19:20:30.863: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e0d20
2017-06-28 19:20:30.863: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e0d20), client(1/0x2aaab0258f50)
2017-06-28 19:20:30.863: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab0258f50 with con 0x1187, requested num -1, flags 0x4000e00
2017-06-28 19:20:30.863: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:30.863: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1187
2017-06-28 19:20:30.864: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e0d20
2017-06-28 19:20:30.864: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e0d20) con(0x1158) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:30.864: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1158
2017-06-28 19:20:31.149: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:20:31.149: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:20:31.149: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114396094) for my node
2017-06-28 19:20:31.149: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:20:31.149: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:20:31.150: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:20:31.654: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:31.676: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007125, LATS 114396624, lastSeqNo 127007124, uniqueness 1469772618, timestamp 1498663230/3163910808
2017-06-28 19:20:32.657: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:32.678: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007126, LATS 114397624, lastSeqNo 127007125, uniqueness 1469772618, timestamp 1498663231/3163911818
2017-06-28 19:20:33.660: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:33.680: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007127, LATS 114398624, lastSeqNo 127007126, uniqueness 1469772618, timestamp 1498663232/3163912818
2017-06-28 19:20:34.159: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:34.159: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:20:34.663: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:34.682: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007128, LATS 114399624, lastSeqNo 127007127, uniqueness 1469772618, timestamp 1498663233/3163913818
2017-06-28 19:20:35.666: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:35.684: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007129, LATS 114400634, lastSeqNo 127007128, uniqueness 1469772618, timestamp 1498663234/3163914818
2017-06-28 19:20:35.871: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:35.871: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d3860) allocated
2017-06-28 19:20:35.871: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d3860 - 1,2,3,4,5
2017-06-28 19:20:35.871: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x122e) proc(0x2aaab01d3860) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:35.871: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:35.873: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d3860
2017-06-28 19:20:35.873: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d3860
2017-06-28 19:20:35.873: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d3860), client(1/0x2aaab01e4e90)
2017-06-28 19:20:35.873: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01e4e90 with con 0x125d, requested num -1, flags 0x4000e00
2017-06-28 19:20:35.873: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:35.873: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x125d
2017-06-28 19:20:35.874: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d3860
2017-06-28 19:20:35.874: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d3860) con(0x122e) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:35.874: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x122e
2017-06-28 19:20:36.669: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:36.686: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007130, LATS 114401634, lastSeqNo 127007129, uniqueness 1469772618, timestamp 1498663235/3163915818
2017-06-28 19:20:37.671: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:37.688: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007131, LATS 114402634, lastSeqNo 127007130, uniqueness 1469772618, timestamp 1498663236/3163916828
2017-06-28 19:20:38.163: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:20:38.163: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:20:38.163: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114403114) for my node
2017-06-28 19:20:38.163: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:20:38.163: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:20:38.164: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:20:38.170: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:38.170: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:20:38.673: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:38.690: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007132, LATS 114403634, lastSeqNo 127007131, uniqueness 1469772618, timestamp 1498663237/3163917828
2017-06-28 19:20:39.675: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:39.692: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007133, LATS 114404634, lastSeqNo 127007132, uniqueness 1469772618, timestamp 1498663238/3163918828
2017-06-28 19:20:40.677: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:40.694: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007134, LATS 114405644, lastSeqNo 127007133, uniqueness 1469772618, timestamp 1498663239/3163919828
2017-06-28 19:20:40.880: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:40.880: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01dc460) allocated
2017-06-28 19:20:40.881: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01dc460 - 1,2,3,4,5
2017-06-28 19:20:40.881: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x12f6) proc(0x2aaab01dc460) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:40.881: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:40.882: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01dc460
2017-06-28 19:20:40.882: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01dc460
2017-06-28 19:20:40.882: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01dc460), client(1/0x2aaab026f670)
2017-06-28 19:20:40.882: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab026f670 with con 0x1325, requested num -1, flags 0x4000e00
2017-06-28 19:20:40.882: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:40.882: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1325
2017-06-28 19:20:40.883: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01dc460
2017-06-28 19:20:40.883: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01dc460) con(0x12f6) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:40.883: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x12f6
2017-06-28 19:20:41.679: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:41.696: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007135, LATS 114406644, lastSeqNo 127007134, uniqueness 1469772618, timestamp 1498663240/3163920828
2017-06-28 19:20:42.178: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:42.178: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:20:42.681: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:42.699: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007136, LATS 114407644, lastSeqNo 127007135, uniqueness 1469772618, timestamp 1498663241/3163921828
2017-06-28 19:20:43.683: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:43.701: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007137, LATS 114408644, lastSeqNo 127007136, uniqueness 1469772618, timestamp 1498663242/3163922838
2017-06-28 19:20:44.685: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:44.703: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007138, LATS 114409644, lastSeqNo 127007137, uniqueness 1469772618, timestamp 1498663243/3163923838
2017-06-28 19:20:45.177: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:20:45.177: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:20:45.177: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114410124) for my node
2017-06-28 19:20:45.177: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:20:45.178: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:20:45.178: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:20:45.687: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:45.705: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007139, LATS 114410654, lastSeqNo 127007138, uniqueness 1469772618, timestamp 1498663244/3163924838
2017-06-28 19:20:45.888: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:45.888: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d9970) allocated
2017-06-28 19:20:45.889: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d9970 - 1,2,3,4,5
2017-06-28 19:20:45.889: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x13be) proc(0x2aaab01d9970) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:45.889: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:45.890: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d9970
2017-06-28 19:20:45.890: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d9970
2017-06-28 19:20:45.890: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d9970), client(1/0x2aaab01f07a0)
2017-06-28 19:20:45.890: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01f07a0 with con 0x13ed, requested num -1, flags 0x4000e00
2017-06-28 19:20:45.890: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:45.890: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x13ed
2017-06-28 19:20:45.891: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d9970
2017-06-28 19:20:45.891: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d9970) con(0x13be) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:45.891: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x13be
2017-06-28 19:20:46.186: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:46.186: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:20:46.689: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:46.707: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007140, LATS 114411654, lastSeqNo 127007139, uniqueness 1469772618, timestamp 1498663245/3163925838
2017-06-28 19:20:47.692: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:47.709: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007141, LATS 114412654, lastSeqNo 127007140, uniqueness 1469772618, timestamp 1498663246/3163926838
2017-06-28 19:20:48.693: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:48.711: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007142, LATS 114413654, lastSeqNo 127007141, uniqueness 1469772618, timestamp 1498663247/3163927848
2017-06-28 19:20:49.695: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:49.713: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007143, LATS 114414654, lastSeqNo 127007142, uniqueness 1469772618, timestamp 1498663248/3163928848
2017-06-28 19:20:50.697: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:50.715: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007144, LATS 114415654, lastSeqNo 127007143, uniqueness 1469772618, timestamp 1498663249/3163929848
2017-06-28 19:20:50.896: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:50.896: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d3760) allocated
2017-06-28 19:20:50.896: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d3760 - 1,2,3,4,5
2017-06-28 19:20:50.896: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1486) proc(0x2aaab01d3760) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:50.896: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:50.898: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d3760
2017-06-28 19:20:50.898: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d3760
2017-06-28 19:20:50.898: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d3760), client(1/0x2aaab01e5e50)
2017-06-28 19:20:50.898: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01e5e50 with con 0x14b5, requested num -1, flags 0x4000e00
2017-06-28 19:20:50.898: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:50.898: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x14b5
2017-06-28 19:20:50.899: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d3760
2017-06-28 19:20:50.899: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d3760) con(0x1486) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:50.899: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1486
2017-06-28 19:20:51.196: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:51.196: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:20:51.699: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:51.717: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007145, LATS 114416664, lastSeqNo 127007144, uniqueness 1469772618, timestamp 1498663250/3163930848
2017-06-28 19:20:52.191: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:20:52.192: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:20:52.192: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114417134) for my node
2017-06-28 19:20:52.192: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:20:52.192: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:20:52.192: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:20:52.701: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:52.720: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007146, LATS 114417664, lastSeqNo 127007145, uniqueness 1469772618, timestamp 1498663251/3163931848
2017-06-28 19:20:53.703: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:53.722: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007147, LATS 114418664, lastSeqNo 127007146, uniqueness 1469772618, timestamp 1498663252/3163932858
2017-06-28 19:20:54.705: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:54.724: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007148, LATS 114419664, lastSeqNo 127007147, uniqueness 1469772618, timestamp 1498663253/3163933858
2017-06-28 19:20:55.204: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:55.204: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:20:55.707: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:55.726: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007149, LATS 114420674, lastSeqNo 127007148, uniqueness 1469772618, timestamp 1498663254/3163934858
2017-06-28 19:20:55.904: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:20:55.904: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01f0460) allocated
2017-06-28 19:20:55.904: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01f0460 - 1,2,3,4,5
2017-06-28 19:20:55.904: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x154e) proc(0x2aaab01f0460) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:20:55.904: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:20:55.906: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01f0460
2017-06-28 19:20:55.906: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01f0460
2017-06-28 19:20:55.906: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01f0460), client(1/0x2aaab00a8800)
2017-06-28 19:20:55.906: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab00a8800 with con 0x157d, requested num -1, flags 0x4000e00
2017-06-28 19:20:55.906: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:20:55.906: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x157d
2017-06-28 19:20:55.907: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01f0460
2017-06-28 19:20:55.907: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01f0460) con(0x154e) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:20:55.907: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x154e
2017-06-28 19:20:56.709: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:56.728: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007150, LATS 114421674, lastSeqNo 127007149, uniqueness 1469772618, timestamp 1498663255/3163935858
2017-06-28 19:20:57.711: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:57.730: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007151, LATS 114422674, lastSeqNo 127007150, uniqueness 1469772618, timestamp 1498663256/3163936858
2017-06-28 19:20:58.713: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:58.732: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007152, LATS 114423674, lastSeqNo 127007151, uniqueness 1469772618, timestamp 1498663257/3163937868
2017-06-28 19:20:59.205: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:20:59.206: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:20:59.206: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114424144) for my node
2017-06-28 19:20:59.206: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:20:59.206: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:20:59.206: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:20:59.212: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:20:59.212: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:20:59.715: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:20:59.734: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007153, LATS 114424674, lastSeqNo 127007152, uniqueness 1469772618, timestamp 1498663258/3163938868
2017-06-28 19:21:00.717: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:00.736: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007154, LATS 114425674, lastSeqNo 127007153, uniqueness 1469772618, timestamp 1498663259/3163939868
2017-06-28 19:21:00.912: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:00.912: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01efe30) allocated
2017-06-28 19:21:00.913: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01efe30 - 1,2,3,4,5
2017-06-28 19:21:00.913: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1624) proc(0x2aaab01efe30) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:00.913: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:00.914: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01efe30
2017-06-28 19:21:00.914: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01efe30
2017-06-28 19:21:00.914: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01efe30), client(1/0x2aaab01effa0)
2017-06-28 19:21:00.915: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01effa0 with con 0x1653, requested num -1, flags 0x4000e00
2017-06-28 19:21:00.915: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:00.915: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1653
2017-06-28 19:21:00.915: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01efe30
2017-06-28 19:21:00.915: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01efe30) con(0x1624) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:00.915: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1624
2017-06-28 19:21:01.719: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:01.738: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007155, LATS 114426684, lastSeqNo 127007154, uniqueness 1469772618, timestamp 1498663260/3163940868
2017-06-28 19:21:02.722: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:02.740: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007156, LATS 114427684, lastSeqNo 127007155, uniqueness 1469772618, timestamp 1498663261/3163941868
2017-06-28 19:21:03.220: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:03.220: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:21:03.723: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:03.742: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007157, LATS 114428684, lastSeqNo 127007156, uniqueness 1469772618, timestamp 1498663262/3163942878
2017-06-28 19:21:04.725: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:04.745: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007158, LATS 114429684, lastSeqNo 127007157, uniqueness 1469772618, timestamp 1498663263/3163943878
2017-06-28 19:21:05.727: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:05.748: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007159, LATS 114430694, lastSeqNo 127007158, uniqueness 1469772618, timestamp 1498663264/3163944878
2017-06-28 19:21:05.921: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:05.921: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01eee20) allocated
2017-06-28 19:21:05.921: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01eee20 - 1,2,3,4,5
2017-06-28 19:21:05.921: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x16ec) proc(0x2aaab01eee20) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:05.921: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:05.923: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01eee20
2017-06-28 19:21:05.923: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01eee20
2017-06-28 19:21:05.923: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01eee20), client(1/0x2aaab00aa290)
2017-06-28 19:21:05.923: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab00aa290 with con 0x171b, requested num -1, flags 0x4000e00
2017-06-28 19:21:05.923: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:05.923: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x171b
2017-06-28 19:21:05.924: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01eee20
2017-06-28 19:21:05.924: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01eee20) con(0x16ec) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:05.924: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x16ec
2017-06-28 19:21:06.220: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:21:06.220: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:21:06.220: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114431164) for my node
2017-06-28 19:21:06.220: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:21:06.220: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:21:06.220: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:21:06.729: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:06.751: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007160, LATS 114431694, lastSeqNo 127007159, uniqueness 1469772618, timestamp 1498663265/3163945888
2017-06-28 19:21:07.732: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:07.754: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007161, LATS 114432694, lastSeqNo 127007160, uniqueness 1469772618, timestamp 1498663266/3163946888
2017-06-28 19:21:08.230: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:08.230: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:21:08.733: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:08.756: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007162, LATS 114433694, lastSeqNo 127007161, uniqueness 1469772618, timestamp 1498663267/3163947888
2017-06-28 19:21:09.735: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:09.759: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007163, LATS 114434704, lastSeqNo 127007162, uniqueness 1469772618, timestamp 1498663268/3163948888
2017-06-28 19:21:10.737: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:10.761: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007164, LATS 114435704, lastSeqNo 127007163, uniqueness 1469772618, timestamp 1498663269/3163949898
2017-06-28 19:21:10.929: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:10.929: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01eea40) allocated
2017-06-28 19:21:10.930: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01eea40 - 1,2,3,4,5
2017-06-28 19:21:10.930: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x17b4) proc(0x2aaab01eea40) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:10.930: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:10.931: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01eea40
2017-06-28 19:21:10.931: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01eea40
2017-06-28 19:21:10.931: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01eea40), client(1/0x2aaab01fa970)
2017-06-28 19:21:10.931: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01fa970 with con 0x17e3, requested num -1, flags 0x4000e00
2017-06-28 19:21:10.931: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:10.931: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x17e3
2017-06-28 19:21:10.932: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01eea40
2017-06-28 19:21:10.932: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01eea40) con(0x17b4) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:10.932: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x17b4
2017-06-28 19:21:11.739: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:11.764: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007165, LATS 114436704, lastSeqNo 127007164, uniqueness 1469772618, timestamp 1498663270/3163950898
2017-06-28 19:21:12.741: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:12.766: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007166, LATS 114437704, lastSeqNo 127007165, uniqueness 1469772618, timestamp 1498663271/3163951898
2017-06-28 19:21:13.234: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:21:13.234: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:21:13.234: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114438174) for my node
2017-06-28 19:21:13.234: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:21:13.234: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:21:13.234: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:21:13.240: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:13.241: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:21:13.743: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:13.768: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007167, LATS 114438704, lastSeqNo 127007166, uniqueness 1469772618, timestamp 1498663272/3163952908
2017-06-28 19:21:14.745: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:14.771: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007168, LATS 114439714, lastSeqNo 127007167, uniqueness 1469772618, timestamp 1498663273/3163953908
2017-06-28 19:21:15.747: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:15.774: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007169, LATS 114440714, lastSeqNo 127007168, uniqueness 1469772618, timestamp 1498663274/3163954908
2017-06-28 19:21:15.937: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:15.937: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d3530) allocated
2017-06-28 19:21:15.938: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d3530 - 1,2,3,4,5
2017-06-28 19:21:15.938: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x188a) proc(0x2aaab01d3530) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:15.938: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:15.939: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d3530
2017-06-28 19:21:15.939: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d3530
2017-06-28 19:21:15.939: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d3530), client(1/0x2aaab0258f50)
2017-06-28 19:21:15.939: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab0258f50 with con 0x18b9, requested num -1, flags 0x4000e00
2017-06-28 19:21:15.939: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:15.939: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x18b9
2017-06-28 19:21:15.940: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d3530
2017-06-28 19:21:15.940: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d3530) con(0x188a) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:15.940: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x188a
2017-06-28 19:21:16.749: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:16.777: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007170, LATS 114441714, lastSeqNo 127007169, uniqueness 1469772618, timestamp 1498663275/3163955908
2017-06-28 19:21:17.751: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:17.780: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007171, LATS 114442724, lastSeqNo 127007170, uniqueness 1469772618, timestamp 1498663276/3163956918
2017-06-28 19:21:18.250: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:18.251: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:21:18.753: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:18.783: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007172, LATS 114443724, lastSeqNo 127007171, uniqueness 1469772618, timestamp 1498663277/3163957918
2017-06-28 19:21:19.755: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:19.786: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007173, LATS 114444724, lastSeqNo 127007172, uniqueness 1469772618, timestamp 1498663278/3163958918
2017-06-28 19:21:20.248: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:21:20.248: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:21:20.248: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114445184) for my node
2017-06-28 19:21:20.248: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:21:20.248: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:21:20.248: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:21:20.758: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:20.789: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007174, LATS 114445734, lastSeqNo 127007173, uniqueness 1469772618, timestamp 1498663279/3163959928
2017-06-28 19:21:20.946: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:20.946: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e0280) allocated
2017-06-28 19:21:20.947: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e0280 - 1,2,3,4,5
2017-06-28 19:21:20.947: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1952) proc(0x2aaab01e0280) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:20.947: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:20.948: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e0280
2017-06-28 19:21:20.948: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e0280
2017-06-28 19:21:20.948: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e0280), client(1/0x2aaab026f670)
2017-06-28 19:21:20.948: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab026f670 with con 0x1981, requested num -1, flags 0x4000e00
2017-06-28 19:21:20.948: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:20.948: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1981
2017-06-28 19:21:20.949: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e0280
2017-06-28 19:21:20.949: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e0280) con(0x1952) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:20.949: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1952
2017-06-28 19:21:21.759: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:21.792: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007175, LATS 114446734, lastSeqNo 127007174, uniqueness 1469772618, timestamp 1498663280/3163960928
2017-06-28 19:21:22.259: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:22.259: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:21:22.762: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:22.795: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007176, LATS 114447734, lastSeqNo 127007175, uniqueness 1469772618, timestamp 1498663281/3163961928
2017-06-28 19:21:23.764: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:23.799: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007177, LATS 114448734, lastSeqNo 127007176, uniqueness 1469772618, timestamp 1498663282/3163962938
2017-06-28 19:21:24.766: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:24.801: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007178, LATS 114449744, lastSeqNo 127007177, uniqueness 1469772618, timestamp 1498663283/3163963938
2017-06-28 19:21:25.768: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:25.804: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007179, LATS 114450744, lastSeqNo 127007178, uniqueness 1469772618, timestamp 1498663284/3163964938
2017-06-28 19:21:25.954: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:25.954: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d9650) allocated
2017-06-28 19:21:25.955: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d9650 - 1,2,3,4,5
2017-06-28 19:21:25.955: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1a28) proc(0x2aaab01d9650) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:25.955: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:25.956: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d9650
2017-06-28 19:21:25.956: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d9650
2017-06-28 19:21:25.956: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d9650), client(1/0x2aaab00aa290)
2017-06-28 19:21:25.956: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab00aa290 with con 0x1a57, requested num -1, flags 0x4000e00
2017-06-28 19:21:25.956: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:25.956: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1a57
2017-06-28 19:21:25.957: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d9650
2017-06-28 19:21:25.957: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d9650) con(0x1a28) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:25.957: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1a28
2017-06-28 19:21:26.267: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:26.267: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:21:26.770: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:26.807: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007180, LATS 114451744, lastSeqNo 127007179, uniqueness 1469772618, timestamp 1498663285/3163965938
2017-06-28 19:21:27.262: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:21:27.262: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:21:27.262: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114452204) for my node
2017-06-28 19:21:27.262: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:21:27.262: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:21:27.262: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:21:27.772: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:27.810: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007181, LATS 114452754, lastSeqNo 127007180, uniqueness 1469772618, timestamp 1498663286/3163966948
2017-06-28 19:21:28.774: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:28.814: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007182, LATS 114453754, lastSeqNo 127007181, uniqueness 1469772618, timestamp 1498663287/3163967948
2017-06-28 19:21:29.777: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:29.816: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007183, LATS 114454754, lastSeqNo 127007182, uniqueness 1469772618, timestamp 1498663288/3163968948
2017-06-28 19:21:30.275: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:30.275: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:21:30.779: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:30.819: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007184, LATS 114455754, lastSeqNo 127007183, uniqueness 1469772618, timestamp 1498663289/3163969958
2017-06-28 19:21:30.963: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:30.963: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01dd210) allocated
2017-06-28 19:21:30.964: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01dd210 - 1,2,3,4,5
2017-06-28 19:21:30.964: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1af0) proc(0x2aaab01dd210) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:30.964: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:30.965: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01dd210
2017-06-28 19:21:30.965: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01dd210
2017-06-28 19:21:30.965: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01dd210), client(1/0x2aaab00aa290)
2017-06-28 19:21:30.965: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab00aa290 with con 0x1b1f, requested num -1, flags 0x4000e00
2017-06-28 19:21:30.965: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:30.965: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1b1f
2017-06-28 19:21:30.966: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01dd210
2017-06-28 19:21:30.966: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01dd210) con(0x1af0) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:30.966: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1af0
2017-06-28 19:21:31.781: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:31.822: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007185, LATS 114456764, lastSeqNo 127007184, uniqueness 1469772618, timestamp 1498663290/3163970958
2017-06-28 19:21:32.783: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:33.785: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:34.276: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:21:34.276: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:21:34.276: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114459214) for my node
2017-06-28 19:21:34.276: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:21:34.276: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:21:34.276: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:21:34.787: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:35.285: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:35.285: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:21:35.789: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:35.972: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:35.972: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e0960) allocated
2017-06-28 19:21:35.973: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e0960 - 1,2,3,4,5
2017-06-28 19:21:35.973: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1bc6) proc(0x2aaab01e0960) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:35.973: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:35.974: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e0960
2017-06-28 19:21:35.974: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e0960
2017-06-28 19:21:35.974: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e0960), client(1/0x2aaab01fab30)
2017-06-28 19:21:35.974: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01fab30 with con 0x1bf5, requested num -1, flags 0x4000e00
2017-06-28 19:21:35.974: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:35.975: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1bf5
2017-06-28 19:21:35.975: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e0960
2017-06-28 19:21:35.975: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e0960) con(0x1bc6) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:35.975: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1bc6
2017-06-28 19:21:36.791: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:37.793: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:38.796: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:39.798: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:40.295: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:40.295: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:21:40.800: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:40.981: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:40.981: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01e0960) allocated
2017-06-28 19:21:40.982: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01e0960 - 1,2,3,4,5
2017-06-28 19:21:40.982: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1c8e) proc(0x2aaab01e0960) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:40.982: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:40.983: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01e0960
2017-06-28 19:21:40.983: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01e0960
2017-06-28 19:21:40.983: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01e0960), client(1/0x2aaab01e0550)
2017-06-28 19:21:40.983: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01e0550 with con 0x1cbd, requested num -1, flags 0x4000e00
2017-06-28 19:21:40.983: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:40.984: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1cbd
2017-06-28 19:21:40.984: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01e0960
2017-06-28 19:21:40.984: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01e0960) con(0x1c8e) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:40.984: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1c8e
2017-06-28 19:21:41.290: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:21:41.290: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:21:41.290: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114466224) for my node
2017-06-28 19:21:41.290: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:21:41.290: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:21:41.290: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:21:41.802: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:42.804: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:43.806: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:44.632: [    CSSD][1075976512]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 11800 msecs
2017-06-28 19:21:44.632: [    CSSD][1075976512]clssscMonitorThreads clssnmvWorkerThread not scheduled for 11800 msecs
2017-06-28 19:21:44.808: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:45.289: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007199, LATS 114470224, lastSeqNo 127007185, uniqueness 1469772618, timestamp 1498663304/3163984988
2017-06-28 19:21:45.305: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:45.305: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:21:45.810: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:45.990: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:45.990: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01dd1a0) allocated
2017-06-28 19:21:45.991: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01dd1a0 - 1,2,3,4,5
2017-06-28 19:21:45.991: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1d56) proc(0x2aaab01dd1a0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:45.991: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:45.992: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01dd1a0
2017-06-28 19:21:45.992: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01dd1a0
2017-06-28 19:21:45.992: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01dd1a0), client(1/0x2aaab01e7ec0)
2017-06-28 19:21:45.992: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01e7ec0 with con 0x1d85, requested num -1, flags 0x4000e00
2017-06-28 19:21:45.992: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:45.993: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1d85
2017-06-28 19:21:45.993: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01dd1a0
2017-06-28 19:21:45.993: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01dd1a0) con(0x1d56) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:45.993: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1d56
2017-06-28 19:21:46.812: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:47.814: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:48.304: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:21:48.304: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:21:48.304: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114473244) for my node
2017-06-28 19:21:48.304: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:21:48.304: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:21:48.304: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:21:48.817: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:49.313: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:49.313: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:21:49.820: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:50.823: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:51.000: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:51.000: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01dd0e0) allocated
2017-06-28 19:21:51.001: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01dd0e0 - 1,2,3,4,5
2017-06-28 19:21:51.001: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1e2c) proc(0x2aaab01dd0e0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:51.001: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:51.002: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01dd0e0
2017-06-28 19:21:51.002: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01dd0e0
2017-06-28 19:21:51.002: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01dd0e0), client(1/0x2aaab01da8e0)
2017-06-28 19:21:51.003: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01da8e0 with con 0x1e5b, requested num -1, flags 0x4000e00
2017-06-28 19:21:51.003: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:51.003: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1e5b
2017-06-28 19:21:51.003: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01dd0e0
2017-06-28 19:21:51.003: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01dd0e0) con(0x1e2c) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:51.003: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1e2c
2017-06-28 19:21:51.826: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:52.829: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:53.325: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:53.325: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:21:53.832: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:54.642: [    CSSD][1075976512]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 8350 msecs
2017-06-28 19:21:54.642: [    CSSD][1075976512]clssscMonitorThreads clssnmvWorkerThread not scheduled for 8350 msecs
2017-06-28 19:21:54.835: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:55.319: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:21:55.319: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:21:55.319: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114480254) for my node
2017-06-28 19:21:55.319: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:21:55.319: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:21:55.319: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:21:55.837: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:56.009: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:21:56.010: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01dd0e0) allocated
2017-06-28 19:21:56.010: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01dd0e0 - 1,2,3,4,5
2017-06-28 19:21:56.010: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1ef4) proc(0x2aaab01dd0e0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:21:56.010: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:21:56.011: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01dd0e0
2017-06-28 19:21:56.011: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01dd0e0
2017-06-28 19:21:56.011: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01dd0e0), client(1/0x2aaab026f670)
2017-06-28 19:21:56.012: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab026f670 with con 0x1f23, requested num -1, flags 0x4000e00
2017-06-28 19:21:56.012: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:21:56.012: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1f23
2017-06-28 19:21:56.012: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01dd0e0
2017-06-28 19:21:56.012: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01dd0e0) con(0x1ef4) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:21:56.012: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1ef4
2017-06-28 19:21:56.839: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:57.336: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:21:57.336: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:21:57.841: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:58.843: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:21:59.845: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:00.847: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:01.018: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:22:01.018: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01dd0e0) allocated
2017-06-28 19:22:01.018: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01dd0e0 - 1,2,3,4,5
2017-06-28 19:22:01.018: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x1fbc) proc(0x2aaab01dd0e0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:22:01.018: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:22:01.019: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01dd0e0
2017-06-28 19:22:01.019: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01dd0e0
2017-06-28 19:22:01.019: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01dd0e0), client(1/0x2aaab01ea6e0)
2017-06-28 19:22:01.020: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01ea6e0 with con 0x1feb, requested num -1, flags 0x4000e00
2017-06-28 19:22:01.020: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:22:01.020: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1feb
2017-06-28 19:22:01.020: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01dd0e0
2017-06-28 19:22:01.020: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01dd0e0) con(0x1fbc) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:22:01.020: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x1fbc
2017-06-28 19:22:01.345: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:22:01.345: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:22:01.849: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:02.333: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:22:02.333: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:22:02.333: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114487264) for my node
2017-06-28 19:22:02.333: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:22:02.333: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:22:02.334: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:22:02.851: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:03.853: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:04.643: [    CSSD][1075976512]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 18350 msecs
2017-06-28 19:22:04.643: [    CSSD][1075976512]clssscMonitorThreads clssnmvWorkerThread not scheduled for 18350 msecs
2017-06-28 19:22:04.855: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:05.318: [    CSSD][1089001792]clssnmvDHBValidateNCopy: node 1, rhis-cr-0613-03, has a disk HB, but no network HB, DHB has rcfg 266426551, wrtcnt, 127007219, LATS 114490254, lastSeqNo 127007199, uniqueness 1469772618, timestamp 1498663324/3164005028
2017-06-28 19:22:05.353: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:22:05.353: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:22:05.857: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:06.026: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:22:06.026: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01dabf0) allocated
2017-06-28 19:22:06.026: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01dabf0 - 1,2,3,4,5
2017-06-28 19:22:06.026: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x2084) proc(0x2aaab01dabf0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:22:06.026: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:22:06.027: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01dabf0
2017-06-28 19:22:06.027: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01dabf0
2017-06-28 19:22:06.027: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01dabf0), client(1/0x2aaab0258f50)
2017-06-28 19:22:06.028: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab0258f50 with con 0x20b3, requested num -1, flags 0x4000e00
2017-06-28 19:22:06.028: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:22:06.028: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x20b3
2017-06-28 19:22:06.028: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01dabf0
2017-06-28 19:22:06.028: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01dabf0) con(0x2084) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:22:06.028: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x2084
2017-06-28 19:22:06.859: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:07.861: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:08.863: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:09.347: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:22:09.347: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:22:09.347: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114494284) for my node
2017-06-28 19:22:09.347: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:22:09.347: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:22:09.348: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:22:09.361: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:22:09.361: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:22:09.865: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:10.867: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:11.034: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:22:11.034: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01da280) allocated
2017-06-28 19:22:11.034: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01da280 - 1,2,3,4,5
2017-06-28 19:22:11.034: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x214c) proc(0x2aaab01da280) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:22:11.034: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:22:11.035: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01da280
2017-06-28 19:22:11.035: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01da280
2017-06-28 19:22:11.035: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01da280), client(1/0x2aaab0258f50)
2017-06-28 19:22:11.036: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab0258f50 with con 0x217b, requested num -1, flags 0x4000e00
2017-06-28 19:22:11.036: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:22:11.036: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x217b
2017-06-28 19:22:11.036: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01da280
2017-06-28 19:22:11.036: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01da280) con(0x214c) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:22:11.036: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x214c
2017-06-28 19:22:11.869: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:12.871: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:13.369: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:22:13.369: [    CSSD][1100900672]clssnmSendingThread: sent 4 join msgs to all nodes
2017-06-28 19:22:13.873: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:14.643: [    CSSD][1075976512]clssscMonitorThreads clssnmvDiskPingThread not scheduled for 8320 msecs
2017-06-28 19:22:14.643: [    CSSD][1075976512]clssscMonitorThreads clssnmvWorkerThread not scheduled for 8320 msecs
2017-06-28 19:22:14.875: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:15.877: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:16.042: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:22:16.042: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d9b10) allocated
2017-06-28 19:22:16.042: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d9b10 - 1,2,3,4,5
2017-06-28 19:22:16.042: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x2214) proc(0x2aaab01d9b10) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:22:16.042: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:22:16.043: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d9b10
2017-06-28 19:22:16.043: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d9b10
2017-06-28 19:22:16.043: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d9b10), client(1/0x2aaab01d9c80)
2017-06-28 19:22:16.044: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01d9c80 with con 0x2243, requested num -1, flags 0x4000e00
2017-06-28 19:22:16.044: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:22:16.044: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x2243
2017-06-28 19:22:16.044: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d9b10
2017-06-28 19:22:16.044: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d9b10) con(0x2214) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:22:16.045: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x2214
2017-06-28 19:22:16.361: [    CSSD][1108396352]clssnmRcfgMgrThread: Local Join
2017-06-28 19:22:16.361: [    CSSD][1108396352]clssnmLocalJoinEvent: begin on node(2), waittime 193000
2017-06-28 19:22:16.361: [    CSSD][1108396352]clssnmLocalJoinEvent: set curtime (114501294) for my node
2017-06-28 19:22:16.361: [    CSSD][1108396352]clssnmLocalJoinEvent: scanning 32 nodes
2017-06-28 19:22:16.361: [    CSSD][1108396352]clssnmLocalJoinEvent: Node rhis-cr-0613-03, number 1, is in an existing cluster with disk state 3
2017-06-28 19:22:16.362: [    CSSD][1108396352]clssnmLocalJoinEvent: takeover aborted due to cluster member node found on disk
2017-06-28 19:22:16.879: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:17.881: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:18.379: [    CSSD][1100900672]clssnmSendingThread: sending join msg to all nodes
2017-06-28 19:22:18.379: [    CSSD][1100900672]clssnmSendingThread: sent 5 join msgs to all nodes
2017-06-28 19:22:18.883: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:19.885: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:20.887: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
2017-06-28 19:22:21.050: [    CSSD][1075976512]clssscSelect: cookie accept request 0x1a13e8d0
2017-06-28 19:22:21.050: [    CSSD][1075976512]clssgmAllocProc: (0x2aaab01d35a0) allocated
2017-06-28 19:22:21.050: [    CSSD][1075976512]clssgmClientConnectMsg: properties of cmProc 0x2aaab01d35a0 - 1,2,3,4,5
2017-06-28 19:22:21.050: [    CSSD][1075976512]clssgmClientConnectMsg: Connect from con(0x22dc) proc(0x2aaab01d35a0) pid(21518) version 11:2:1:4, properties: 1,2,3,4,5
2017-06-28 19:22:21.050: [    CSSD][1075976512]clssgmClientConnectMsg: msg flags 0x0000
2017-06-28 19:22:21.051: [    CSSD][1075976512]clssscSelect: cookie accept request 0x2aaab01d35a0
2017-06-28 19:22:21.051: [    CSSD][1075976512]clssscevtypSHRCON: getting client with cmproc 0x2aaab01d35a0
2017-06-28 19:22:21.052: [    CSSD][1075976512]clssgmRegisterClient: proc(4/0x2aaab01d35a0), client(1/0x2aaab01ea560)
2017-06-28 19:22:21.052: [    CSSD][1075976512]clssgmJoinGrock: global grock CRF- new client 0x2aaab01ea560 with con 0x230b, requested num -1, flags 0x4000e00
2017-06-28 19:22:21.052: [    CSSD][1075976512]clssgmJoinGrock: ignoring grock join for client not requiring fencing until group information has been received from the master; group name CRF-, member number -1, flags 0x4000e00
2017-06-28 19:22:21.052: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x230b
2017-06-28 19:22:21.052: [    CSSD][1075976512]clssgmDeadProc: proc 0x2aaab01d35a0
2017-06-28 19:22:21.053: [    CSSD][1075976512]clssgmDestroyProc: cleaning up proc(0x2aaab01d35a0) con(0x22dc) skgpid  ospid 21518 with 0 clients, refcount 0
2017-06-28 19:22:21.053: [    CSSD][1075976512]clssgmDiscEndpcl: gipcDestroy 0x22dc
2017-06-28 19:22:21.889: [    CSSD][1085192512]clssgmWaitOnEventValue: after CmInfo State  val 3, eval 1 waited 0
