OEM 13c installation

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

OEM 13c installation

Roshan
Oracle DB 19c as repository DB
RHEL 8

OEM 13.5

Hello Erman,

while installing OEM 13.5, I encountered error below.

Oracle Enterprise Manager Cloud Control 13c Release 5
Copyright (c) 1996, 2021 Oracle Corporation.  All rights reserved.
Starting Oracle Management Server...
WebTier Could Not Be Started.
Error Occurred: WebTier Could Not Be Started.
Please check /u01/app/oracle/gc_inst/em/EMGC_OMS1/sysman/log/emctl.log for error details


/ojmisc.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jmx/jmxspi.jar:/u01/app/oracle/middleware/wlserver/modules/features/wlst.wls.classpath.jar:/u01/app/oracle/middleware/sysman/jlib/emConfig.jar
2022-12-23 16:00:14,194 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:14,195 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Initializing WebLogic Scripting Tool (WLST) ...
2022-12-23 16:00:14,195 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:21,832 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Welcome to WebLogic Server Administration Scripting Shell
2022-12-23 16:00:21,834 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:21,834 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Type help() for help on available commands
2022-12-23 16:00:21,834 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:21,847 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>OHS component name: ohs1
2022-12-23 16:00:21,848 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>is_admin_host is TRUE
2022-12-23 16:00:21,848 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>stop_all is TRUE
2022-12-23 16:00:21,848 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>servers_only is NONE
2022-12-23 16:00:21,848 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>nm_host is t24oraclebackup
2022-12-23 16:00:21,852 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>nm_port is 7403
2022-12-23 16:00:21,852 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>ms_name is EMGC_OMS1
2022-12-23 16:00:21,856 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>domain_home is /u01/app/oracle/gc_inst/user_projects/domains/GCDomain
2022-12-23 16:00:21,856 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>bip_only is NONE
2022-12-23 16:00:21,856 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>forced_flag is TRUE
2022-12-23 16:00:21,872 [Thread-1] INFO  commands.BaseCommand run.625 - <ERR>log4j:WARN No appenders could be found for logger (emctl.secure.oms.AdminCredsWalletUtil).
2022-12-23 16:00:21,872 [Thread-1] INFO  commands.BaseCommand run.625 - <ERR>log4j:WARN Please initialize the log4j system properly.
2022-12-23 16:00:21,873 [Thread-1] INFO  commands.BaseCommand run.625 - <ERR>log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
2022-12-23 16:00:22,113 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Connecting to Node Manager ...
2022-12-23 16:00:22,214 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT><Dec 23, 2022 4:00:22 PM EST> <Info> <Security> <BEA-090905> <Disabling the CryptoJ JCE Provider self-integrity check for better startup performance. To enable this check, specify -Dweblogic.security.allowCryptoJDefaultJCEVerification=true.>
2022-12-23 16:00:22,214 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT><Dec 23, 2022 4:00:22 PM EST> <Info> <Security> <BEA-090906> <Changing the default Random Number Generator in RSA CryptoJ from ECDRBG128 to HMACDRBG. To disable this change, specify -Dweblogic.security.allowCryptoJDefaultPRNG=true.>
2022-12-23 16:00:22,235 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT><Dec 23, 2022 4:00:22 PM EST> <Info> <Security> <BEA-090909> <Using the configured custom SSL Hostname Verifier implementation: weblogic.security.utils.SSLWLSHostnameVerifier$NullHostnameVerifier.>
2022-12-23 16:00:23,097 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Successfully Connected to Node Manager.
2022-12-23 16:00:23,098 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>status of node manager:
2022-12-23 16:00:23,098 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Currently connected to Node Manager to monitor the domain GCDomain.
2022-12-23 16:00:23,098 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>current status of OHS:
2022-12-23 16:00:23,102 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,103 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>FAILED
2022-12-23 16:00:23,103 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,103 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>new status of OHS:
2022-12-23 16:00:23,105 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,105 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>FAILED
2022-12-23 16:00:23,105 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,105 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>current status of EMGC_OMS1:
2022-12-23 16:00:23,106 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,106 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>RUNNING
2022-12-23 16:00:23,106 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,106 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Killing server EMGC_OMS1 ...
2022-12-23 16:00:23,708 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Successfully killed server EMGC_OMS1
2022-12-23 16:00:23,708 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>new status of EMGC_OMS1:
2022-12-23 16:00:23,709 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,709 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>SHUTDOWN
2022-12-23 16:00:23,709 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,709 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>wait until EMGC_OMS1 becomes SHUTDOWN
2022-12-23 16:00:23,710 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,710 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>SHUTDOWN
2022-12-23 16:00:23,710 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,710 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>current status of EMGC_ADMINSERVER:
2022-12-23 16:00:23,711 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,711 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>RUNNING
2022-12-23 16:00:23,711 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:23,712 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Killing server EMGC_ADMINSERVER ...
2022-12-23 16:00:24,172 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Successfully killed server EMGC_ADMINSERVER
2022-12-23 16:00:24,172 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>new status of EMGC_ADMINSERVER:
2022-12-23 16:00:24,173 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:24,174 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>SHUTDOWN
2022-12-23 16:00:24,174 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:24,174 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>wait until EMGC_ADMINSERVER becomes SHUTDOWN
2022-12-23 16:00:24,175 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:24,175 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>SHUTDOWN
2022-12-23 16:00:24,175 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:24,175 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Stopped Node Manager Process successfully
2022-12-23 16:00:24,176 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>OHS status: FAILED
2022-12-23 16:00:24,176 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>OHS stop code: 100
2022-12-23 16:00:24,176 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>Not connected to Node Manager
2022-12-23 16:00:24,176 [Thread-0] INFO  commands.BaseCommand run.625 - <OUT>_END_
2022-12-23 16:00:24,176 [Thread-1] INFO  commands.BaseCommand run.625 - <ERR>_END_
2022-12-23 16:00:24,233 [main] ERROR commands.BaseCommand logAndPrint.671 - WebTier Could Not Be Stopped
2022-12-23 16:00:24,234 [main] INFO  commands.BaseCommand logAndPrint.673 - Oracle Management Server Successfully Stopped
2022-12-23 16:00:24,234 [main] ERROR commands.BaseCommand logAndPrint.671 - AdminServer Failed to be Stopped
Check Admin Server log file for details: /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/EMGC_ADMINSERVER/logs/EMGC_ADMINSERVER.out
2022-12-23 16:00:24,235 [main] INFO  commands.StopCommand stopOMS.525 - stopOMS finished with result: 100
2022-12-23 16:00:24,585 [main] INFO  commands.BaseCommand logAndPrint.673 - Oracle Management Server is Down
2022-12-23 16:00:24,597 [main] INFO  commands.BaseCommand printMessage.429 - statusOMS finished with result: 8
2022-12-23 16:00:24,600 [main] INFO  ctrl_extn.EmctlCtrlExtnLoader logp.251 - Extensions found: 1
2022-12-23 16:00:24,601 [main] INFO  ctrl_extn.EmctlCtrlExtnLoader logp.251 - Executing callback for extensible_sample
2022-12-23 16:00:24,601 [main] INFO  ctrl_extn.EmctlCtrlExtnLoader logp.251 - jar is /u01/app/oracle/middleware/plugins/oracle.sysman.emas.oms.plugin_13.5.1.0.0/archives/jvmd/em-engines-emctl.jar; class is oracle.sysman.emctl.jvmd.JVMDEmctlStatusImpl
2022-12-23 16:00:24,614 [main] INFO  ctrl_extn.EmctlCtrlExtnLoader logp.251 - Connection refused (Connection refused)
2022-12-23 16:00:24,614 [main] INFO  ctrl_extn.EmctlCtrlExtnLoader logp.251 - rsp is 1 message is JVMD Engine is Down
2022-12-23 16:00:24,614 [main] INFO  commands.BaseCommand printMessage.442 - extensible_sample rsp is 1 message is JVMD Engine is Down
2022-12-23 16:00:24,614 [main] INFO  commands.BaseCommand logAndPrint.673 - JVMD Engine is Down
2022-12-23 16:00:40,048 [main] INFO  wls.OMSController main.225 - Executing emctl command : start
2022-12-23 16:00:40,439 [main] INFO  commands.BaseCommand getEnvProps.513 - WLST_EXT_CLASSPATH is : :/u01/app/oracle/middleware/sysman/jlib/emagentSDK.jar:/u01/app/oracle/middleware/sysman/jlib/emcoreAgent.jar:/u01/app/oracle/middleware/sysman/jlib/emCORE.jar:/u01/app/oracle/middleware/oracle_common/modules/com.bea.core.apache.log4j.jar:/u01/app/oracle/middleware/jlib/emConfigInstall.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jdbc/ojdbc8.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jdbc/ojdbc8dms.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.dms/dms.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.odl/ojdl.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.xdk/xmlparserv2.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.xdk/xml.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.nlsrtl/orai18n.jar:/u01/app/oracle/middleware/oracle_common/modules/com.oracle.http_client.http_client.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.pki/oraclepki.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.osdt/osdt_cert.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.osdt/osdt_core.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jps/jps-mbeans.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jps/jps-api.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.ldap/ojmisc.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jmx/jmxspi.jar:/u01/app/oracle/middleware/wlserver/modules/features/wlst.wls.classpath.jar:/u01/app/oracle/middleware/sysman/jlib/emConfig.jar
2022-12-23 16:00:40,850 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:40,850 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Initializing WebLogic Scripting Tool (WLST) ...
2022-12-23 16:00:40,851 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:47,470 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Welcome to WebLogic Server Administration Scripting Shell
2022-12-23 16:00:47,470 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:47,471 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Type help() for help on available commands
2022-12-23 16:00:47,471 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:47,531 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>nm home is /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/nodemanager
2022-12-23 16:00:47,531 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>OHS component name: ohs1
2022-12-23 16:00:47,532 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>bip_only_start = NONE
2022-12-23 16:00:47,532 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>is_admin_host is TRUE
2022-12-23 16:00:47,532 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>admin_start is FALSE
2022-12-23 16:00:47,532 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>admin_only_start is NONE
2022-12-23 16:00:47,532 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>oms_only_start is FALSE
2022-12-23 16:00:47,532 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>ohs_start is TRUE
2022-12-23 16:00:47,554 [Thread-2] INFO  commands.BaseCommand run.625 - <ERR>log4j:WARN No appenders could be found for logger (emctl.secure.oms.AdminCredsWalletUtil).
2022-12-23 16:00:47,554 [Thread-2] INFO  commands.BaseCommand run.625 - <ERR>log4j:WARN Please initialize the log4j system properly.
2022-12-23 16:00:47,554 [Thread-2] INFO  commands.BaseCommand run.625 - <ERR>log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
2022-12-23 16:00:47,774 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Connecting to Node Manager ...
2022-12-23 16:00:47,860 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT><Dec 23, 2022 4:00:47 PM EST> <Info> <Security> <BEA-090905> <Disabling the CryptoJ JCE Provider self-integrity check for better startup performance. To enable this check, specify -Dweblogic.security.allowCryptoJDefaultJCEVerification=true.>
2022-12-23 16:00:47,860 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT><Dec 23, 2022 4:00:47 PM EST> <Info> <Security> <BEA-090906> <Changing the default Random Number Generator in RSA CryptoJ from ECDRBG128 to HMACDRBG. To disable this change, specify -Dweblogic.security.allowCryptoJDefaultPRNG=true.>
2022-12-23 16:00:47,879 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT><Dec 23, 2022 4:00:47 PM EST> <Info> <Security> <BEA-090909> <Using the configured custom SSL Hostname Verifier implementation: weblogic.security.utils.SSLWLSHostnameVerifier$NullHostnameVerifier.>
2022-12-23 16:00:48,505 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>This Exception occurred at Fri Dec 23 16:00:48 EST 2022.
2022-12-23 16:00:48,506 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>weblogic.nodemanager.NMConnectException: Connection refused (Connection refused). Could not connect to NodeManager. Check that it is running at t24oraclebackup/10.10.10.10:7403.
2022-12-23 16:00:48,506 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Attempt to connect to nm failed. Trying to start it...
2022-12-23 16:00:48,506 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>status of node manager:
2022-12-23 16:00:48,506 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Not connected to Node Manager
2022-12-23 16:00:48,515 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Launching NodeManager ...
2022-12-23 16:00:48,516 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Running startNodeManager.sh from the directory /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/bin
2022-12-23 16:00:48,603 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: + /u01/app/oracle/middleware/oracle_common/jdk/bin/java -Djava.security.egd=file:///dev/./urandom -Dweblogic.security.SSL.enableJSSE=true -server -Xms32m -Xmx200m -Djdk.tls.ephemeralDHKeySize=2048 -Dcoherence.home=/u01/app/oracle/middleware/wlserver/../coherence -Dbea.home=/u01/app/oracle/middleware/wlserver/.. -Dohs.product.home=/u01/app/oracle/middleware/ohs -DListenAddress=t24oraclebackup -DNodeManagerHome=/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/nodemanager -DStartScriptName=startEMServer.sh -DStartScriptEnabled=true -DUseKSSForDemo=false -DQuitEnabled=true -DListenPort=7403 -Dweblogic.RootDirectory=/u01/app/oracle/gc_inst/user_projects/domains/GCDomain -Doracle.security.jps.config=/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/config/fmwconfig/jps-config-jse.xml -Dcommon.components.home=/u01/app/oracle/middleware/oracle_common -Dopss.version=12.2.1.3 -Dweblogic.RootDirectory=/u01/app/oracle/gc_inst/user_projects/domains/GCDomain -Djava.system.class.loader=com.oracle.classloader.weblogic.LaunchClassLoader -Djava.security.policy=/u01/app/oracle/middleware/wlserver/server/lib/weblogic.policy -Dweblogic.nodemanager.JavaHome=/u01/app/oracle/middleware/oracle_common/jdk weblogic.NodeManager -v
2022-12-23 16:00:48,603 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: NODEMGR_HOME is already set to /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/nodemanager
2022-12-23 16:00:48,603 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: CLASSPATH=/u01/app/oracle/middleware/oracle_common/jdk/lib/tools.jar:/u01/app/oracle/middleware/wlserver/server/lib/weblogic.jar:/u01/app/oracle/middleware/wlserver/../oracle_common/modules/thirdparty/ant-contrib-1.0b3.jar:/u01/app/oracle/middleware/wlserver/modules/features/oracle.wls.common.nodemanager.jar::/u01/app/oracle/middleware/sysman/jlib/emagentSDK.jar:/u01/app/oracle/middleware/sysman/jlib/emcoreAgent.jar:/u01/app/oracle/middleware/sysman/jlib/emCORE.jar:/u01/app/oracle/middleware/oracle_common/modules/com.bea.core.apache.log4j.jar:/u01/app/oracle/middleware/jlib/emConfigInstall.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jdbc/ojdbc8.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jdbc/ojdbc8dms.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.dms/dms.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.odl/ojdl.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.xdk/xmlparserv2.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.xdk/xml.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.nlsrtl/orai18n.jar:/u01/app/oracle/middleware/oracle_common/modules/com.oracle.http_client.http_client.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.pki/oraclepki.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.osdt/osdt_cert.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.osdt/osdt_core.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jps/jps-mbeans.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jps/jps-api.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.ldap/ojmisc.jar:/u01/app/oracle/middleware/oracle_common/modules/oracle.jmx/jmxspi.jar:/u01/app/oracle/middleware/wlserver/modules/features/wlst.wls.classpath.jar:/u01/app/oracle/middleware/sysman/jlib/emConfig.jar:/u01/app/oracle/middleware/oracle_common/jdk/lib/tools.jar:/u01/app/oracle/middleware/oracle_common/modules/features/cieCfg_cam_lib.jar:/u01/app/oracle/middleware/wlserver/modules/features/wlst.wls.classpath.jar:/u01/app/oracle/middleware/wlserver/..:/u01/app/oracle/middleware/wlserver/modules/features/oracle.wls.common.grizzly.jar
2022-12-23 16:00:49,866 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:49 PM EST> <INFO> <Loading domains file: /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/nodemanager/nodemanager.domains>
2022-12-23 16:00:50,188 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:50 PM EST> <INFO> <Loading identity key store: FileName=/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/security/DemoIdentity.jks, Type=jks, PassPhraseUsed=true>
2022-12-23 16:00:50,194 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:50 PM EST> <INFO> <Loaded NodeManager configuration properties from '/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/nodemanager/nodemanager.properties'>
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Node manager v12.2.1.4.0
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess:
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Configuration settings:
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess:
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: DomainsFile=/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/nodemanager/nodemanager.domains
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: LogLimit=0
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: DomainsDirRemoteSharingEnabled=false
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: AuthenticationEnabled=true
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: LogLevel=INFO
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: DomainsFileEnabled=true
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: ListenAddress=t24oraclebackup
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: NativeVersionEnabled=true
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: ProcessDestroyTimeout=20000
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: ListenPort=7403
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: LogToStderr=true
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: weblogic.StartScriptName=startEMServer.sh
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: SecureListener=true
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: LogCount=1
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: QuitEnabled=true
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: LogAppend=true
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: weblogic.StopScriptEnabled=false
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: StateCheckInterval=500
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: CrashRecoveryEnabled=false
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: weblogic.StartScriptEnabled=true
2022-12-23 16:00:50,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: LogFile=/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/nodemanager/nodemanager.log
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: LogFormatter=weblogic.nodemanager.server.LogFormatter
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: coherence.StartScriptEnabled=false
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: ListenBacklog=50
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: NodeManagerHome=/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/nodemanager
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: RestEnabled=false
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: isLogLockingEnabled=true
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: weblogic.startup.JavaHome=/u01/app/oracle/middleware/oracle_common/jdk
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: weblogic.startup.MW_Home=
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: coherence.startup.JavaHome=/u01/app/oracle/middleware/oracle_common/jdk
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: coherence.startup.MW_Home=
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess:
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Domain name mappings:
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess:
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: GCDomain -> /u01/app/oracle/gc_inst/user_projects/domains/GCDomain
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess:
2022-12-23 16:00:50,196 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:50 PM EST> <INFO> <12.2.1.4.0>
2022-12-23 16:00:50,243 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:50 PM EST> <INFO> <GCDomain> <EMGC_OMS1> <Startup configuration properties loaded from "/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/data/nodemanager/startup.properties">
2022-12-23 16:00:50,353 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Dec 23, 2022 4:00:50 PM oracle.ohs.plugin.nodemanager.OhsDomain <init>
2022-12-23 16:00:50,353 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: INFO: Domain initialized for /u01/app/oracle/gc_inst/user_projects/domains/GCDomain
2022-12-23 16:00:50,367 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:50 PM EST> <INFO> <GCDomain> <ohs1> <Adjusted state of server 'ohs1 ' from FAILED to FAILED_NOT_RESTARTABLE>
2022-12-23 16:00:50,367 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:50 PM EST> <INFO> <Server Implementation Class: weblogic.nodemanager.server.NMServer$ClassicServer.>
2022-12-23 16:00:50,485 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:50 PM EST> <INFO> <Secure socket listener started on port 7403, host t24oraclebackup/10.10.10.10>
2022-12-23 16:00:58,537 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>The Node Manager is launched.
2022-12-23 16:00:58,538 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>The Node Manager process is running independent of the WLST process.
2022-12-23 16:00:58,538 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Exiting WLST will not stop the Node Manager process. Please refer to the Node Manager logs for more information.
2022-12-23 16:00:58,538 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>The Node Manager logs will be under /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/nodemanager
2022-12-23 16:00:58,538 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Launching Node Manager is completed.
2022-12-23 16:00:58,538 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Connecting to Node Manager ...
2022-12-23 16:00:58,776 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Successfully Connected to Node Manager.
2022-12-23 16:00:58,777 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Currently connected to Node Manager to monitor the domain GCDomain.
2022-12-23 16:00:58,778 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>current status of EMGC_ADMINSERVER:
2022-12-23 16:00:58,781 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:58,781 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>SHUTDOWN
2022-12-23 16:00:58,781 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:00:58,782 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Starting server EMGC_ADMINSERVER
2022-12-23 16:00:58,782 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Starting server EMGC_ADMINSERVER ...
2022-12-23 16:00:58,785 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:58 PM EST> <WARNING> <GCDomain> <EMGC_ADMINSERVER> <Startup config file /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/EMGC_ADMINSERVER/data/nodemanager/startup.properties for server 'EMGC_ADMINSERVER' does not exist, and startup config properties are not specified when invoking start command. Node Manager will try its best to start the server using default configurations which may not fit and may lead to startup failure.>
2022-12-23 16:00:58,785 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:58 PM EST> <INFO> <GCDomain> <EMGC_ADMINSERVER> <Rotated server output log to "/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/EMGC_ADMINSERVER/logs/EMGC_ADMINSERVER.out00004">
2022-12-23 16:00:58,786 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:58 PM EST> <INFO> <GCDomain> <EMGC_ADMINSERVER> <Server error log also redirected to server log>
2022-12-23 16:00:58,786 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:58 PM EST> <INFO> <GCDomain> <EMGC_ADMINSERVER> <Starting WebLogic server with command line: /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/bin/startEMServer.sh >
2022-12-23 16:00:58,796 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:58 PM EST> <INFO> <GCDomain> <EMGC_ADMINSERVER> <Working directory is '/u01/app/oracle/gc_inst/user_projects/domains/GCDomain'>
2022-12-23 16:00:58,796 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:00:58 PM EST> <INFO> <GCDomain> <EMGC_ADMINSERVER> <Server output log file is '/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/EMGC_ADMINSERVER/logs/EMGC_ADMINSERVER.out'>
2022-12-23 16:01:47,397 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:01:47 PM EST> <INFO> <GCDomain> <EMGC_ADMINSERVER> <The server 'EMGC_ADMINSERVER' is running now.>
2022-12-23 16:01:47,399 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Successfully started server EMGC_ADMINSERVER ...
2022-12-23 16:01:47,399 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>new status of EMGC_ADMINSERVER:
2022-12-23 16:01:47,401 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:01:47,401 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>RUNNING
2022-12-23 16:01:47,401 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:01:47,401 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>wait until EMGC_ADMINSERVER becomes RUNNING
2022-12-23 16:01:47,402 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:01:47,402 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>RUNNING
2022-12-23 16:01:47,402 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:01:47,402 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>current status of EMGC_OMS1:
2022-12-23 16:01:47,403 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:01:47,403 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>SHUTDOWN
2022-12-23 16:01:47,403 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:01:47,403 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Starting server EMGC_OMS1
2022-12-23 16:01:47,403 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Starting server EMGC_OMS1 ...
2022-12-23 16:01:47,406 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:01:47 PM EST> <INFO> <GCDomain> <EMGC_OMS1> <Starting WebLogic server with command line: /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/bin/startEMServer.sh >
2022-12-23 16:01:47,415 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:01:47 PM EST> <INFO> <GCDomain> <EMGC_OMS1> <Working directory is '/u01/app/oracle/gc_inst/user_projects/domains/GCDomain'>
2022-12-23 16:01:47,415 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:01:47 PM EST> <INFO> <GCDomain> <EMGC_OMS1> <Server output log file is '/u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/EMGC_OMS1/logs/EMGC_OMS1.out'>
2022-12-23 16:04:23,620 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:04:23 PM EST> <INFO> <GCDomain> <EMGC_OMS1> <The server 'EMGC_OMS1' is running now.>
2022-12-23 16:04:23,621 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Successfully started server EMGC_OMS1 ...
2022-12-23 16:04:23,625 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>new status of EMGC_OMS1:
2022-12-23 16:04:23,625 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:04:23,625 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>RUNNING
2022-12-23 16:04:23,625 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:04:23,625 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>wait until EMGC_OMS1 becomes RUNNING
2022-12-23 16:04:23,633 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>RUNNING
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Killing OHS, ignore errors:
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Killing server ohs1 ...
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>This Exception occurred at Fri Dec 23 16:04:23 EST 2022.
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>weblogic.nodemanager.NMException: Received error message from Node Manager Server: [OHS Server 'ohs1' is not currently running]. Please check Node Manager log for details.
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Ignoring exception when stopping the OHS:  main.WLSTException  value:  Error occurred while performing nmKill : Error killing server ohs1 : Received error message from Node Manager Server: [OHS Server 'ohs1' is not currently running]. Please check Node Manager log for details.
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Use dumpStack() to view the full stacktrace :
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>starting OHS:
2022-12-23 16:04:23,638 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Starting server ohs1 ...
2022-12-23 16:04:23,654 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Dec 23, 2022 4:04:23 PM oracle.ohs.plugin.nodemanager.OhsProcessManagementPlugin$ProcessImpl start
2022-12-23 16:04:23,654 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: INFO: Starting server ohs1
2022-12-23 16:04:23,658 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Dec 23, 2022 4:04:23 PM oracle.ohs.plugin.nodemanager.OhsRunCommand execute
2022-12-23 16:04:23,658 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: INFO: Running /u01/app/oracle/middleware/ohs/bin/launch httpd -DOHS_MPM_WORKER -d /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/config/fmwconfig/components/OHS/instances/ohs1 -k start -f /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/config/fmwconfig/components/OHS/instances/ohs1/httpd.conf
2022-12-23 16:04:23,675 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Dec 23, 2022 4:04:23 PM oracle.ohs.plugin.nodemanager.OhsRunCommand runGeneric
2022-12-23 16:04:23,675 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: INFO: /u01/app/oracle/middleware/ohs/bin/httpd: error while loading shared libraries: libclntshcore.so.12.1: cannot open shared object file: No such file or directory
2022-12-23 16:04:24,192 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Dec 23, 2022 4:04:24 PM oracle.ohs.plugin.nodemanager.OhsRunCommand execute
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: SEVERE: /u01/app/oracle/middleware/ohs/bin/launch httpd -DOHS_MPM_WORKER -d /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/config/fmwconfig/components/OHS/instances/ohs1 -k start -f /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/config/fmwconfig/components/OHS/instances/ohs1/httpd.conf: exit status = 127
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Dec 23, 2022 4:04:24 PM oracle.ohs.plugin.nodemanager.OhsProcessHandler buildProcess
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: INFO: Check the instance log file for more information: /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/ohs1/logs/ohs1.log
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Dec 23, 2022 4:04:24 PM oracle.ohs.plugin.nodemanager.OhsProcessManagementPlugin$ProcessImpl buildIoException
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: SEVERE: Failed to start the server ohs1
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: <Dec 23, 2022 4:04:24 PM EST> <WARNING> <Server start command for OHS server 'ohs1' failed due to: [Failed to start the server ohs1
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>NMProcess: Check log file /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/system_components/OHS/ohs_nm.log]. Please check Node Manager log and/or server 'ohs1' log for detailed information.>
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>This Exception occurred at Fri Dec 23 16:04:24 EST 2022.
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>weblogic.nodemanager.NMException: Received error message from Node Manager Server: [Server start command for OHS server 'ohs1' failed due to: [Failed to start the server ohs1
2022-12-23 16:04:24,193 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Check log file /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/system_components/OHS/ohs_nm.log]. Please check Node Manager log and/or server 'ohs1' log for detailed information.]. Please check Node Manager log for details.
2022-12-23 16:04:24,194 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Failed to start OHS component namedohs1
2022-12-23 16:04:24,194 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Exception while starting OHS:  main.WLSTException  value:  Error occurred while performing nmStart : Error Starting server ohs1 : Received error message from Node Manager Server: [Server start command for OHS server 'ohs1' failed due to: [Failed to start the server ohs1
2022-12-23 16:04:24,194 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Check log file /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/system_components/OHS/ohs_nm.log]. Please check Node Manager log and/or server 'ohs1' log for detailed information.]. Please check Node Manager log for details.
2022-12-23 16:04:24,194 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Use dumpStack() to view the full stacktrace :
2022-12-23 16:04:24,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>status of node manager:
2022-12-23 16:04:24,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Currently connected to Node Manager to monitor the domain GCDomain.
2022-12-23 16:04:24,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>1
2022-12-23 16:04:24,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>Successfully disconnected from Node Manager.
2022-12-23 16:04:24,195 [Thread-1] INFO  commands.BaseCommand run.625 - <OUT>_END_
2022-12-23 16:04:24,196 [Thread-2] INFO  commands.BaseCommand run.625 - <ERR>_END_
2022-12-23 16:04:24,578 [main] ERROR commands.BaseCommand logAndPrint.671 - WebTier Could Not Be Started.
2022-12-23 16:04:24,579 [main] ERROR wls.OMSController main.258 - OMSController failed for start oms
2022-12-23 16:04:24,580 [main] ERROR wls.OMSController main.259 - OMSController Error: WebTier Could Not Be Started.
java.lang.Exception: WebTier Could Not Be Started.
        at oracle.sysman.emctl.commands.StartCommand.startOMS(StartCommand.java:387)
        at oracle.sysman.emctl.commands.StartCommand.execute(StartCommand.java:239)
        at oracle.sysman.emctl.wls.OMSController.main(OMSController.java:239)
[oracle@t24oraclebackup bin]$



ADMIn server log is shown below
0080: 2A 8D 43 B7 9B 27 93 E4   5F 52 5D 18 47 56 45 20  *.C..'.._R].GVE
0090: CD B5 C8 85 DD 0E C3 AB   84 AE FE DF 6E 69 4F A7  ............niO.
00A0: A3 1F D8 DD 6C 16 59 E8   62 7D 3C EE 79 35 05 D7  ....l.Y.b.<.y5..
00B0: 0C 77 65 8A 90 47 3F 58   11 4F 32 3E 55 F0 2B E9  .we..G?X.O2>U.+.
00C0: 10 45 2C 2D 6E A8 41 BF   4B D8 EA 88 82 D5 AD A8  .E,-n.A.K.......
00D0: 61 8F 31 47 A5 11 17 18   63 99 DD CA 54 97 9F FC  a.1G....c...T...
00E0: 50 BE C8 CB C7 49 28 36   A7 8C 0D 74 B8 14 AC 18  P....I(6...t....
00F0: 29 D5 F9 40 6A AA 5B 58   87 3D C4 AF 37 C8 B2 CE  )..@j.[X.=..7...

] The system is vulnerable to security attacks, since the server private key is available to the public.>
####<Dec 23, 2022 4:04:16,255 PM EST> <Warning> <JMX> <t24oraclebackup> <EMGC_ADMINSERVER> <[ACTIVE] ExecuteThread: '39' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <0b95f966-2a0b-405f-b7a5-ec945bcd9f3f-0000005b> <1671829456255> <[severity-value: 16] [rid: 0] [partition-id: 0] [partition-name: DOMAIN] > <BEA-149504> <The Administration Server was unable to establish JMX Connectivity with the EMGC_OMS1 at the JMX Service URL of service:jmx:t3s://10.10.10.10:7301/jndi/weblogic.management.mbeanservers.runtime.>
####<Dec 23, 2022 4:04:16,267 PM EST> <Warning> <JMX> <t24oraclebackup> <EMGC_ADMINSERVER> <[ACTIVE] ExecuteThread: '39' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <0b95f966-2a0b-405f-b7a5-ec945bcd9f3f-0000005c> <1671829456267> <[severity-value: 16] [rid: 0] [partition-id: 0] [partition-name: DOMAIN] > <BEA-149504> <The Administration Server was unable to establish JMX Connectivity with the EMGC_OMS1 at the JMX Service URL of service:jmx:t3s://10.10.10.10:7301/jndi/weblogic.management.mbeanservers.runtime.>
####<Dec 23, 2022 4:04:21,795 PM EST> <Warning> <JMX> <t24oraclebackup> <EMGC_ADMINSERVER> <[ACTIVE] ExecuteThread: '39' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <0b95f966-2a0b-405f-b7a5-ec945bcd9f3f-0000005c> <1671829461795> <[severity-value: 16] [rid: 0] [partition-id: 0] [partition-name: DOMAIN] > <BEA-149504> <The Administration Server was unable to establish JMX Connectivity with the EMGC_OMS1 at the JMX Service URL of service:jmx:t3s://10.10.10.10:7301/jndi/weblogic.management.mbeanservers.runtime.>
####<Dec 23, 2022 4:04:28,168 PM EST> <Warning> <JMX> <t24oraclebackup> 
<EMGC_ADMINSERVER> <[ACTIVE] ExecuteThread: '39' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <0b95f966-2a0b-405f-b7a5-ec945bcd9f3f-0000005c> <1671829468168> <[severity-value: 16] [rid: 0] [partition-id: 0] [partition-name: DOMAIN] > <BEA-149506> <Established JMX Connectivity with EMGC_OMS1 at the JMX Service URL of service:jmx:t3s://10.10.10.10:7301/jndi/weblogic.management.mbeanservers.runtime.>

image706.png
Does it mean I have DNS issue? The hostname and Ip if VM is in hosts file.

Kindly advise..

Thanks,
Roshan
Reply | Threaded
Open this post in threaded view
|

Re: OEM 13c installation

Roshan
Hello Erman,

I checked the prerequisites. I applied latest CPU patch Oct 22 and it was fixed.
Reply | Threaded
Open this post in threaded view
|

Re: OEM 13c installation

ErmanArslansOracleBlog
Administrator
Just found time to check the issues, but it seems you got it fixed Roshan :)
Thanks for sharing..