Adcfgclone failing

[latifa]

Hello Erman,

I ma facing an issue while cloning. The error message is:

Starting an edit session ...
Started edit session, please be sure to save and activate your
changes once you are done.

.end std out.
Problem invoking WLST - Traceback (innermost last):
  File "/opt/application/V12/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetAppsLibsTarget.py", line 909, in ?
  File "/opt/application/V12/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetAppsLibsTarget.py", line 705, in setNodeManagerCredentials
java.lang.AssertionError: java.lang.reflect.InvocationTargetException
        at weblogic.descriptor.DescriptorManager$SecurityServiceImpl$SecurityProxy._invokeServiceMethod(DescriptorManager.java:175)
        at weblogic.descriptor.DescriptorManager$SecurityServiceImpl$SecurityProxy.decrypt(DescriptorManager.java:192)
        at weblogic.descriptor.DescriptorManager$SecurityServiceImpl.decrypt(DescriptorManager.java:114)
        at weblogic.descriptor.internal.AbstractDescriptorBean._decrypt(AbstractDescriptorBean.java:1191)
        at weblogic.management.configuration.SecurityConfigurationMBeanImpl.getNodeManagerPassword(SecurityConfigurationMBeanImpl.java:1180)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at weblogic.management.jmx.modelmbean.WLSModelMBean.getAttribute(WLSModelMBean.java:525)
        at weblogic.management.jmx.modelmbean.WLSModelMBean.setAttribute(WLSModelMBean.java:630)
        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.setAttribute(DefaultMBeanServerInterceptor.java:746)
        at com.sun.jmx.mbeanserver.JmxMBeanServer.setAttribute(JmxMBeanServer.java:739)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$14.run(WLSMBeanServerInterceptorBase.java:378)
        at java.security.AccessController.doPrivileged(Native Method)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.setAttribute(WLSMBeanServerInterceptorBase.java:376)
        at weblogic.management.mbeanservers.internal.JMXContextInterceptor.setAttribute(JMXContextInterceptor.java:228)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$14.run(WLSMBeanServerInterceptorBase.java:378)
        at java.security.AccessController.doPrivileged(Native Method)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.setAttribute(WLSMBeanServerInterceptorBase.java:376)
        at weblogic.management.mbeanservers.edit.internal.RecordingInterceptor.setAttribute(RecordingInterceptor.java:130)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$14.run(WLSMBeanServerInterceptorBase.java:378)
        at java.security.AccessController.doPrivileged(Native Method)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.setAttribute(WLSMBeanServerInterceptorBase.java:376)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$14.run(WLSMBeanServerInterceptorBase.java:378)
        at java.security.AccessController.doPrivileged(Native Method)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.setAttribute(WLSMBeanServerInterceptorBase.java:376)
        at weblogic.management.mbeanservers.edit.internal.EditLockInterceptor.setAttribute(EditLockInterceptor.java:95)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$14.run(WLSMBeanServerInterceptorBase.java:378)
        at java.security.AccessController.doPrivileged(Native Method)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.setAttribute(WLSMBeanServerInterceptorBase.java:376)
        at weblogic.management.mbeanservers.internal.SecurityInterceptor.setAttribute(SecurityInterceptor.java:359)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServer.setAttribute(WLSMBeanServer.java:303)
        at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder$9$1.run(JMXConnectorSubjectForwarder.java:551)
        at java.security.AccessController.doPrivileged(Native Method)
        at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder$9.run(JMXConnectorSubjectForwarder.java:549)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
        at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder.setAttribute(JMXConnectorSubjectForwarder.java:544)
        at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1511)
        at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:97)
        at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1329)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1428)
        at javax.management.remote.rmi.RMIConnectionImpl.setAttribute(RMIConnectionImpl.java:743)
        at javax.management.remote.rmi.RMIConnectionImpl_WLSkel.invoke(Unknown Source)
        at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:667)
        at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:522)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
        at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:518)
        at weblogic.rmi.internal.wls.WLSExecuteRequest.run(WLSExecuteRequest.java:118)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:263)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at weblogic.descriptor.DescriptorManager$SecurityServiceImpl$SecurityProxy._invokeServiceMethod(DescriptorManager.java:173)
        ... 52 more
Caused by: weblogic.security.internal.encryption.EncryptionServiceException
        at weblogic.security.internal.encryption.JSafeEncryptionServiceImpl.decryptBytes(JSafeEncryptionServiceImpl.java:139)
        at weblogic.security.internal.encryption.JSafeEncryptionServiceImpl.decryptString(JSafeEncryptionServiceImpl.java:187)
        at weblogic.security.internal.encryption.ClearOrEncryptedService.decrypt(ClearOrEncryptedService.java:96)
        ... 57 more

java.lang.AssertionError: java.lang.AssertionError: java.lang.reflect.InvocationTargetException


.end err out.

Script Executed in 10905 milliseconds, returning status 1
ERROR: Failed to execute /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/adPostDomainCloneCfg.pl



Any idea on what's happening ? Thank you in advance for your help.

Best Regards,
Latifa

[ErmanArslansOracleBlog]

Gathered info:
1)
Script Executed in 10905 milliseconds, returning status 1
ERROR: Failed to execute /opt/application/V12/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/adPostDomainCloneCfg.pl

2)
Caused by: weblogic.security.internal.encryption.EncryptionServiceException
        at weblogic.security.internal.encryption.JSafeEncryptionServiceImpl.decryptBytes(JSafeEncryptionServiceImpl.java:139)
        at weblogic.security.internal.encryption.JSafeEncryptionServiceImpl.decryptString(JSafeEncryptionServiceImpl.java:187)
        at weblogic.security.internal.encryption.ClearOrEncryptedService.decrypt(ClearOrEncryptedService.java:96)
        ... 57 more

[ErmanArslansOracleBlog]

Hi Latifa,

Similar issue addresssed in  MOS note -> "12.2 E-Business Suite Fsclone Attempts Fail After An Upgrade With Error 'weblogic.security.internal.encryption.EncryptionServiceException' 'in setNodeManagerCredentials java.lang.AssertionError' Running adPostDomainCloneCfg.pl (Doc ID 2232990.1)"

However; your error stack is a little bit different and it look similar to the following MOS notes ->

Weblogic Managed Server Fails To Start With Lang.AssertionError: Java.lang.reflect.InvocationTargetException (Doc ID 2035279.1)
        WLS Managed Server Failing to Start with "java.lang.AssertionError: Java.lang.reflect.InvocationTargetException" (Doc ID 2399965.1)

It just can not decrypt the password....

[ErmanArslansOracleBlog]

When did this issue start?
Did you cloned this instance earlier or is it the first time?

A manual intervention to the clone may be required in this case...

[latifa]

Hi Erman,

I started cloning a test environment from a production environment bundle.
This is cloning the master server.

It's sticking in :

Set Nodemanager credentials
==============================
Location changed to edit tree. This is a writable tree with
DomainMBean as the root. To make changes you will need to start
an edit session via startEdit().

For more help, use help(edit)

Starting an edit session ...
Started edit session, please be sure to save and activate your
changes once you are done.

.end std out.
Problem invoking WLST - Traceback (innermost last):
  File "/opt/application/V12/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetAppsLibsTarget.py", line 909, in ?
  File "/opt/application/V12/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkSetAppsLibsTarget.py", line 705, in setNodeManagerCredentials
java.lang.AssertionError: java.lang.reflect.InvocationTargetException

……

It looks like can't use the  startEdit() to do changes !!

It should be like this (cloning log file for another environment):
Set Nodemanager credentials
==============================
Location changed to edit tree. This is a writable tree with
DomainMBean as the root. To make changes you will need to start
an edit session via startEdit().

For more help, use help(edit)

Starting an edit session ...
Started edit session, please be sure to save and activate your
changes once you are done.
Activating all your changes, this may take a while ...
The edit lock associated with this edit session is released
once the activation is completed.
Activation completed
Edit session is cancelled successfully

Add ebs-forms to shared libs list
========================================

--> in this the cloning process continues to add ebs_forms … etc …

[latifa]

which manual intervetion should be done ?

By the way AdminServer is already staretd.

Also, cloning didn't finish so how can we continue after doing these changes ?

[ErmanArslansOracleBlog]

The manual interventions which you can derive from the MOS notes below;

Weblogic Managed Server Fails To Start With Lang.AssertionError: Java.lang.reflect.InvocationTargetException (Doc ID 2035279.1)
        WLS Managed Server Failing to Start with "java.lang.AssertionError: Java.lang.reflect.InvocationTargetException" (Doc ID 2399965.1)

Read the solution parts and think about implementing them in your EBS cloning process..

Also , ensure you have no lock in the primary weblogic console...

[latifa]

Hi Erman,

Thank you for your feedback.

In an previous case, we faced the almost same error and we forced updating credentials in WebLogic console. It works.

For this case we have done almsot the same but in the source server. We updated the credentials of WebLogic in the console. We have done an preclone and the tar of the EBSapps folder to clone the test environment server. It works fine :)

Actually we try, to add other servers but it's not finish getting errors I will put it in another topic message.

Thank you again for your assistance.

Regrads.

[ErmanArslansOracleBlog]

Cool :)