Working...... Error in password verification for APPS

[Aejaz Ahmad]

Hello Erman,

Finally Oracle provided datafix for the issue .  i have attached the sql . they have registered this as bug and development is working on this . now after running this script i am able to change the password and i am able to login to system ,

i will keep you posted .

Thanks
Aejaz

[Aejaz Ahmad]

Hello Erman,

Finally oracle provide me sata fix for this issue . we nee dto run script with apps and provide username as sysadmin . after the script was run FNDCPASS was working fine, and forms are opening fine , now am applying the same patch which i mentioned earlier that oracle provided ,


SCRIPTS ----

REM dbdrv: none
REM WARNING: This Oracle proprietary code to ONLY be used with ATG Developer guidance.

WHENEVER SQLERROR EXIT FAILURE ROLLBACK;
WHENEVER OSERROR EXIT FAILURE ROLLBACK;

set serveroutput on size 100000
set heading off

select '$Header: WebSecFix.sql 119.0 2025/12/08 00:00:02 mskees fix $' from dual;

REM ======================================================================
REM ============== Spec Block
REM ======================================================================
CREATE OR REPLACE PACKAGE WebSecDebug AS
gIsDebug CONSTANT NUMBER := 0;
FUNCTION run (pAppsPwd IN VARCHAR2, pUser IN VARCHAR2, pUserPwd IN VARCHAR2)
 RETURN VARCHAR2;

END WebSecDebug;
/
REM ======================================================================
REM ============== Body Block
REM ======================================================================

CREATE OR REPLACE PACKAGE BODY
/* Created with WebSecDebugX.pls 119.4 2026/01/06 00:00:00 mskees fix */
WebSecDebug wrapped
a000000
369
abcd
abcd
abcd
abcd
abcd
abcd
abcd
abcd
abcd
abcd
abcd
abcd
abcd
abcd
abcd
b
357d 121f
lZVEWByn+Lbc1XcmJw1C3hOKXYkwgw26HiAFhfO76vhktD9XaX6UkM0E+ydJPhbAbAP3Whws
P11pL1/bzncDbDWJ8Tkutf7/0b6u0Wxsvp6+baL////knxmRZsYQwV9/q0AZHUVqajaYHBzJ
C10UsLCw569PzG9TJiw5hWpI5C9j7b/O+zr7RTLg/tT0lpKlefE4OvHw4G7JLVNntKjOWW5w
bvdz+e5oexa46ASTCi5/EsVblSNMsiLRwdblbs3fbc2cr0w6qD4KJy2j3G0BCFRIUdcn33Wc
A9ecgWH+ZAZefzDFp9DWkZiTViz4kkT9eZfNSAOikrIe7BFvlWtt7VbUpdcoJaMeh4muty3l
GK6iLAYtLGmU5POr+KEu+TmQjNI5sXgvm0DrFCgDIZcl++ScruSm/mnXJbzoolelqR063Lz0
kCZadild1K1yB2TR85NMjNn3it0r57Ro/yWhHNq/HbGhJXqyx2AZ73i4j0AcHHSQNp1Ffj+B
yNg5APy4uIYUeO0Un7MTxGJKpUyFF/4TPSmEouMyG0LAx0gF3+tu3k38zRlw/kwim4w2kcBA
tor6qyqrUAzwADfpQ1LFS32QT5AqWplnBLM9/bx5cuy7QU+dVLJimhWrrbc2uteTVZhXZsAq
Ib+4JRZGTkq2OneVBiH//A2iamHR5eILbhl7MRTwuXrgn5OsC/woGBfpQl0U+kwEEpIyVwN2
DitV/1+nDwsyE2pvxFf/pHJt+iBAMQw5iLClAOUfsDAy3h0wNd9Yd0YNU19ZZjRw2N19hJYT
cJEOyls48OGWl0CyJdJU3dhL3GJKt/E2qEllyBp2CtzRt89GjKt48BqoqQXcjmxdaUUwpr2z
Pyy9foZduXeEVfF3FggEXXu2RedKjc502oJGfSsOsai2wfWOcckV8RZdkgebUi2i6sFdW0aD
5Mc6qAe42s5UXUPCywrqcEzqls32w9HBsW6ZvMZIp6wtLrC0TqTO1DrJ9Cxf86IAN6pPBGN8
TJK3+kkVDuhlB+m9yWbmM9iRun5hfS1oGW+YsHnSQkgpnwxiE1M6HdtBfFoIEIMDhf9XUw2S
pyzMnm4Up/uvNq5LE2bu4UvHFvg2/v7MdtzzBHy0jAe20x+PNmzzcB1ashjDEmbyL4tBt3s6
FkemlGxLhQYQE+OQ4PG7rbIhZJpm2fqFPya7e6LFma3KNXYZRDGO7a2di2j1vtD3kM9HvbPl
l9ewwLeWi+cg3wqycAFrZA/Mm9k2xgiOMbGetq3FPsxNfxoehO6+hJ7N3cv0JT5g76xvhY7T
rTA+eA51fQ22RPesi9O6K9t9lgQlXMcsMKHeN0tLw3ZfdI5v7OE8qo/BqjtkD0KDibbxRvDo
TzhMb+lXufQ9YTRxNkjNz+kNFLweOPuTqjUez1vfDVZBDFD46rQEob2UP5O1oIU/i2MeUeUi
ZN/HLYlt76erKyudlME62E3OQeGYah6nCjyXOSQucQadaYkXLU8iXbOYCKlxEdwvEq2Raxxq
zH1HJ38xEfjFWM/pnmisTf+abkB2mbWvKlxkd6tNvdxGIIUT2GZkPYsFP3Oeq8QD1QQdgv3o
dS7uOliSTVewK0hJPsr9G95ot8PaByTfv9r0q3Qz7QbF1w/CpbuzTieHGCPM5bZwgjyIve74
4cMTEif2BRIBukKdEnkklenjU9sno8WHhZuhfN/L9HUmMkWbLIwrgyYrRa47YSKWzSBiC1S/
zh0BX92pb9EnXO8OEZUPlNpsJMjdAaXj0EN71lNEjXSB51ccr7zLHc3n4aTy201DYj3I69Km
BiLwG6LTJs1p+PdXmQ4oOIp3SNaFkVMa84NaGRPEsC4+2qiN4f9eLObCzqATyKG5W6H8NuJZ
yX18DrBqvRasyPe5NCmCixcXF2+6+/AwIkdgi5ScFzRLP2TSpjkZNAvgpGioFXyfdHqyRkae
B/N7hfcCoo1jN7hu7hR5zLnuMHc8YmOY51KfGmUw9Tao6ugTyBzaYwMaKsZ202x++gWhV3tZ
58u0K9lof6ypoCPWNNmN775BGx7nUKhMX223N86H0Ic/ZjicUu6BT1LavIhcqS+7SU5AIdmE
8/MUP/ya4Fww3MHxBCY6jPfRbbd8K6/K7asRw5rgRp2RVz995s0GWayycXvtrv4GEperPuiU
0IRwPt51toMc4zXi/vcqstYfQf4G+yJ9F/XHx1JCKoFkonIRfklWe9huQkMHVe/lEYzyQHCV
YeRCmDDRZPxh5hm6qc9pdnLvFVTNpr2Z4/SiUlebSTBn12sX9y/mBWVlGdZ7IJ2PhQ+sNNmT
9OEJJA9rD/fp6UOYZ0JAWSbnk8wtNyoFwNY8T+lzftyhG/YnXZ1qhAmGy6M2QGLtqCfFF0AR
bQoxY1crRxI5yJ4Sb6bNMF4kS5L1Gz3klafxm1vx70NwoqmgeVlvhO/G5TAco+kuDNGI5q2o
yNqc6DxcGMsmwrZ4faRqeoTSnjIU7j1fUzWYv3v7j8SuWJazvYS2xvhW3E6Yz9tn1UYjFWfE
a5uZXLwg5GvKLsVjg913/8tECmKrO5/Zvmz+iX4bmLY6qnLjDu3r4L4ZeRNr3UEmqaDXvmzX
HctPOcM2uTa/phnD+3luE1w24X/NJlLQLR3+1vqEIuxXXTFGjZOxTf3O1lcUQ16tBQmTLz6h
SjkLbHwfcGec3Si5gbo+9wzhTU7iOWVIrnMsDUM5cbwyTxfkIq4p01KwUviR5k7yIZSSuNi2
h4LdhkyTpDgn4ZqAMeg6Nlkn6TCo66K2ziM7aKv0uoxaqmVjb+dRf7ZwoTugCUwnCHbhfmrj
kM/R5o3DCuNiMA6zEzJC4mPfHruysgqOaUJHBlrhJLzUrhGMYDoIMQdYbPCD0wuY15NAUI5e
qZYgVRkTA5GM4vG+48g4xTaUa+AaFZqhFj3dg1LAiVphseI1uS21I9ETDmXFwwUl1BgmQRRm
6kM8CV+xfsbBp2XZjY/2yC9AtHs6p+e5SAM+nLrTshasju3oxbN8jYDcYjr1mSndw7kWKtkH
q9EEhmAwbwcj5I6SrJ1m1kC70H4viHhpd3cISC8X2uEZKCu6F5XYHoTQtDaB6E0/1cHI8HgD
CS7GgzwJwXQYoYL0QRxuJmXCiBFZsgZfSAITCHn1eILjGiR5qE9WZgFTheFamE+P/56ZkY/z
XroNeEwIMvJlZk//jne4Knpj3qcyY+8dQDEjy0zZCKEm+VrREDje4PSAIWD9mhdp24Gfww5h
rQ3PCxi324ixMnMi1SaNrOgXM5gR7wSWeWsasQzpllVC46PCUnafti5r6ySDeHTTdsEEfnBC
gyKWrWif6brSkir0pyCaZmwVQfzIIvZcXzAl7zUmG6okZwAeGfy6Xd5I5SIcjKDA40ZItLDt
gRQ2nYsmmHKjGxN2P1AYuIDA90VXFQrWk+rrzZYX1Wcg1NMbKTQu7S4tbowyzLouVXEDGWSQ
3YnJXaktJ50BXswUL98Sunpi9STYF7V+hVumj/iJVkFUFl9DHj9nOKBKMNEFVcFioVwtumTq
/WYCvluYoEcNtO4JFcNOJpTTmZdhiMTUlUrlCEXPntusQ20Yp/0Yrrx4IqNQPYqedmgn86pK
70KNVUwtHMsElwuTCJ3v8hbeFNE4/5yBOhZx0fBj6cDN/1J73z6gZx+y0ZYEiEn8J032f34J
2giwngLSXNSSwU5RI9FhA5pfXvTm9BDy/GlsmWzH8fUgiIl2wgE/+C1KvFv2qOVY9raIE9rf
wXm/RYu1Q2mMIHp3y+N1Mf3Ke/IzICZejjok95xuvKEd8DVL5k9aUGAKSeyiEXbER7YC5h7b
e/h6kVUc3vGS1nLtnxwQnJADLFYGpS9jsHYm7MgZVQBervzSXRq5ptzciUUPiL7MZe2KsWBC
3ezXu+d5sfW5kOkgt+riI1U0dcw15lXEqLEfDnut85Bn76lSRyPAwFH9X53YLtT0pRCk1CLx
+vxPtdxyqYK3E72PJQisXOuhaYeQ8DZWF2DOEqSONc++C7hqKXeuZGPhCZ8kYrTK34cf35H2
NZk+Q6TznCKWoWj9ejJ9+CF2DLPp1dzra0gDnhDR5asqo+0qMkErufbLn1bGuafu+He3afyP
CgAF6+gvcHrXc12o93y7prnOWlqkzM0NMYQ1m/XEWHQknD0LvGK17TuADV1cyIi99UKBYyMb
xEGx5+AcVAgHln0mTWFCVQwnsicENxClB7fvzmQxDB54amkghfodGXft820pz1gAiX6/+s4Z
rvYo4NU/rJfjRZETtHEcmBpmnfFFK7SFSCpow1SB5dq9tkf+PUlbkhJ/PM8Do4x5CPuXiLbi
JxI4dnp2BNqpTuYEyrWlqXrLMAjE2ZlOuFFqeBbLfd6B45fvGagqspigvjZ5844LHx18PdPX
W4bYsZSuA+pASWtQNEfJAVwQaACy0v87vcDC9ZJ1XRK/pK35Gg0PW02agog+0vSu/Sn0jiKF
ma1VhA8Nold7UNGnTT+b3JrR9pyZzUVT1ioa3ZqcCnIMw9eXAS2T2FDPzNcrT5curYDWr2cG
EOVIuMU4FdJDlkyVk6aa+ngpT1RMtSmqTBx3sA==

/
REM ======================================================================
REM ============== Exec Block
REM ======================================================================

DECLARE
    l_result        varchar2(100);
     -- User_Name
    l_UserName      varchar2(100) := '&User_Name';
    -- User_Password
    l_UserPassword  varchar2(100) := '&User_Password';
    l_Apps_Pwd      varchar2(100) := '&Apps_Pwd';
BEGIN

    FND_GLOBAL.APPS_INITIALIZE(0,20420,1);

    l_result := WebSecDebug.run(l_Apps_Pwd,l_UserName,l_UserPassword);
    dbms_output.put_line( 'WebSecDebug = ' || l_result );

END;
/

REM DROP PACKAGE WebSecDebug;

EXIT;

[ErmanArslansOracleBlog]

Good. It updates the FND_ORACLE_USERID table :)
decrypting and encrypting go on.
It seems to be fixing the entire chain, ending with a re-encrypted fresh password.

[Aejaz Ahmad]

Hello,

FNDCPASS is now working fine . the patch which they told me earlier is now causing issue in adop phase=cutover.

when i do adop phase=cutover i get
fndsvcrg.log ------

cannot complete application logon you may have entered an invalid application password or there may have been a database connect error . internal concurrent manager status could not be determined .

 I am searching if there is any possible issue .

Application login is working fine FNDCPASS is working fine ,

Thanks
Aejaz

[ErmanArslansOracleBlog]

the MOS note: "EBS Upgrade From 12.1.3 to 12.2.12 Fails at Adop Cutover with Internal Concurrent Manager status could not be determined" , KB757279 is describing the same exact thing.

Abother note -> ADOP Prepare Phase Fails With <Error determining status of Internal Concurrent Manager>, KB625894

I guess you can't abot the patching cycle at the moment right?

Which patch is that? please clarify.

When did you start this patching activity, after correcting those encrypted passwords and the whole chain using Oracle Support script, you started the prepare phase completed it successfully and the you applied the patches and now you are trying to cutover and failing, right? There may be the same issue remaining in the path fs / or lets say patch edition.. But lets clarify first. Send me the adop status and complete adop cutover logs .. Update your SR also

[Aejaz Ahmad]

Hello,

Yes I have applied the fix from oracle and they said to apply the patch  38207032, now patch is applied and finalize is done now on cutover i am getting the error .

i am able to login and change password .but  on cutover i am stuck .



The below patch is already applied .

the MOS note: "EBS Upgrade From 12.1.3 to 12.2.12 Fails at Adop Cutover with Internal Concurrent Manager status could not be determined" , KB757279 is describing the same exact thing.

for KB625894 i verified i dont have any issue everything is working


$FND_TOP/bin/FNDSVCRG STATUS

Working

$ adcmctl.sh status <apps_user>/<apps_password>

Also working


Thanks
Aejaz

[ErmanArslansOracleBlog]

Then your issue is either patch specific or adop utility (or cutover phase) specific. (it may also be an indirect issue, I mean the fix may not be in place in the patch fs or patch db edition.. this is a guess..)

Ensure you got all covered in the patch edition.. (apps password and all that -- working good there.)

+Send me the full adop log(s)

+And is that patch 38207032 publically available? -- a patch internal review may also help.. ( I mean the analysis of the files and instructions/scripts/codes in the patch directory)

[Aejaz Ahmad]

The patch was available until i downloaded after that i cant find the patch now on oracle support .


applstg@hostname:~$ adop phase=cutover

Enter the APPS password:
Enter the EBS_SYSTEM password:
Enter the WLSADMIN password:

Validating credentials.

Initializing.
    Run Edition context  : /u01/app/ERPSTG/fs1/inst/apps/ERPSTG_hostname/appl/admin/ERPSTG_hostname.xml
    Patch edition context: /u01/app/ERPSTG/fs2/inst/apps/ERPSTG_hostname/appl/admin/ERPSTG_hostname.xml
    Patch file system free space: 121.62 GB

Validating system setup.
    Node registry is valid.

Checking for existing adop sessions.
    Continuing with existing session [Session ID: 12].
        Session Id            :   12
        Prepare phase status  :   COMPLETED
        Apply phase status    :   COMPLETED
        Cutover  phase status :   NOT COMPLETED
        Abort phase status    :   NOT COMPLETED
        Session status        :   FAILED

===========================================================================
ADOP (C.Delta.16)
Session ID: 12
Node: hostname
Phase: cutover
Log: /u01/app/ERPSTG/fs_ne/EBSapps/log/adop/12/20260216_072711/adop.log
===========================================================================

Validating configuration on node: [hostname].
    Log: /u01/app/ERPSTG/fs_ne/EBSapps/log/adop/12/20260216_072711/cutover/validate/hostname

Checking if finalize required.
    Finalize phase is not required

Submitting request for Internal Concurrent Manager shutdown.

You are running adcmctl.sh version 120.19.12020000.7

Shutting down concurrent managers for ERPSTG ...
ORACLE Password:
Submitted request 23068571 for CONCURRENT FND SHUTDOWN


adcmctl.sh: exiting with status 0


adcmctl.sh: check the logfile /u01/app/ERPSTG/fs1/inst/apps/ERPSTG_hostname/logs/appl/admin/log/adcmctl.txt for more information ...

    Cancelling ADZDPATCH concurrent request

Waiting for Internal Concurrent Manager to go down.
    [UNEXPECTED]Error trying to find the status of ICM
    [UNEXPECTED]Error occurred waiting for ICM to go down
    [UNEXPECTED]Cutover phase has failed.


[STATEMENT] Please run adopscanlog utility, using the command

"adopscanlog -latest=yes"

to get the list of the log files along with snippet of the error message corresponding to each log file.


adop exiting with status = 1 (Fail)
applstg@hostname:~$
applstg@hostname:~$ adopscanlog -latest=yes

Scanning /u01/app/ERPSTG/fs_ne/EBSapps/log/adop/12/ directory ...

/u01/app/ERPSTG/fs_ne/EBSapps/log/adop/12/20260216_072711/adop.log:
-------------------------------------------------------------------

Lines #(245-251):
    [STATEMENT] ICM status cannot be determined.
    [STATEMENT] [END   2026/02/16 07:29:37] Check if ICM is running
    [UNEXPECTED]Error trying to find the status of ICM
    [UNEXPECTED]Error occurred waiting for ICM to go down
    [UNEXPECTED]Cutover phase has failed.
    [PROCEDURE] [START 2026/02/16 07:29:37] Updating session timestamps
    [STATEMENT] CUTOVER Phase END TIME: 16-02-2026 07:29:37
applstg@hostname:~$ cd /u01/app/ERPSTG/fs_ne/EBSapps/log/adop/12/


applstg@hostname:/u01/app/ERPSTG/fs_ne/EBSapps/log/adop/12/20260216_072711/cutover/hostname$ cat fndsvcrg.log

Cannot complete applications logon. You may have entered an invalid applications password, or there may have been a database connect error.
Internal Concurrent Manager status could not be determined.

applstg@hostname:/u01/app/ERPSTG/fs_ne/EBSapps/log/adop/12/20260216_072711/cutover/hostname$
 

[ErmanArslansOracleBlog]

Check -> https://community.oracle.com/mosc/discussion/3927556/cutover-issue-while-checking-icm-status

And then check (as a redirect from above) -> https://zmsolution.com/error-occurred-while-waiting-for-icm-to-go-down/ --translate it to English first.:)

[Aejaz Ahmad]

Not working .

but there is some different versions in patch and run file system

RUN:
1. $FND_TOP/bin/FNDSVCRG STATUS > /tmp/runoutput.txt
2. adident Header $FND_TOP/bin/FNDSVCRG > /tmp/runcversions.txt
3. adident Header $FND_TOP/lib/libfnd.a > /tmp/runlibversions.txt

PATCH:
1. $FND_TOP/bin/FNDSVCRG STATUS > /tmp/patchoutput.txt
2. adident Header $FND_TOP/bin/FNDSVCRG > /tmp/patchcversions.txt
3. adident Header $FND_TOP/lib/libfnd.a > /tmp/patchlibversions.txt

[ErmanArslansOracleBlog]

So you say APPL_SERVER_ID is correct in all the places relevant to the issue.

The difference in FNDSVCRG and libfnd.a is interesting and seems relevant with the issue.
Why do they differ? Do the patches you just applied touch those? Did you control that?

[Aejaz Ahmad]

Yes APPL_SERVER_ID  is same in both patch and run dbc file .

Yes The patch has changed the files that is what i see difference. i have update the oracle about the issue .

[ErmanArslansOracleBlog]

Maybe hot patching or downtime patching is what is required for this situation.. But ask it to SR.. Waiting for your updates.

[Aejaz Ahmad]

Hello Erman,

Now the issue of cutover is got resolved . oracle suggested to set run env before doing cutover, that did not work gave same error . but i tried out of box i set patch env and ran cutover again and that worked fine , patch applied and everything is working fine, Now oracle has released final patch for this issue  38965426 . now the other patch  38207032:R12.FND.C is replaced by 38965426:R12.FND.C

I will reclone the staging system and reapply again before applying on production . this is the bug in oracle which has been linked with apex user creation.

Now this bug is registered and patch has been released and published ,  Thanks alot for your support and cooperation .

Have a wonderful time .

Thanks
Aejaz

[ErmanArslansOracleBlog]

Good for you. And, yes you should go with the new patch.

Thank you for the update. As I always say, knowledge is the only treasure that increases when shared!