ADOP Patching Prepare phase has failed on Disaster Recovery site

[jayr]

Hi,

Can you please help me regarding on my issue, I just want to apply a patch on DR site using adop patching however it was failed.

ERROR while running FSCloneApply...
Thu Jan 23 14:57:43 2025
*******FATAL ERROR*******
PROGRAM : (/u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl)
TIME : Thu Jan 23 14:57:43 2025
FUNCTION: main::migrateCloneComponentApply [ Level 1 ]
ERRORMSG: /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/bin/adclone.pl did not go through successfully.

[UNEXPECTED]Error occurred running "perl /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/pfas1s1/fs1/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -patchcontextfile=/u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -promptmsg=hide -console=off -mode=migrate -sessionid=28 -timestamp=20250123_145031 -outdir=/u01/pfas1s1/fs_ne/EBSapps/log/adop/28/20250123_145031/prepare/fasprd"
[UNEXPECTED]occurred during CONFIG_CLONE Patch File System from Run File System, running command: "perl /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/pfas1s1/fs1/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -patchcontextfile=/u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -promptmsg=hide -console=off -mode=migrate -sessionid=28 -timestamp=20250123_145031 -outdir=/u01/pfas1s1/fs_ne/EBSapps/log/adop/28/20250123_145031/prepare/fasprd".
[UNEXPECTED]fs_clone has failed.
[UNEXPECTED]Error calling runPendingConfigClone subroutine.
Stopping services on patch file system.
Stopping admin server.

You are running adadminsrvctl.sh version 120.10.12020000.11


The AdminServer is already shutdown

AdminServer logs are located at /u01/pfas1s1/fs2/FMW_Home/user_projects/domains/EBS_domain/servers/AdminServer/logs

adadminsrvctl.sh: exiting with status 2

adadminsrvctl.sh: check the logfile /u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/logs/appl/admin/log/adadminsrvctl.txt for more information ...

Stopping node manager.

You are running adnodemgrctl.sh version 120.11.12020000.12


The Node Manager is already shutdown

NodeManager log is located at /u01/pfas1s1/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome1

adnodemgrctl.sh: exiting with status 2

adnodemgrctl.sh: check the logfile /u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/logs/appl/admin/log/adnodemgrctl.txt for more information ...

[ERROR] Prepare phase has failed.


[STATEMENT] Please run adopscanlog utility, using the command

"adopscanlog -latest=yes"

to get the list of the log files along with snippet of the error message corresponding to each log file.


adop exiting with status = 1 (Fail)
[applprd@fasprd 27]$

[ErmanArslansOracleBlog]

Send me the output of adopscanlog -latest=yes

[jayr]

Hi,

[applprd@fasprd ~]$ adopscanlog -latest=yes

Scanning /u01/pfas1s1/fs_ne/EBSapps/log/adop/28/ directory ...

/u01/pfas1s1/fs_ne/EBSapps/log/adop/28/20250122_123434/prepare/fasprd/adconfig.log:
-----------------------------------------------------------------------------------

Lines #(3329-3333):
[ FND_VALIDATION_LEVEL ]
Application Id : 0
Profile Value : ERROR
Level Name: SITE
INFO : Updated/created profile option value.

Lines #(3335-3339):
[ FND_FUNCTION_VALIDATION_LEVEL ]
Application Id : 0
Profile Value : ERROR
Level Name: SITE
INFO : Updated/created profile option value.

Lines #(3341-3345):
[ FRAMEWORK_VALIDATION_LEVEL ]
Application Id : 0
Profile Value : ERROR
Level Name: SITE
INFO : Updated/created profile option value.

/u01/pfas1s1/fs_ne/EBSapps/log/adop/28/20250122_123434/prepare/fasprd/TXK_SYNC_migrate/txkADOPPreparePhaseSynchronize.log:
--------------------------------------------------------------------------------------------------------------------------

Lines #(296-298):
TIME : Wed Jan 22 12:41:01 2025
FUNCTION: main::migrateCloneComponentApply [ Level 1 ]
ERRORMSG: /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/bin/adclone.pl did not go through successfully.

/u01/pfas1s1/fs_ne/EBSapps/log/adop/28/20250122_123434/adop.log:
----------------------------------------------------------------

Lines #(257-262):
[PROCEDURE] Calling: /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl
[EVENT] Log: /u01/pfas1s1/fs_ne/EBSapps/log/adop/28/20250122_123434/prepare/fasprd
[UNEXPECTED]Error occurred running "perl /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/pfas1s1/fs1/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -patchcontextfile=/u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -promptmsg=hide -console=off -mode=migrate -sessionid=28 -timestamp=20250122_123434 -outdir=/u01/pfas1s1/fs_ne/EBSapps/log/adop/28/20250122_123434/prepare/fasprd"
[UNEXPECTED]occurred during CONFIG_CLONE Patch File System from Run File System, running command: "perl /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/pfas1s1/fs1/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -patchcontextfile=/u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -promptmsg=hide -console=off -mode=migrate -sessionid=28 -timestamp=20250122_123434 -outdir=/u01/pfas1s1/fs_ne/EBSapps/log/adop/28/20250122_123434/prepare/fasprd".
[PROCEDURE] [START 2025/01/22 12:41:01] Updating status of patches
[STATEMENT] SQL statement : " update ad_adop_session_patches

Lines #(266-271):
and appltop_id=4195 and node_name='fasprd'"
[PROCEDURE] [END 2025/01/22 12:41:01] Updating status of patches
[UNEXPECTED]fs_clone has failed.
[UNEXPECTED]Error calling runPendingConfigClone subroutine.
[EVENT] Stopping services on patch file system.
[EVENT] Stopping admin server.

Lines #(279-283):
[PROCEDURE] [END 2025/01/22 12:41:09] Check and Stop patch Node Manager
[PROCEDURE] [END 2025/01/22 12:41:09] Check and stop patch Node Manager
[ERROR] Prepare phase has failed.
[PROCEDURE] [START 2025/01/22 12:41:09] Updating adop session status
[STATEMENT] SQL statement : " update ad_adop_sessions
[applprd@fasprd ~]$

[ErmanArslansOracleBlog]

Okay. A Generic one.

Please try with ;

export CONFIG_JVM_ARGS="-Xms2048m -Xmx4096m -XX:MaxPermSize=2048m"

Run adop again as:  adop phase=fs_clone

Other than that, go through the following MOS docs;

FS_CLONE Fails: "[UNEXPECTED]Error running adadminsrvctl command" (Doc ID 2433700.1)

FSClone fails while running txkADOPPreparePhaseSynchronize.pl (Doc ID 2094689.1)

[jayr]

Hi Erman,

I applied this export CONFIG_JVM_ARGS="-Xms2048m -Xmx4096m -XX:MaxPermSize=2048m" then run adop phase again still the same error

ERROR while running FSCloneApply...
Wed Feb 12 10:04:27 2025
*******FATAL ERROR*******
PROGRAM : (/u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl)
TIME    : Wed Feb 12 10:04:27 2025
FUNCTION: main::migrateCloneComponentApply [ Level 1 ]
ERRORMSG: /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/bin/adclone.pl did not go through successfully.

    [UNEXPECTED]Error occurred running "perl /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/pfas1s1/fs1/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -patchcontextfile=/u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -promptmsg=hide -console=off -mode=migrate -sessionid=27 -timestamp=20250212_095608 -outdir=/u01/pfas1s1/fs_ne/EBSapps/log/adop/27/20250212_095608/prepare/fasprd"
    [UNEXPECTED]occurred during CONFIG_CLONE Patch File System from Run File System, running command: "perl /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/pfas1s1/fs1/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -patchcontextfile=/u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -promptmsg=hide -console=off -mode=migrate -sessionid=27 -timestamp=20250212_095608 -outdir=/u01/pfas1s1/fs_ne/EBSapps/log/adop/27/20250212_095608/prepare/fasprd".
    [UNEXPECTED]fs_clone has failed.
    [UNEXPECTED]Error calling runPendingConfigClone subroutine.
    Stopping services on patch file system.
    Stopping admin server.

You are running adadminsrvctl.sh version 120.10.12020000.11


 The AdminServer is already shutdown

AdminServer logs are located at /u01/pfas1s1/fs2/FMW_Home/user_projects/domains/EBS_domain/servers/AdminServer/logs

adadminsrvctl.sh: exiting with status 2

adadminsrvctl.sh: check the logfile /u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/logs/appl/admin/log/adadminsrvctl.txt for more information ...

    Stopping node manager.

You are running adnodemgrctl.sh version 120.11.12020000.12


The Node Manager is already shutdown

NodeManager log is located at /u01/pfas1s1/fs2/FMW_Home/wlserver_10.3/common/nodemanager/nmHome1

adnodemgrctl.sh: exiting with status 2

adnodemgrctl.sh: check the logfile /u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/logs/appl/admin/log/adnodemgrctl.txt for more information ...

    [ERROR]     Prepare phase has failed.


[STATEMENT] Please run adopscanlog utility, using the command

"adopscanlog -latest=yes"

to get the list of the log files along with snippet of the error message corresponding to each log file.


adop exiting with status = 1 (Fail)
[applprd@cmcprdlxfasb21 patch]$ adopscanlog -latest=yes

Scanning /u01/pfas1s1/fs_ne/EBSapps/log/adop/27/ directory ...

/u01/pfas1s1/fs_ne/EBSapps/log/adop/27/20250212_095608/prepare/fasprd/adconfig.log:
-----------------------------------------------------------------------------------

Lines #(3055-3059):
[ FND_VALIDATION_LEVEL ]
Application Id : 0
Profile Value  : ERROR
Level Name: SITE
INFO           : Updated/created profile option value.

Lines #(3061-3065):
[ FND_FUNCTION_VALIDATION_LEVEL ]
Application Id : 0
Profile Value  : ERROR
Level Name: SITE
INFO           : Updated/created profile option value.

Lines #(3067-3071):
[ FRAMEWORK_VALIDATION_LEVEL ]
Application Id : 0
Profile Value  : ERROR
Level Name: SITE
INFO           : Updated/created profile option value.

/u01/pfas1s1/fs_ne/EBSapps/log/adop/27/20250212_095608/prepare/fasprd/TXK_SYNC_migrate/txkADOPPreparePhaseSynchronize.log:
--------------------------------------------------------------------------------------------------------------------------

Lines #(296-298):
TIME    : Wed Feb 12 10:04:27 2025
FUNCTION: main::migrateCloneComponentApply [ Level 1 ]
ERRORMSG: /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/bin/adclone.pl did not go through successfully.

/u01/pfas1s1/fs_ne/EBSapps/log/adop/27/20250212_095608/adop.log:
----------------------------------------------------------------

Lines #(257-262):
        [PROCEDURE] Calling: /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl
        [EVENT]     Log: /u01/pfas1s1/fs_ne/EBSapps/log/adop/27/20250212_095608/prepare/fasprd
        [UNEXPECTED]Error occurred running "perl /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/pfas1s1/fs1/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -patchcontextfile=/u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -promptmsg=hide -console=off -mode=migrate -sessionid=27 -timestamp=20250212_095608 -outdir=/u01/pfas1s1/fs_ne/EBSapps/log/adop/27/20250212_095608/prepare/fasprd"
        [UNEXPECTED]occurred during CONFIG_CLONE Patch File System from Run File System, running command: "perl /u01/pfas1s1/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/pfas1s1/fs1/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -patchcontextfile=/u01/pfas1s1/fs2/inst/apps/pfas1s1p_fasprd/appl/admin/pfas1s1p_fasprd.xml -promptmsg=hide -console=off -mode=migrate -sessionid=27 -timestamp=20250212_095608 -outdir=/u01/pfas1s1/fs_ne/EBSapps/log/adop/27/20250212_095608/prepare/fasprd".
        [PROCEDURE] [START 2025/02/12 10:04:27] Updating status of patches
        [STATEMENT] SQL statement : "  update ad_adop_session_patches

Lines #(266-271):
  and appltop_id=4195 and node_name='fasprd'"
        [PROCEDURE] [END   2025/02/12 10:04:28] Updating status of patches
        [UNEXPECTED]fs_clone has failed.
        [UNEXPECTED]Error calling runPendingConfigClone subroutine.
        [EVENT]     Stopping services on patch file system.
            [EVENT]     Stopping admin server.

Lines #(279-283):
                [PROCEDURE] [END   2025/02/12 10:04:36] Check and Stop patch Node Manager
                [PROCEDURE] [END   2025/02/12 10:04:36] Check and stop patch Node Manager
        [ERROR]     Prepare phase has failed.
        [PROCEDURE] [START 2025/02/12 10:04:36] Updating adop session status
        [STATEMENT] SQL statement : "  update ad_adop_sessions
[applprd@cmcprdlxfasb21 patch]$

[ErmanArslansOracleBlog]

anything (any ORA- errors) in the database alert log during this activity?

[jayr]

Hi Erman,

None on database side , however this is DR environment that sync the production environment, I don't think that there is a configuration on the database side that conflict on adop patching. May I know if feasible to apply adop patching on DR environment?

Thanks ,
Jayr

[ErmanArslansOracleBlog]

I don't see any DR related thing here.. What do you mean by DR? (that's another thing..) But you are asking DR patching.. Why? You mean adop on DR? directly on DR?  No
For patching with adop on DR-enabled environments
Please read -> "Business Continuity for Oracle E-Business Suite Release 12.2 Using Oracle 12c (12.1.0.2) Physical Standby Database (Doc ID 1963472.1)" -> Section 7: Maintaining Oracle E-Business Suite with a Standby Database .

[jayr]

Hi Erman,

DR means Disaster Recovery, We apply adop patching on DR environment which is sync on Production environment. Once the patch successfully applied on DR environment we can apply it too to Production.

Thanks
Armando

[ErmanArslansOracleBlog]

What kind of DR do you have?

I think there is a misunderstanding here?

For instance how do you apply an application patch to a standby database-based EBS DR environment with adop? -- in the mode of standby first patching.

Probably, you mean something else..

Just tell me, how do you implement DR for this EBS? -- give me the tech details.

[ErmanArslansOracleBlog]

Read ->

Business Continuity for Oracle E-Business Suite Release 12.2 Using Oracle 12c (12.1.0.2) Physical Standby Database (Doc ID 1963472.1)

"Section 7: Maintaining Oracle E-Business Suite with a Standby Database"

*While patching a DR-enabled EBS, ensure you are aligned with what is told in the document above (and the relevant section (section 7) of it)

[jayr]

Hi Erman,

Thanks for the support, we already fixed the issue of ADOP Patching in DR environment. We downloaded the java version 7 (US_export_policy.jar and local_policy.jar) and updates to the required directories. Adop patch prepare successfully completed.

Regards,
Armando