How to re-build EBS RDBMS home from scratch

[VinodN]

Hi Erman!

We are on EBS 12.2.10, DB 19.9.0.0.0 on RHEL 8. While applying the latest CPU patches to APP and DB, we found that we cannot rollback some DB patches because the folders and files they need for rollback are not present in oh/.patch_storage. We do not have any backup which has those missing files under OH. So, the only option left for us is to re-build EBS RDBMS home from scratch. I searched for Oracle Note which describes the procedure to do it but couldn't find it. I tried installing new home and running adcfgclone.pl dbTechStack, but it is failing. Could you please shed some light on this.

[ErmanArslansOracleBlog]

1)Did you try to rollback those patches really? And what error did you get?
2)Oracle Home can be cloned from a working, non-patched instance, but what about the db objects and in-db codes?
3)Why don't you reapply those patches? Why did you rollback them.
4)For those-types of cloning needs, please see -> Cloning Oracle E-Business Suite Release 12.2 with Rapid Clone (Doc ID 1383621.1) - 5.1 Refreshing a Target System

[VinodN]

relinkActions2024-07-25_04-23-46PM.logopatch2024-07-25_14-53-41PM_1.log

[VinodN]

1)Did you try to rollback those patches really? And what error did you get?
Yes, we tried. I have uploaded the error log. Relink also failing.

2)Oracle Home can be cloned from a working, non-patched instance, but what about the db objects and in-db codes?
We do not have any working but non-patched instance. All are clones of our production.

3)Why don't you reapply those patches? Why did you rollback them.
You mean we should re-apply the patches which we are not able to rollback?

[ErmanArslansOracleBlog]

For 1) Check the MOS wit the keywords -> qesrcLcu and/or libserver19 + relink

2) Follow the MOS note that I sent, if you will clone oracle home and refresh this env.. You may run the db-side of those missing after you clone the oracle home from a patched instance.

3)It is a choice, you can rollback, you can fix the error and reapply, or you can restore your backup..

[VinodN]

Hi Erman,

1) Check the MOS wit the keywords -> qesrcLcu and/or libserver19 + relink
I did search, but couldn't find a note applicable to our specific error.

2) Follow the MOS note that I sent, if you will clone oracle home and refresh this env.. You may run the db-side of those missing after you clone the oracle home from a patched instance.
- I cannot use our db home, need to install fresh binaries and configure the same. Could you please point me to a note which tells how it can be done?

3)It is a choice, you can rollback, you can fix the error and reapply, or you can restore your backup..
- Patch rollback as well as reapply is failing with the make error..

[ErmanArslansOracleBlog]

Okay. You want to install a new Oracle Home.

For that, you have to follow the action plan below;

Download the related version of Oracle Enterprise Edition
Install it. (to a new path if you want to..)
Then list the patches/RUs and features applied to the PROD Oracle Home using opatch lsinventory.
Apply those patches to the newly installed Oracle Home, and install the features and/or options if you have them in PROD.
Copy the crucial db related files from old oracle home to new oracle home (such as spfile)
Implement autoconfig in the new Oracle Home . (or use/copy the directories that store the appsutil, TNS_ADMIN etc.. from old oracle home to the new one..)

[ErmanArslansOracleBlog]

See the following MOS Note as well ->

Undefined first referenced symbol ld: fatal: symbol referencing errors. (Doc ID 1539887.1)

[VinodN]

Will this approach also be fine:

Install new home > Configure it for ebs > Apply latest CPU and RUP patches > Compare with prod home > Apply any missing patches.

[ErmanArslansOracleBlog]

The following one is a better flow;

Install new home > Apply the RU & CPU patches (the RU and CPU levels should the same as PROD) -> Compare with prod home > Apply any missing patches -> Configure the new Oracle Home for EBS.

[VinodN]

We need to apply JULY 24 CPU patches. Won't they cover already existing patches?
I have already applied p36199232_190000_Linux-x86-64.zip & p36233263_190000_Linux-x86-64.zip to the new home. Won't they supersede those patches which are on prod? If not, how can I know which prod patches I still need to apply?  

[ErmanArslansOracleBlog]

You have to make all your environments in sync ( PROD, UAT and TEST). So, applying those exact same patches should be your goal.