Concurrent request RUNNING NORMAL but no db session

[VinodNN]

Hi Erman,
A particular custom program is having this issue. The concurrent requests are RUNNING NORMAL but there is no database session. It is showing as pending OPP too. I restarted OPP but it did not help. I am not sure how to troubleshoot it. Cannot run recovery wizard as it is production and users are working.

[ErmanArslansOracleBlog]

What does OPP log say? Is that custom program calls for OPP? Is that call / OPP request picked up by OPP?
What does the custom program do? No DB activity Ok, but any app process, such as the ones for reporting or so?

Did you enable trace for that custom program? If not, please do and check the trace -- check -> https://blogs.oracle.com/ebs/more-trace-options-for-programs-and-reports

[VinodNN]

It is a custom program --> Draft Invoice Tax Details Report.
This report is used to cross check India tax applicability correctness on invoice level.

The request is not there in OPP logs:
[applmgr@azerpebsprod1 ~]$ grep 73217027 /oraapp/EBS/fs_ne/inst/ERP_azerpebsprod1/logs/appl/conc/log/FNDOPP*

I will take trace and come back.

[VinodNN]

I enabled trace. But there is no oracle process id, os process id for the request. It is RUNNING NORMAL. There is no database session.

[VinodNN]

The issue is resolved. The rdf file had vanished from the RUN fs. How can this happen? We ran adop prepare and apply yesterday. Could it have caused that?

[ErmanArslansOracleBlog]

There can be several reasons for this.
First things coming in my mind is, some one may have deleted or maybe adop deleted it because the deployment wasn't accurately done.
Or maybe it was caused by a couple of fs_clone operations with bad timings..(Remember fs_clone -> recreates the entire patch edition file system as a fresh copy of the run edition)
You need to do your custom deployments according to the  "Developing and Deploying Customizations in Oracle E-Business Suite Release 12.2 (Doc ID 1577661.1)"
You need to deploy your custom rdf reports in to your custom tops.

For tracking the changes that is done on the filesystem, you can use an OS layer audit utility.
As for Linux, you can use auditd.

[VinodNN]

Thank you so much!