Error at Applications Tier EBS 12.2

[Brian Hogantara]

Hi erman,

i want to open App tier from EBS 12.2 after i did install EBS. the error shows up

have any suggest?
thanks,
brian

error_app.PNG

[ErmanArslansOracleBlog]

1)Did you get any errors while installing it?
2)what about the last screen that you see in the installation? (there are checks there, did you pass all of them?)
3)Could you start the apps services without getting any errors?
4)Did you try the things mentioned in this note? -> 12.2: Login Gives 10.5.1 500 Internal Server Error (Doc ID 1615694.1)
-Recompile the JSP files using following command :
perl ojspCompile.pl --compile --flush -p 2
-Initiate the execution of Autoconfig on the DB- and the APPS_Tier(s)
-Start the APPS-Tier(s) Services again and re-test the logon.
5)Did you check this note? -> R12: Troubleshooting 500 Internal Server Error in Oracle E-Business suite (Doc ID 813523.1)

[Brian Hogantara]

1. i did, but i solved during the installation. like i asked you in another forum
2. last screen that i see is check. i think if the one of the config is uncheck i try to solved first. cause it would bring a some new error in future if i do so.
3. i dont get what you ask erman, but database is work really fine. only EBS app get error like screenshoot that i send to you
4. i try to recompile like Doc ID 1615694.1 says. but you will see the output
root@solarisdev:/*/fs1/*/appl/fnd/12.0.0/patch/115/bin# perl ojspCompile.pl --compile --flush -p 2
defined(%hash) is deprecated at ./ojspCompile.pl line 204.
        (Maybe you should just omit the defined()?)
defined(%hash) is deprecated at ./ojspCompile.pl line 1142.
        (Maybe you should just omit the defined()?)
cannot read /appl/admin/ojspCompile.conf
please see ojspCompile.pl --help to override this file
5. i did. this below result
select fnd_profile.value('JTF_DIST_CACHE_PORT') from dual;
FND_WEB_SEC.VALIDATE_LOGIN('GUEST','<PASSWORD>')
--------------------------------------------------------------------------------
N

root@solarisdev:/# ./*/fs1/inst/apps/*/admin/scripts/adopmnctl.sh status -l

You are running adopmnctl.sh version 120.0.12020000.2

ld.so.1: perl: fatal: relocation error: file /*/12.1.0/perl/lib/5.14.1/sun4-solaris-thread-multi-64/auto/Tie/Hash/NamedCapture/NamedCapture.so: symbol Perl_xs_apiversion_bootcheck: referenced symbol not found
./*/fs1/inst/apps/*/admin/scripts/adopmnctl.sh: line 117: 28689: Killed

adopmnctl.sh: Exiting with status 265Killed

[Brian Hogantara]

5. i getting error at fs1, but when i try compiled at fs 2. here is the result

root@solarisdev:/*/fs2/inst/apps/*/admin/scripts# . /*/fs2/inst/apps/*/admin/scripts/adopmnctl.sh status -l

You are running bash version 120.0.12020000.2

Checking status of OPMN managed processes...
[2017-09-06T16:21:25+07:00] [opmn] [ERROR:1] [217] [internal] OPMN cannot run as the root user
opmnctl status: opmn is not running.

bash: exiting with status 0

bash: check the logfile /*/fs2/inst/apps/*/logs/appl/admin/log/adopmnctl.txt for more information ...

[ErmanArslansOracleBlog]

Brian,

Your answers are complicated.

Let's send me the output of the following sequence of events.

do these exactly in the same order as enumerated below

1)
login your apps OS as applmgr.
set your run env.
cd to $ADMIN_SCRIPTS_HOME
stop the apps services using adstpall.sh
kill the remaining processes (applmgr processes using kill command-- if you need assistance,take help from your OS admin)
Then start the apps services using adstrtal.sh
"Send me the whole output of adstrtal.sh"

2)
"Retry login"

3)
set your run env and run the following command;

Run this script as the owner of the applications file system to gather the log files for OPMN and OHS services:

zip -r /tmp/`uname -n`_`date +%m%d%y.%H%M`_OPMN_OHS.zip $IAS_ORACLE_HOME/instances/*/diagnostics/logs/OHS/*/*log* $IAS_ORACLE_HOME/instances/*/diagnostics/logs/OPMN/opmn/*

"Send me the zip file that will be created under your /tmp directory"

4)
set your run env and run the following command;

zip -r /tmp/`uname -n`_`date +%m%d%y.%H%M`_FMW.zip $IAS_ORACLE_HOME/../wlserver_10.3/common/nodemanager $EBS_DOMAIN_HOME/servers/oa*/logs/*out* $EBS_DOMAIN_HOME/servers/oa*/logs/*log* $EBS_DOMAIN_HOME/servers/forms*/logs/*out* $EBS_DOMAIN_HOME/servers/forms*/logs/*log* $EBS_DOMAIN_HOME/servers/AdminServer/logs/*out* $EBS_DOMAIN_HOME/servers/AdminServer/logs/*log* $EBS_DOMAIN_HOME/sysman/log/* $EBS_DOMAIN_HOME/servers/oac*/adr/diag/ofm/EBS_domain_*/oac*/incident/* $EBS_DOMAIN_HOME/servers/forms_s*/adr/diag/ofm/EBS_domain_*/forms_s*/incident/*

"Send me the zip file that will be created under your /tmp directory"

5)

Send me the output of the following commands;

cd $INST_TOP/appl/fnd/12.0.0/secure
ls -al

Also send me the dbc file located under $INST_TOP/appl/fnd/12.0.0/secure .. (blabla.dbc)

Send me the output of the following commands;

grep -i guest $CONTEXT_FILE


6)
Connect your DB through listener (using toad or something and ensure it is connectable) Check tablespaces and see if they have free space in them. Check the DB alert log and see if there are any weird erros like ORA 600 or 7445 or any kinds of RDBMS or TNS errors)

[Brian Hogantara]

1. adstrtal.log

3. solarisdev_090617.zip
solarisdev_090617.zip

4. solarisdev_090817.zip

5. PROD.dbc


6. i think it's fine in DB because i can login and run some select query from sql developer.

[ErmanArslansOracleBlog]

This is gathered from oacore_server1.log

-->
####<Sep 6, 2017 2:25:53 PM WIB> <Notice> <WebLogicServer> <solarisdev.in.adis.co.id> <oacore_server1> <main> <<WLS Kernel>> <> <a7dee9476da5ebb0:2342ea68:15e5612a60b:-8000-0000000000000008> <1504682753255> <BEA-000360> <Server started in RUNNING mode> 

Just after the start , it gets the error

Root cause of ServletException.
java.lang.ExceptionInInitializerError
        at oracle.apps.fnd.sso.Utils.<clinit>(Utils.java:675)
        at oracle.apps.fnd.sso.AppsLoginRedirect.AppsSetting(AppsLoginRedirect.java:245)
        at oracle.apps.fnd.sso.AppsLoginRedirect.init(AppsLoginRedirect.java:311)
        at weblogic.servlet.internal.StubSecurityHelper$ServletInitAction.run(StubSecurityHelper.java:283)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
        at weblogic.servlet.internal.StubSecurityHelper.createServlet(StubSecurityHelper.java:64)
        at weblogic.servlet.internal.StubLifecycleHelper.createOneInstance(StubLifecycleHelper.java:58)
        at weblogic.servlet.internal.StubLifecycleHelper.<init>(StubLifecycleHelper.java:48)
        at weblogic.servlet.internal.ServletStubImpl.prepareServlet(ServletStubImpl.java:539)
        at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:244)
        at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
        at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
        at oracle.apps.jtf.base.session.ReleaseResFilter.doFilter(Unknown Source)
        at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
        at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:138)
        at java.security.AccessController.doPrivileged(Native Method)
        at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:324)
        at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:464)
        at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:121)
        at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:211)
        at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
        at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
        at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:163)
        at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:60)
        at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3748)
        at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3714)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
        at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2283)
        at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2182)
        at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1491)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
Caused By: oracle.apps.fnd.common.AppsException: oracle.apps.fnd.common.PoolException: Exception creating new Poolable object.
        at oracle.apps.fnd.profiles.Profiles.getProfileOption(Profiles.java:1509)
        at oracle.apps.fnd.profiles.Profiles.getProfile(Profiles.java:362)
        at

[ErmanArslansOracleBlog]

You see the time of the errors above right?
It is around Sep 6, 2017 2:25:53 PM

If this data&time is logical, then this is your issue.

Your EBS cannot create poolable object. This means it can not get db connection.

Your log also contains :

Caused By: oracle.apps.fnd.common.AppsException: java.sql.SQLException: ORA-01017: invalid username/password; logon denied

This is probably related with dbc. Your dbc may be wrong. Consider recreating it. It may also related with sec_case_sensitive_logon

Check these notes one by one:

Users Receive Error "Exception: oracle.apps.fnd.common.AppsException: oracle.apps.fnd.common.PoolException: Exception creating new Poolable object" During Login To E-Business Suite (Doc ID 1485112.1)

Random oracle.apps.fnd.common.AppsException: oracle.apps.fnd.common.PoolException Occurs For Login (Doc ID 1937879.1)

R12: On a Cloned Target System The Login Screen Reports 'HTTP error 500 Internal server error' (Doc ID 1335176.1)

Update me with the outcome..

[Roshan]

Hi,

I am getting same error as above on a test instance.

Server details
EBS R12.1.3
Oracle Database 11g

I see the database server is not configured on DNS.
DNSDB.PNG

sec_case_sensitive_logon is alrady set to failse.

Do you think the Databsae not configured in DNS is causing the issue?

Regards,

Roshan

[Roshan]

Please find below DBC content

GUEST_USER_PWD=GUEST/ORACLE
APPL_SERVER_ID=63B07F61AD7F00E0E0530AD71B4600E023323911986334877111113388152116
FND_JDBC_BUFFER_DECAY_INTERVAL=300
APPS_JDBC_DRIVER_TYPE=THIN
FND_JDBC_BUFFER_MIN=1
GWYUID=APPLSYSPUB/PUB
FND_JDBC_BUFFER_MAX=5
APPS_JDBC_URL=jdbc\:oracle\:thin\:@(DESCRIPTION\=(ADDRESS_LIST\=(LOAD_BALANCE\=YES)(FAILOVER\=YES)(ADDRESS\=(PROTOCOL\=tcp)(HOST\=peopletest.mauritiustelecom.com)(PORT\=1531)))(CONNECT_DATA\=(SID\=PROD)))
FND_JDBC_STMT_CACHE_SIZE=100
TWO_TASK=PROD
JDBC\:oracle.jdbc.maxCachedBufferSize=358400
JDBC\:processEscapes=true
FND_MAX_JDBC_CONNECTIONS=500
FND_JDBC_USABLE_CHECK=false
FNDNAM=APPS
FND_JDBC_PLSQL_RESET=false
DB_PORT=1531
FND_JDBC_CONTEXT_CHECK=true
FND_JDBC_BUFFER_DECAY_SIZE=5
DB_HOST=peopletest.mauritiustelecom.com

[ErmanArslansOracleBlog]

Can you do telnet from apps server to db server?

login to apps using root

then telnet using telnet db_server_ip db_listener_port..

ex: telnet 10.10.10.15 1521 (or your db listener port)
 
also test telnet using "db_server_hostname" and db_listener_port

ex: telnet dbservername 1521 (or your db listener port)