1 Reply Latest reply on Apr 27, 2016 6:25 PM by Noname123

    oracle.apps.fnd.framework.OAException: Illegal method call because there is no database connection.

    Noname123

      Message error when trying to log in:

       

      • oracle.apps.fnd.framework.OAException: Illegal method call because there is no database connection.

      However, we were able to log in when I bounced the applications.   I think this might be a temporary solution.  What I need

      is a permanent solution by identifying the cause o the problem and solving it. 

      I did my search and what I found is below .  If you have come across this error before and your workaround worked successfully

      then you are welcome to share your experience here.

       

       

      Causes according the article below:
      http://ora-players.blogspot.com/2011/08/oracleappsfndframeworkoaexception.html


      1)  The root cause of the issue is that there was no database connection available to service your request.

      2)  The most likely cause of that issue is that we are leaking JDBC connections.

      3)  However it can also occur when the database is overloaded and unable to process our request quickly enough.

      Regarding to the causes above:
      1)

      There was a database connection at the time of error (Database , DB listener, Apps listener  were up and running).

      2)

      I went to   system administration --> Diagnostic -->  AOL/J Database Connection Pool Status

      Then  AOL/J Database Connection Pool Status page appears with some statistics:

      leaked connections : 82

      locked connections: 16

       

       

       


      Double clicking on "leaked connections" shows some exception message  as  below :

      AOL/J Database Connection Pool Status

      April 27, 2016 3:02:12 PM AST

      Top of Form

       

      • oracle.apps.fnd.security.LeakedConnectionException 1, 0x100124f, 2016-04-27+08:34:46.227+0300, Thread[AJPRequestHandler-HTTPThreadGroup-3,5,HTTPThreadGroup]

              at oracle.apps.fnd.security.CallStack.getInstance(CallStack.java:109)

              at oracle.apps.fnd.security.DBConnObj.setBorrowingThread(DBConnObj.java:990)

              at oracle.apps.fnd.security.DBConnObj.setBorrowingThread(DBConnObj.java:973)

              at oracle.apps.fnd.common.AppsContext.checkDedicated(AppsContext.java:500)

              at oracle.apps.fnd.common.AppsContext.connectionBorrowed(AppsContext.java:481)

              at oracle.apps.fnd.common.Context.borrowConnection(Context.java:1724)

              at oracle.apps.fnd.common.AppsContext.getPrivateConnectionFinal(AppsContext.java:2314)

              at oracle.apps.fnd.common.AppsContext.getPrivateConnection(AppsContext.java:2251)

              at oracle.apps.fnd.common.AppsContext.getJDBCConnection(AppsContext.java:2108)

              at oracle.apps.fnd.common.AppsContext.getJDBCConnection(AppsContext.java:1918)

              at oracle.apps.fnd.common.AppsContext.getJDBCConnection(AppsContext.java:1762)

              at oracle.apps.fnd.common.AppsContext.getJDBCConnection(AppsContext.java:1775)

              at oracle.apps.fnd.common.Context.getJDBCConnection(Context.java:1453)

              at oracle.apps.fnd.cache.GenericCacheLoader.load(GenericCacheLoader.java:170)

              at oracle.apps.fnd.profiles.Profiles.getProfileOption(Profiles.java:1500)

              at oracle.apps.fnd.profiles.Profiles.getProfile(Profiles.java:362)

              at oracle.apps.fnd.profiles.ExtendedProfileStore.getSpecificProfileFromDB(ExtendedProfileStore.java:211)

              at oracle.apps.fnd.profiles.ExtendedProfileStore.getSpecificProfile(ExtendedProfileStore.java:171)

              at oracle.apps.fnd.profiles.ExtendedProfileStore.getProfile(ExtendedProfileStore.java:148)

              at oracle.apps.fnd.common.logging.DebugEventManager.configureUsingDatabaseValues(DebugEventManager.java:1294)

              at oracle.apps.fnd.common.logging.DebugEventManager.configureLogging(DebugEventManager.java:1149)

              at oracle.apps.fnd.common.logging.DebugEventManager.internalReinit(DebugEventManager.java:1118)

              at oracle.apps.fnd.common.logging.DebugEventManager.reInitialize(DebugEventManager.java:1085)

              at oracle.apps.fnd.common.logging.DebugEventManager.reInitialize(DebugEventManager.java:1072)

              at oracle.apps.fnd.common.AppsLog.reInitialize(AppsLog.java:595)

              at oracle.apps.fnd.common.AppsContext.initLog(AppsContext.java:602)

              at oracle.apps.fnd.common.AppsContext.initializeContext(AppsContext.java:579)

              at oracle.apps.fnd.common.AppsContext.initializeContext(AppsContext.java:533)

              at oracle.apps.fnd.common.AppsContext.(AppsContext.java:301)

              at oracle.apps.fnd.common.WebAppsContext.(WebAppsContext.java:1147)

              at oracle.apps.fnd.framework.server.OAUtility.getWebAppsContext(OAUtility.java:352)

              at oracle.apps.fnd.framework.webui.OAServerDelegate.getWebAppsContext(OAServerDelegate.java:1689)

              at oracle.apps.fnd.framework.webui.OAServerDelegate.getIcxCookieName(OAServerDelegate.java:573)

              at oracle.apps.fnd.framework.webui.OAJSPHelper.getIcxCookieName(OAJSPHelper.java:216)

              at oracle.apps.fnd.framework.webui.OAJSPHelper.getIcxCookie(OAJSPHelper.java:294)

              at _OALogout._jspService(_OALogout.java:221)

              at com.orionserver.http.OrionHttpJspPage.service(OrionHttpJspPage.java:59)

              at oracle.jsp.runtimev2.JspPageTable.service(JspPageTable.java:462)

              at oracle.jsp.runtimev2.JspServlet.internalService(JspServlet.java:594)

              at oracle.jsp.runtimev2.JspServlet.service(JspServlet.java:518)

              at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)

              at com.evermind.server.http.ResourceFilterChain.doFilter(ResourceFilterChain.java:64)

              at oracle.apps.jtf.base.session.ReleaseResFilter.doFilter(ReleaseResFilter.java:26)

              at com.evermind.server.http.EvermindFilterChain.doFilter(EvermindFilterChain.java:15)

              at oracle.apps.fnd.security.AppsServletFilter.doFilter(AppsServletFilter.java:318)

              at com.evermind.server.http.ServletRequestDispatcher.invoke(ServletRequestDispatcher.java:621)

              at com.evermind.server.http.ServletRequestDispatcher.forwardInternal(ServletRequestDispatcher.java:370)

              at com.evermind.server.http.HttpRequestHandler.doProcessRequest(HttpRequestHandler.java:871)

              at com.evermind.server.http.HttpRequestHandler.processRequest(HttpRequestHandler.java:453)

              at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:313)

              at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:199)

              at oracle.oc4j.network.ServerSocketReadHandler$SafeRunnable.run(ServerSocketReadHandler.java:260)

              at oracle.oc4j.network.ServerSocketAcceptHandler.procClientSocket(ServerSocketAcceptHandler.java:234)

              at oracle.oc4j.network.ServerSocketAcceptHandler.access$700(ServerSocketAcceptHandler.java:29)

              at oracle.oc4j.network.ServerSocketAcceptHandler$AcceptHandlerHorse.run(ServerSocketAcceptHandler.java:879)

              at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:303)

              at java.lang.Thread.run(Thread.java:619)

      Bottom of Form

       

       

      3)

      Could be some processes are loading the system…  I have checked the memory ,processes status and the output as below:

      $cat /proc/meminfo

      MemTotal:         32922004 kB

      MemFree:          761216 kB

      Buffers:              622788 kB

      Cached:             26113920 kB

      SwapCached:     9828 kB

      Active:                14245340 kB

      Inactive:             16765808 kB

      HighTotal:           0 kB

      HighFree:            0 kB

      LowTotal:           32922004 kB

      LowFree:           761216 kB

      SwapTotal:       34812844 kB

      SwapFree:        34657220 kB

      Dirty:                 648 kB

      Writeback:        0 kB

      AnonPages:      4264324 kB

      Mapped:          1843372 kB

      Slab:                  595268 kB

      PageTables:      460500 kB

      NFS_Unstable:  0 kB

      Bounce:              0 kB

      CommitLimit:    51273844 kB

      Committed_AS: 9394976 kB

      VmallocTotal:      34359738367 kB

      VmallocUsed:     283720 kB

      VmallocChunk:   34359452431 kB

      HugePages_Total:   0

      HugePages_Free:    0

      HugePages_Rsvd:    0

      Hugepagesize:     2048 kB

       

       

       

      Top processes that consumes high CPU usage:

      $ top -n 1

      top - 15:07:13 up 159 days, 21:12,  6 users,  load average: 2.14, 2.11, 2.09

      Tasks: 720 total,   3 running, 717 sleeping,   0 stopped, 0 zombie

      Cpu(s):  3.6%us, 0.1%sy,  0.0%ni, 96.2%id,  0.1%wa, 0.0%hi,  0.0%si,  0.0%st

      Mem:  32922004k total, 32163336k used,   758668k free,   622904k buffers

      Swap: 34812844k total,   155620k used, 34657224k free, 26114968k cached

       

        PID    USER      PR NI  VIRT     RES   SHR     S   %CPU %MEM    TIME+          COMMAND

      29849 oracle    25  0    95808  47m  15m   R    99.4    0.1           190357:44   frmweb

      30478 oracle    25  0    90240  44m  14m   R   99.4      0.1           42066:22     frmweb

      3721  oracle    16  0    111m   67m  15m    S   1.9         0.2           0:14.17        frmweb

      6063  oracle    15  0    13180  1540  756    R   1.9        0.0            0:00.01         top

          1      root       15  0    10372  696     588    S  0.0        0.0             2:05.56         init

          2     root         RT -5   0.0       0 S       0.0 0.0   1:00.01    migration/0

          3 root 34  19     0 0    0 S  0.0 0.0   0:44.49 ksoftirqd/0

          4 root RT  -5     0 0    0 S  0.0 0.0   0:00.00 watchdog/0

          5 root RT  -5     0 0    0 S  0.0 0.0   0:37.66 migration/1

          6 root 34  19     0 0    0 S  0.0 0.0   0:47.33 ksoftirqd/1

          7 root RT  -5     0 0    0 S  0.0 0.0   0:00.00 watchdog/1

          8 root RT  -5     0 0    0 S  0.0 0.0   0:27.29 migration/2

          9 root 34  19     0 0    0 S  0.0 0.0   0:35.13 ksoftirqd/2

         10 root RT  -5     0 0    0 S  0.0 0.0   0:00.00 watchdog/2

         11 root RT  -5     0 0    0 S  0.0 0.0   0:35.37 migration/3

         12 root 34  19     0 0    0 S  0.0 0.0   0:50.43 ksoftirqd/3

         13 root RT  -5     0 0    0 S  0.0 0.0   0:00.00 watchdog/3


       

       

      Below is the output of Apache log: (What I am concerned about the error here are any error related to OC4J .... Other errors do exist since 2 years ago and they are regarding the desktop coloring..etc .  Other DBA changed it's location because of the coloring problems on the apps...etc)
      [Wed Apr 27 07:43:54 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461732234:xxx.xxx.x.xxx:14387:0:6801,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 07:43:57 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461732237:xxx.xxx.x.xxx:12422:0:7022,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 07:44:16 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461732256:xxx.xxx.x.xxx:15687:0:1,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 07:49:52 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461732592:xxx.xxx.x.xxx:12422:0:7028,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 07:49:53 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461732593:xxx.xxx.x.xxx:12422:0:7029,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 07:56:15 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461732975:xxx.xxx.x.xxx:12422:0:7045,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 07:56:16 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461732976:xxx.xxx.x.xxx:12422:0:7046,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

       

      [Wed Apr 27 08:12:58 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461733978:xxx.xxx.x.xxx:14386:0:7276,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 08:13:29 2016] [error] [client xxx.xx.xx.xx] [ecid: 1461734009:xxx.xxx.x.xxx:12426:0:6197,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 08:13:30 2016] [error] [client xxx.xx.xx.xx] [ecid: 1461734010:xxx.xxx.x.xxx:12426:0:6198,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 08:21:16 2016] [notice]  configured -- resuming normal operations

      [Wed Apr 27 08:21:16 2016] [notice] Accept mutex: fcntl (Default: fcntl)

      [Wed Apr 27 08:31:50 2016] [error] [client xxx.xx.xx.xx] [ecid: 1461735110:xxx.xxx.x.xxx:16786:0:12,0] mod_oc4j: There is no oc4j process (for destination: application://oacore) available to service request.

      [Wed Apr 27 08:33:18 2016] [notice]  configured -- resuming normal operations

      [Wed Apr 27 08:33:18 2016] [notice] Accept mutex: fcntl (Default: fcntl)

      [Wed Apr 27 08:34:44 2016] [error] [client xxx.xx.xx.xxx] [ecid: 1461735284:xxx.xxx.x.xxx:18482:0:2,0] mod_oc4j: Failed to find a failover oc4j process for session request for destination: application://oacore (no island or jgroup).

      [Wed Apr 27 08:35:14 2016] [error] [client xxx.xx.xx.xx] [ecid: 1461735314:xxx.xxx.x.xxx:20312:0:1,0] mod_oc4j: Failed to find a failover oc4j process for session request for destination: application://oacore (no island or jgroup).

      [Wed Apr 27 08:35:25 2016] [error] [client xxx.xx.xx.xx] [ecid: 1461735325:xxx.xxx.x.xxx:18482:0:16,0] File does not exist: /apps/prod/apps/apps_st/comn/java/classes//

      [Wed Apr 27 08:35:56 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461735356:xxx.xxx.x.xxx:18483:0:10,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 08:35:56 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461735356:xxx.xxx.x.xxx:18483:0:11,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 08:36:09 2016] [error] [client xxx.xx.xx.xx] [ecid: 1461735369:xxx.xxx.x.xxx:20183:0:5,0] mod_oc4j: Failed to find a failover oc4j process for session request for destination: application://oacore (no island or jgroup).

      [Wed Apr 27 08:41:33 2016] [error] [client xxx.xx.xx.xxx] [ecid: 1461735693:xxx.xxx.x.xxx:20302:0:16,0] mod_oc4j: Failed to find a failover oc4j process for session request for destination: application://oacore (no island or jgroup).

      [Wed Apr 27 08:41:38 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461735698:xxx.xxx.x.xxx:20653:0:2,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 08:41:57 2016] [error] [client xxx.xx.xx.xxx] [ecid: 1461735717:xxx.xxx.x.xxx:18477:0:138,0] File does not exist: /apps/prod/apps/apps_st/comn/java/classes/oracle/forms/engine/RunformBundle_ar_US.properties

      [Wed Apr 27 08:42:19 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461735739:xxx.xxx.x.xxx:20183:0:56,0] File does not exist: /apps/prod/inst/apps/PROD_erpappsprod/portal/favicon.ico

      [Wed Apr 27 08:43:29 2016] [error] [client xxx.xx.xx.xxx] [ecid: 1461735809:xxx.xxx.x.xxx:18483:0:58,0] File does not exist: /apps/prod/apps/apps_st/comn/java/classes//

      [Wed Apr 27 08:43:31 2016] [error] [client xxx.xx.xx.xxx] [ecid: 1461735811:xxx.xxx.x.xxx:20314:0:15,0] File does not exist: /apps/prod/apps/apps_st/comn/java/classes/oracle/forms/engine/RunformBundle_ar_SA.class

      [Wed Apr 27 08:43:31 2016] [error] [client xxx.xx.xx.xxx] [ecid: 1461735811:xxx.xxx.x.xxx:20314:0:16,0] File does not exist: /apps/prod/apps/apps_st/comn/java/classes/oracle/forms/engine/RunformBundle_ar_SA.properties

      [Wed Apr 27 08:49:06 2016] [error] [client xxx.xxx.x.xx] [ecid: 1461736146:xxx.xxx.x.xxx:18483:0:89,0] File does not exist: /apps/prod/apps/apps_st/comn/java/classes//

       

       

       

       

       

       

       

      The alert<sid>.log  file shows no error


      My database version is : 11.2.0.3.0
      My apps : 12.1
      My OS :  Linux
      $ uname -a

      Linux  2.6.18-348.el5 #1 SMP Wed Jan 9 08:26:59 PST 2013 x86_64 x86_64 x86_64 GNU/Linux

       

       

      In my case it seems that there is no sufficient memory free space in RAM.  Do I need to add RAM or there is another solution?
      If there is a solution other than adding RAM , it would be better.  Adding RAM want it to be the last solution (if lacking memory space is the reason).
      Providing an explanation of the problem and the solution  would be much appreciated.