14 Replies Latest reply on Jul 12, 2017 6:36 AM by Beauty_and_dBest

    Many OC4J oacore?

    Beauty_and_dBest

      Hi ALL,

       

      EBS R12.1.3

      OL6

       

      We have two PROD  EBS R12.1.3  instances.

       

      The first has this ompn status:

      Capture2.PNG

       

      While the second Instance has this opmn status:

      Capture.PNG

       

      What is the advantage of many OC4J forms and oacore? This instance has lots of users though.

      This instance often shows warning as well like:

       

      ****************************************************

      ERROR : Timed out( 100000 ): Interrupted Exception

       

      You are running adoacorectl.sh version 120.13

      Starting OPMN managed OACORE OC4J instance  ...

      ****************************************************

      Executing service control script:

      /fin_app/PROD/inst/apps/PROD_eagle/admin/scripts/adoacorectl.sh start

      script returned:

      ****************************************************

      ERROR : Timed out( 100000 ): Interrupted Exception

       

      You are running adoacorectl.sh version 120.13

      Starting OPMN managed OACORE OC4J instance  ...

      ****************************************************

      Executing service control script:

      /fin_app/PROD/inst/apps/PROD_eagle/admin/scripts/adformsctl.sh start

      script returned:

      ****************************************************

      ERROR : Timed out( 100000 ): Interrupted Exception

       

      You are running adformsctl.sh  version 120.16.12010000.3

      Starting OPMN managed FORMS OC4J instance  ...

      Calling txkChkFormsDeployment.pl to check whether latest FORMSAPP.EAR is deployed

       

       

      Please help...

       

      Kind regards,

      jc

        • 1. Re: Many OC4J oacore?
          handat

          Each process can handle a number of requests. If you have more of those processes, then in theory, your server will be handle a lot more concurrent requests assuming you have plenty of hardware to support those processes. So in theory, the more spare CPUs you have, the more additional processes you can add to handle additional load. If you don't have the spare CPU capacity and add more processes, then your system performance will suffer.

          The number of processes you should have will depend on the number and type of CPU you have as well as the user load.

          Also, the interrupt messages you see are most likely caused by users who request services from their browsers but then press the stop/cancel/reload button on their browser before the request has completed. In this case, if a lot of your users do that, then potentially, the threads in your process could all be waiting for such actions to time out and you end up with no thread/process left to handle new user requests. In such cases, you will need additional process(es), to overcome the many existing/interrupted requests that are waiting to timeout. If you have a lot of interrupted requests, you might need to investigate why they are happening so frequently, either your processes take too long and users are just fed up waiting, or your users are very impatient (or wrongfully expect millisecond response times) when there is valid processing happening that is expected to take a few seconds. If it is the first case, you might need to add system capacity, whereas the seconds case, you might just need to print a message or have a spinning clock advising the user to wait a bit.

          • 2. Re: Many OC4J oacore?
            Kanda-Oracle

            Hi JC,

             

            Based on the User load you need to add jvms (oacore) to get better performance.  (Doc ID 362851.1) should provide sizing details..

             

             

            Hope this helps!

             

            Thanks


            N Kandasamy

            • 3. Re: Many OC4J oacore?
              Beauty_and_dBest

              Thanks Kanda and Handat,

               

              The irony is the two servers have just same CPU power

              And the one with lots of Oacore is performing slow or is problematic.

              How do I revert back to the default number of oacores?

               

               

              Kind regards,

              • 4. Re: Many OC4J oacore?
                handat

                You might want tp rebalance the oacore instances and remove some from the second machine and add them to the first machine, like 3 or 4 each and monitor how things go.

                • 5. Re: Many OC4J oacore?
                  Beauty_and_dBest

                  Thanks Handat,

                   

                  But we only have one machine server for apps tier?

                  How many CPU should be allocated to each oacore process?

                   

                   

                  Kind regards,

                  • 6. Re: Many OC4J oacore?
                    Kanda-Oracle

                    Hi JC,

                     

                    1. Refer the (Doc ID 362851.1) to know how many JVM/OC4J instances per CPU core you can define.

                    2. To revert, check out s_oacore_nprocs in your context file; change according to you requirement.

                     

                    Thanks!

                    N Kandasamy

                    • 7. Re: Many OC4J oacore?
                      handat

                      It depends on the CPU type and number of cores they have. In the past it was easy, 1 CPU for each JVM, but nowadays, the concept of cores is more prevalent with CPUs having multiple sockets on modern hardware and the JVM is much better at multi-threading across cores.

                      I would allocate 2 cores per JVM as a starting point.

                      • 8. Re: Many OC4J oacore?
                        Beauty_and_dBest

                        Thanks Handat and Kanda,

                         

                        How much estimate CPU do we need for the following oacores?Capture.PNG

                         

                         

                        Kind regards,

                        • 9. Re: Many OC4J oacore?
                          Kanda-Oracle

                          You may monitor CPU Usage and Idle time, during peak time.

                          sar 2 20

                          top

                          • 10. Re: Many OC4J oacore?
                            Beauty_and_dBest

                            Thanks

                             

                            [applmgr@moli ~]$ sar 2 20

                            Linux 3.8.13-118.14.2.el6uek.x86_64 (moli.oracloud.com)       07/12/2017      _x86_64_        (8 CPU)

                             

                             

                            12:32:05 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle

                            12:32:07 AM     all      0.06      0.00      0.06      0.25      0.00     99.62

                            12:32:09 AM     all      0.13      0.00      0.00      0.13      0.00     99.75

                            12:32:11 AM     all      0.19      0.00      0.19      0.63      0.00     99.00

                            12:32:13 AM     all      0.06      0.00      0.00      0.31      0.00     99.62

                            12:32:15 AM     all      0.25      0.00      0.19      1.19      0.00     98.38

                            12:32:17 AM     all      0.81      0.00      0.13      0.88      0.00     98.19

                            12:32:19 AM     all      0.06      0.00      0.00      0.00      0.00     99.94

                            12:32:21 AM     all      0.12      0.00      0.06      0.25      0.00     99.56

                            12:32:23 AM     all      0.13      0.00      0.13      0.50      0.00     99.25

                            12:32:25 AM     all      0.06      0.00      0.06      0.12      0.00     99.75

                            12:32:27 AM     all      0.38      0.00      0.06      0.19      0.06     99.31

                            12:32:29 AM     all      0.19      0.00      0.00      0.44      0.00     99.37

                            12:32:31 AM     all      0.00      0.00      0.00      0.00      0.00    100.00

                            12:32:33 AM     all      0.13      0.00      0.06      3.32      0.00     96.50

                            12:32:35 AM     all      0.13      0.00      0.00      0.44      0.00     99.44

                            12:32:37 AM     all      0.06      0.00      0.06      0.12      0.00     99.75

                            12:32:39 AM     all      0.12      0.00      0.06      0.25      0.00     99.56

                            12:32:41 AM     all      0.13      0.00      0.00      0.25      0.00     99.62

                            12:32:43 AM     all      0.06      0.00      0.06      0.12      0.00     99.75

                            12:32:45 AM     all      0.13      0.00      0.00      0.38      0.00     99.50

                            Average:        all      0.16      0.00      0.06      0.49      0.00     99.29

                            [applmgr@moli ~]$

                            • 11. Re: Many OC4J oacore?
                              Kanda-Oracle

                              Its good that you could get 90% idle time, during peak time.    

                              • 12. Re: Many OC4J oacore?
                                Beauty_and_dBest

                                Its our test server

                                 

                                I do not have access to PROD server, its secured by PCIDSS

                                 

                                 

                                Kind regards

                                • 13. Re: Many OC4J oacore?
                                  Kanda-Oracle

                                  Hi,

                                   

                                  1. Refer the (Doc ID 362851.1) to do sizing ...... How many JVM/OC4J instances per CPU core you can define.

                                   

                                  2. To change no of jvms, check out s_oacore_nprocs in your context file; change according to you requirement.

                                   

                                  Thanks!

                                   

                                  N Kandasamy

                                  • 14. Re: Many OC4J oacore?
                                    Beauty_and_dBest

                                    Thanks Kanda,

                                     

                                    You mean I can edit directly the context_file?

                                    I thought it is now allowed