12 Replies Latest reply on Oct 22, 2019 7:08 AM by Beauty_and_dBest

    EBS 12.2.7 frmweb 100% cpu

    Beauty_and_dBest

      EBS 12.2.7

      12c

      OL6

       

      Hi ALL,

       

      We have frmweb process that is consistently running at  100% cpu, which is running for a Loooong time.

      How do I fix this, or check if this has error , or already runaway process?

       

      Please help...

       

       

      Kind regards,

        • 1. Re: EBS 12.2.7 frmweb 100% cpu
          Maaz Khan

          Hello Jc,

           

          Can you please refer below doc ids.

          Forms Process (FRMWEB) Consumes 100% of CPU in Oracle Applications R12 (Doc ID 745711.1)

          R12.1.3: frmweb Processes Exhaust CPU After Retrieving Large Number of Records (Doc ID 2303970.1)

           

           

          Basically you should be checking below -

          1. Check for form session, in most cases, there are end-users who are using LOVs and retrieving large amount of data, this can cause high cpu.

          2. You can limit number of records to be fetched in LOVs but it has its own implications and needs to be tested thoroughly before implementing context variables in prod.

          3. Check for logfiles for same frmweb process under $FORMS_TRACE_DIR

           

           

          You can also refer my blog for few scenarios with high cpu,

          OraclExuberance: Forms Abnormal Termination - FORMS_CATCHTERM, FORMS_RECORD_GROUP_MAX & FORMS_MMAP

           

           

          Regards,

          Maaz

           

          • 2. Re: EBS 12.2.7 frmweb 100% cpu
            Beauty_and_dBest

            Thanks Maaz and ALL,

            • 3. Re: EBS 12.2.7 frmweb 100% cpu
              Kanda-Oracle

              Hi

               

              In case If the above notes did note help..

               

              1. Are there any core file getting generated? ensure you set core file setting on Form Tier.

               

              $ ulimit -a

                  core file size          (blocks, -c) 0

                   :

               

              2. Does it create any file frmweb_dump_<pid> under $FORMS_TRACE_DIR ?

               

               

              3. Whats your forms version ? Is it latest ?

               

               

              4. whats FORMS_CATCHTERM is set to ?

               

               

              FORMS_LOV_INITIAL

              FORMS_RECORD_GROUP_MAX

              FORMS_TRACE_DIR

               

              Thanks!

              • 4. Re: EBS 12.2.7 frmweb 100% cpu
                Beauty_and_dBest

                Thanks Kanda and ALL,

                 

                Can you share me what command to run please?

                 

                It is just echo

                $FORMS_LOV_INITIAL

                $FORMS_RECORD_GROUP_MAX

                $FORMS_TRACE_DIR

                 

                 

                Kind regards,

                • 5. Re: EBS 12.2.7 frmweb 100% cpu
                  Maaz Khan

                  Hello Jc,

                   

                  Yes, above echo commands will give you values after sourcing run fs.

                  You can also try below after sourcing run fs-

                  env | grep FORMS_LOV_INITIAL

                  env | grep FORMS_RECORD_GROUP_MAX
                  env | grep FORMS_TRACE_DIR

                   

                   

                  Regards,

                  Maaz

                  • 6. Re: EBS 12.2.7 frmweb 100% cpu
                    Beauty_and_dBest

                    Thanks ALL,

                     

                    The "top" monitor display time of the runaway frmweb process is  18633:59    Is the first digit in minutes?

                    Or it was running away for 18633 minutes of  or 310 hrs? or  12 days?

                     

                     

                    Kind regards,

                    • 7. Re: EBS 12.2.7 frmweb 100% cpu
                      Beauty_and_dBest

                      Hi Kanda and ALL,

                       

                      Below are the variable settings.

                       

                        Sourcing the RUN File System ...

                       

                       

                      [appprod@ebs ~]$ echo $FORMS_LOV_INITIAL

                      5000

                       

                      [appprod@ebs ~]$ echo $FORMS_RECORD_GROUP_MAX

                       

                      [appprod@ebs ~]$ echo $FORMS_TRACE_DIR

                      /u01/appprod/PROD/fs2/inst/apps/PROD_ebs/logs/ora/10.1.2/forms

                       

                      [appprod@ebs ~]$ echo $FORMS_CATCHTERM

                      1

                       

                       

                      [appprod@ebs ~]$ ulimit -a

                      core file size          (blocks, -c) 0

                      data seg size           (kbytes, -d) unlimited

                      scheduling priority             (-e) 0

                      file size               (blocks, -f) unlimited

                      pending signals                 (-i) 515711

                      max locked memory       (kbytes, -l) 64

                      max memory size         (kbytes, -m) unlimited

                      open files                      (-n) 4096

                      pipe size            (512 bytes, -p) 8

                      POSIX message queues     (bytes, -q) 819200

                      real-time priority              (-r) 0

                      stack size              (kbytes, -s) 10240

                      cpu time               (seconds, -t) unlimited

                      max user processes              (-u) 2047

                      virtual memory          (kbytes, -v) unlimited

                      file locks                      (-x) unlimited

                      [appprod@ebs ~]$

                       

                      Can you please advise if I need to set parameters or adjust its value?

                       

                      Why is that the max user processes for the appsTier above is only 2047?   and stack of  10240?

                      Are the above value sufficient?

                       

                       

                      As compared to ulimit of our database Tier below:

                       

                      [oraprod@ebs2 ~]$ ulimit -a

                      core file size          (blocks, -c) unlimited

                      data seg size           (kbytes, -d) unlimited

                      scheduling priority             (-e) 0

                      file size               (blocks, -f) unlimited

                      pending signals                 (-i) 1030118

                      max locked memory       (kbytes, -l) 197817042

                      max memory size         (kbytes, -m) unlimited

                      open files                      (-n) 131072

                      pipe size            (512 bytes, -p) 8

                      POSIX message queues     (bytes, -q) 819200

                      real-time priority              (-r) 0

                      stack size              (kbytes, -s) 8192

                      cpu time               (seconds, -t) unlimited

                      max user processes              (-u) 131072

                      virtual memory          (kbytes, -v) unlimited

                      file locks                      (-x) unlimited

                      [oraprod@ebs2 ~]$

                       

                       

                       

                      Please help...

                       

                       

                      Kind regards,

                      • 8. Re: EBS 12.2.7 frmweb 100% cpu
                        Kanda-Oracle

                        Hi

                        Refer (Doc ID 1330701.1)

                        Open the /etc/security/limits.conf file and check out for "hard" and "soft"

                        Thanks!

                        • 9. Re: EBS 12.2.7 frmweb 100% cpu
                          Kanda-Oracle

                          Hi

                           

                          Also Please check FORMS_TRACE_DIR at regular interval  to see if you have any core file or errors.

                           

                          Thanks!

                          • 10. Re: EBS 12.2.7 frmweb 100% cpu
                            Beauty_and_dBest

                            Hi Kanda and ALL,

                             

                            Our Forms variable  below has no value, what value do I supply it?

                             

                            [appprod@ebs ~]$ echo $FORMS_RECORD_GROUP_MAX

                             

                             

                             

                            Before we always encountered weblogic java error (cpu rise up to 500%) and all the self-service users can not login.

                            image.png

                            We  have adjusted our weblogic oracore1 to 3G, but now after sometime we still hit java runaway process and warning error

                            Same as what has happened before when the value was still 2G, How much limit can we go higher?

                            Or is there a clean script that will clean memory leaks of weblogic java?

                             

                             

                            Kind regards,

                            • 11. Re: EBS 12.2.7 frmweb 100% cpu
                              Kanda-Oracle

                              Hi

                               

                              You may set FORMS_RECORD_GROUP_MAX to 10000 and monitor any users complains that its too restrictive as mentioned  (Doc ID 2190037.1)

                               

                              Thanks!

                              • 12. Re: EBS 12.2.7 frmweb 100% cpu
                                Beauty_and_dBest

                                Thanks Kanda and ALL,