13 Replies Latest reply on Dec 5, 2017 8:22 AM by Bashar.

    EBS R12.1 on VM Oracle Cloud IaaS

    Beauty_and_dBest

      Hi ALL,

       

      EBS R12.1.3

      11gR2

      OL6

      Oracle Cloud VM IaaS.

       

       

      We have issues in bouncing our database in Oracle Cloud.

      The disk seems slow sometimes and sometime okay.

      I can say this because every time we startup or shutdown our database, there is 12.5% I/O wait.

      Capture.GIF

      Is this normal? Or there is somethings cause of database to stop and start very loooong time

      How do I complain this to Oracle Cloud support?

       

       

      Please help....

       

      Kind regards,

      jc

        • 1. Re: EBS R12.1 on VM Oracle Cloud IaaS
          Bashar.

          Hi,

           

          How much time does it take to startup/shutdown the database?

           

          It does not necessarily mean that there is something wrong in the infrastructure especially if the database operates normally after startup.

           

          Regards,

          Bashar

          • 2. Re: EBS R12.1 on VM Oracle Cloud IaaS
            Beauty_and_dBest

            Hi Bashar and ALL,

             

            How much time does it take to startup/shutdown the database? It usually took only less than 15 seconds, but now it took like 5 minutes.

             

            I can feel it, once It start and stop very slow or very long time, the performance is not good as well.

            The problem is that it does not manifest on "top" monitoring and in alert log. I just suspect the issue is on the host server?

            I can not understand why on the same server, there lies also the TEST instance along with the PROD instance.

            But I can stop/start the TEST instance  fast.

             

             

            Kind regards,

            • 3. Re: EBS R12.1 on VM Oracle Cloud IaaS
              Bashar.

              Run the below command immediately before you start/stop the database and post the output:

               

              sar 3 30

               

              Regards,

              Bashar

              • 4. Re: EBS R12.1 on VM Oracle Cloud IaaS
                Beauty_and_dBest

                Thanks Bashar,

                 

                I will do it next time.

                 

                The issue was resolved after 4 times of bouncing the database.

                 

                Kind regards,

                • 5. Re: EBS R12.1 on VM Oracle Cloud IaaS
                  Beauty_and_dBest

                  Hi Bashar,

                   

                  This is just what we have observed.

                  After the cloud EBS instance is running for 1 week, more or less, there come a time that we can not login to it anymore

                  There is some "limit" has been reached?

                  I just scheduled a script to stop/start (or bounce) the EBS instance at midnight, hoping this will resolve the issue.

                   

                   

                  Kind regards,

                  • 6. Re: EBS R12.1 on VM Oracle Cloud IaaS
                    Bashar.

                    You have to investigate the issue when it happens.

                    There is no limit of any kind on how long an EBS instance will stay working on Oracle Cloud.

                    Maybe you have memory limitations and the application simply ran into some sort of issue because of that.

                     

                    What are the specs of the cloud instance?

                     

                    Regards,

                    Bashar

                    • 7. Re: EBS R12.1 on VM Oracle Cloud IaaS
                      Beauty_and_dBest

                      Hi Bashar,

                       

                       

                      I already the the Memory and CPU and there is so lots of Free (at the time the issue happened)

                      Memory = 30Gb

                      CPU = 4 Ocpu  = 8 Cpu

                      Disk = 1 TB

                      There is no problem with resources, when I monitored using "top". I suspect it could network issue at the host level.

                      Capture7.PNG

                      Actually we migrated first  this Prod EBS 12.1.3 on AWS and it did not encounter any performance or connection issue

                      We migrated it to Oracle Cloud because it is cheaper.

                       

                      Other issues occurred Oracle cloud sometimes it happened that we can not connect putty to the Oracle Cloud.

                      Even if we reboot the instance, the putty still can not connect.

                      What we did it to stop the instance. And it is weird in OCI (Oracle Cloud Infra), if you stop the instance, it will release the internal IP and generates new IP I need to run autoconfig to be able to startup the instance, too many hassles in OCI.

                       

                      But this never happened in AWS.  Even if we stop the instance, it still retains its internal IP.

                       

                      Please comment.

                       

                       

                      Kind regards,

                      • 8. Re: EBS R12.1 on VM Oracle Cloud IaaS
                        Bashar.

                        I have no idea why you are having these issues.

                        Maybe you should log a SR with Cloud Support when it happens.

                        You can also come here for advice or use another forum dedicated to OCI.

                         

                        There is nothing related to EBS in this case.

                         

                        Regards,

                        Bashar

                        • 9. Re: EBS R12.1 on VM Oracle Cloud IaaS
                          Beauty_and_dBest

                          Hi Bashar, and everyone,

                           

                          I already did log and SR many times ,but it seems the support handling is not from OCI itself.

                          And they just respond that they do not see issues in the host server, when in fact there is DNS issue,

                          because a simple sqlplus apps/apps from  appstier hangs, and can not connect to the database.

                           

                          But after, logging SR with 3 hours of hanging issues the DNS issue was resolved. I do not know who fixed it.

                           

                           

                          Kind regards,

                          • 10. Re: EBS R12.1 on VM Oracle Cloud IaaS
                            Beauty_and_dBest

                            Hi Bashar and ALL,

                             

                            I happened again, our EBS hangs, no one can login.

                            The is high I/O waits

                            I tried again to stop/apps but it took soooooo long.

                             

                            [oraprod@abc ~]$ sar 3 30

                            Linux 3.8.13-118.14.2.el6uek.x86_64 (abc.oracloud.com)       12/01/2017      _x86_64_        (8 CPU)

                             

                            03:45:15 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle

                            03:45:18 PM     all      0.04      0.00      0.04     12.46      0.00     87.45

                            03:45:21 PM     all      0.08      0.00      0.00     12.46      0.00     87.45

                            03:45:24 PM     all      0.08      0.00      0.00     12.47      0.00     87.45

                            03:45:27 PM     all      0.08      0.00      0.04     12.42      0.00     87.45

                            03:45:30 PM     all      0.04      0.00      0.00     12.47      0.00     87.49

                            03:45:33 PM     all      0.08      0.00      0.00     12.43      0.00     87.48

                            03:45:36 PM     all      0.17      0.00      0.04     12.34      0.00     87.45

                            03:45:39 PM     all      0.08      0.00      0.00     12.47      0.00     87.45

                            03:45:42 PM     all      0.08      0.00      0.04     12.46      0.00     87.41

                            03:45:45 PM     all      0.08      0.00      0.00     12.43      0.00     87.49

                            03:45:48 PM     all      0.04      0.00      0.00     12.47      0.00     87.49

                            03:45:51 PM     all      0.08      0.00      0.00     12.47      0.00     87.45

                            03:45:54 PM     all      0.08      0.00      0.04     12.42      0.00     87.46

                            03:45:57 PM     all      0.04      0.00      0.00     12.39      0.04     87.53

                            03:46:00 PM     all      0.08      0.00      0.00     12.42      0.00     87.49

                            03:46:03 PM     all      0.04      0.00      0.04     12.43      0.00     87.49

                            03:46:06 PM     all      0.08      0.00      0.00     12.42      0.00     87.49

                            03:46:09 PM     all      0.08      0.00      0.04     12.42      0.00     87.46

                            03:46:12 PM     all      0.08      0.00      0.00     12.39      0.00     87.53

                            03:46:15 PM     all      0.04      0.00      0.00     12.43      0.00     87.53

                            03:46:18 PM     all      0.08      0.00      0.00     12.42      0.00     87.49

                            03:46:21 PM     all      0.04      0.00      0.00     12.39      0.00     87.57

                            03:46:24 PM     all      0.12      0.00      0.04     12.41      0.00     87.42

                            03:46:27 PM     all      0.04      0.00      0.00     12.40      0.00     87.56

                            03:46:30 PM     all      0.08      0.00      0.00     12.42      0.00     87.49

                            03:46:33 PM     all      0.04      0.00      0.04     12.42      0.00     87.49

                            03:46:36 PM     all      0.08      0.00      0.00     12.42      0.00     87.49

                            03:46:39 PM     all      0.25      0.00      0.00     12.26      0.00     87.49

                            03:46:42 PM     all      0.08      0.00      0.04     12.34      0.00     87.54

                            03:46:45 PM     all      0.04      0.00      0.00     12.39      0.00     87.57

                            Average:        all      0.08      0.00      0.01     12.42      0.00     87.49

                             

                             

                            Please help....

                             

                             

                            Kind regards,

                            • 11. Re: EBS R12.1 on VM Oracle Cloud IaaS
                              Bashar.

                              Do you still experience this issue?

                              Have you noticed whether the OS was responsive as usual or there was some delay when executing commands?

                               

                              Regards,

                              Bashar

                              • 12. Re: EBS R12.1 on VM Oracle Cloud IaaS
                                Beauty_and_dBest

                                Hi Bashar,

                                 

                                Yes we often encounter this issue. I can not understand why the users can not login? and after many attempts or sometime later they can login.

                                Is there process limit  been reached? What statistics should I monitor?

                                 

                                Kind regards,

                                • 13. Re: EBS R12.1 on VM Oracle Cloud IaaS
                                  Bashar.

                                  Make sure that you have all the OS prereqs met and when you have this case log a severity 1 SR with Oracle Support.

                                   

                                  Regards,

                                  Bashar