Forum Stats

  • 3,814,706 Users
  • 2,258,900 Discussions
  • 7,892,809 Comments

Discussions

Storage-How to calculate IOPS requirement for application

BabuRamesh
BabuRamesh Member Posts: 103
edited Apr 14, 2020 3:41AM in ZFS Storage Appliance

Hi Team,

It would be a great help if you guide me on how to calculate application IOPS requirement

Regards

Ramesh

«1

Answers

  • Nik
    Nik Blocked Member Posts: 2,879 Bronze Crown
    edited Apr 12, 2020 7:11AM

    Hi.

    The answer can be very easy and difficult at same time.

    One example:

      You know tha your application copy file with block size =4k.

      You want copy 1GB file at  10s.

      You will require:   1 * 1024 *1024  (KB) / 4 (Block size)  / 10 (s) ~ 26214 IOPS.

       You want that 10 users can do same operation.

       You will require:   1 * 1024 *1024  (KB) / 4 (Block size) * 10 (Users)  / 10 (s)  ~ 262144 IOPS

    Main problems:

        Generaly You do not know how  your application work.

        So You start some disk activity monitorig and check:

         -  What block size  realy use your application.

         -  How many iops  now use  your application.

         -  Monitor utilization of disk now.

    Yor will require more IOPS in 2 cases:

      -  You need more users with same speed.  It's more easy: Just multiple current IOPS.

      -  You need  increase perfomance. You can also mutiple current IOPS, but need check that only array is bottleneck at this moment.

    In case You plan new project and  try do array sizing -  ask software vendor  for perfomance requirements.  

    Regard,

       Nik.

  • BabuRamesh
    BabuRamesh Member Posts: 103
    edited Apr 12, 2020 7:25AM

    Hi Nik,

    Thanks for the detailed information, Below are the existing stats

    Need to calculate the estimate for Application IOPS ,Can you suggest

    ----------------------------

    GDC2-APP

    BIZ-APP_RAID6-pool

    a.       DATA

    1.       Used 23.3T and available 797G

    b.       MEMORY

    1.       96 GB mem , unused 2.84 G

    GDC2-DB

    ·         Data 8.03 T and 1.15 T available

    ·         Memory 96.GB , 3.40 GB unused

    ·         Disk IOPS 1091 ops/sec

    ·         NFSv3 : 622 ops/sec

    ·         Cache 13.2 M on disk

    GDC3- APP

    ·         Data -24TB , 1,56TB available

    ·         Mem 96.Gb, 2.80G unused

    ·         Iops – 740 ops/sec

    ·         Nfsv4 7484 ops/sec

    GDC3- db

    Data – 8.03TB  , 462 G available

    Mem- 86 GB , 3.84 G unused

    Disk 2011 ops/sec

    Storage.jpg

    GDC2-APP

    BIZ-APP_RAID6-pool

    a.       DATA

    1.       Used 23.3T and available 797G

    b.       MEMORY

    1.       96 GB mem , unused 2.84 G

    GDC2-DB

    ·         Data 8.03 T and 1.15 T available

    ·         Memory 96.GB , 3.40 GB unused

    ·         Disk IOPS 1091 ops/sec

    ·         NFSv3 : 622 ops/sec

    ·         Cache 13.2 M on disk

    GDC3- APP

    ·         Data -24TB , 1,56TB available

    ·         Mem 96.Gb, 2.80G unused

    ·         Iops – 740 ops/sec

    ·         Nfsv4 7484 ops/sec

    GDC3- db

    Data – 8.03TB  , 462 G available

    Mem- 86 GB , 3.84 G unused

    Disk 2011 ops/sec

  • BabuRamesh
    BabuRamesh Member Posts: 103
    edited Apr 12, 2020 7:28AM

    The shared stats are from an existing application

    We are upgrading the same project,I would need to calculate IOPS for the application side. I need your suggestion to calculate the same. In the meantime I will completely understand your response

  • Nik
    Nik Blocked Member Posts: 2,879 Bronze Crown
    edited Apr 12, 2020 10:17AM

    Hi.

    What mean "upgrade project" ?  You try resolve some perfomance issue or increase size of  this project or replace some hardware?

    At this moment it's look like You got statistics from idle system.

    You should monitor system more long time for got  peak value of iops.

    For every share you have NFS IOPS and DISK IOPS.

    Regards,

       Nik

  • BabuRamesh
    BabuRamesh Member Posts: 103
    edited Apr 12, 2020 9:17PM

    Thanks, Nik.

    Its upgrade project

    However, We are facing issues with existing storage ZFS STORAGE 7320 as well.(Hitting maximum IOPS if there is no utilization also)

    We are seeing the feasibility to move to new storage. This is one part.

    Secondly, We would need to calculate IOPS requirement for Application side for upgrade project-Need your suggestions in this

    Regards

    Ramesh

  • Nik
    Nik Blocked Member Posts: 2,879 Bronze Crown
    edited Apr 13, 2020 2:44AM

    Hi.

    Again:

    1. Only You can  show how many IOPS required,  becouse  only You can say what speed of Application will enought.

        Arra can show current value of IOPS, but only You can say how many You want.

    2. For analyze perfomance issue need see whole  system, not only array.

    According provided statistics your array not have any noticeable load.

    Regards,

      Nik.

  • BabuRamesh
    BabuRamesh Member Posts: 103
    edited Apr 13, 2020 10:32AM

    Thanks, Nik.

    Are there some steps to get IO stats from Db layer?

    Based on this we can assess application IOPS

    ------------------------------

    IO activities/usage statistic  from DB layer

  • BabuRamesh
    BabuRamesh Member Posts: 103
    edited Apr 13, 2020 10:50AM

    Hi Nik

    Here is my disk utilization as of today, However we are facing lot of issues with the current storage. We are planning to migrate one of the Dr databases to new storage.

    to free some space .we want to sustain for another 5 months with this storage configuration.

    Pls suggest if any other Db we can target

    DiskGrpUtlization.jpeg

  • Nik
    Nik Blocked Member Posts: 2,879 Bronze Crown
    edited Apr 13, 2020 12:24PM

    Hi.

    This screenshot  show space utilization,  not performace.

    You say that you have many issues with storage, but not write what kind of issue.

    You can open SR for toubleshoot  arrays problems.

    Enterprise Manager   is good point for start  troubleshoot  ASM performance.

      https://docs.oracle.com/database/121/OSTMG/GUID-DADF9739-BA8B-4378-973D-AF9B3DF5981A.htm#OSTMG94271

    Regards,

      Nik

  • BabuRamesh
    BabuRamesh Member Posts: 103
    edited Apr 13, 2020 7:38PM

    Thanks, Nik for the clear Information

    1) Are we referring to Oracle enterprise manager(OEM) as a performance monitoring tool?

    2)  Can you give some idea of how to achieve this -IO activities/usage statistic  from DB layer