Storage-How to calculate IOPS requirement for application

BabuRamesh

Hi Team,

It would be a great help if you guide me on how to calculate application IOPS requirement

Regards

Ramesh

Nik

Hi.

The answer can be very easy and difficult at same time.

One example:

  You know tha your application copy file with block size =4k.

  You want copy 1GB file at  10s.

  You will require:   1 * 1024 *1024  (KB) / 4 (Block size)  / 10 (s) ~ 26214 IOPS.

   You want that 10 users can do same operation.

   You will require:   1 * 1024 *1024  (KB) / 4 (Block size) * 10 (Users)  / 10 (s)  ~ 262144 IOPS

Main problems:

    Generaly You do not know how  your application work.

    So You start some disk activity monitorig and check:

     -  What block size  realy use your application.

     -  How many iops  now use  your application.

     -  Monitor utilization of disk now.

Yor will require more IOPS in 2 cases:

  -  You need more users with same speed.  It's more easy: Just multiple current IOPS.

  -  You need  increase perfomance. You can also mutiple current IOPS, but need check that only array is bottleneck at this moment.

In case You plan new project and  try do array sizing -  ask software vendor  for perfomance requirements.  

Regard,

   Nik.

BabuRamesh

Hi Nik,

Thanks for the detailed information, Below are the existing stats

Need to calculate the estimate for Application IOPS ,Can you suggest

----------------------------

GDC2-APP

BIZ-APP_RAID6-pool

a.       DATA

1.       Used 23.3T and available 797G

b.       MEMORY

1.       96 GB mem , unused 2.84 G

GDC2-DB

·         Data 8.03 T and 1.15 T available

·         Memory 96.GB , 3.40 GB unused

·         Disk IOPS 1091 ops/sec

·         NFSv3 : 622 ops/sec

·         Cache 13.2 M on disk

GDC3- APP

·         Data -24TB , 1,56TB available

·         Mem 96.Gb, 2.80G unused

·         Iops – 740 ops/sec

·         Nfsv4 7484 ops/sec

GDC3- db

Data – 8.03TB  , 462 G available

Mem- 86 GB , 3.84 G unused

Disk 2011 ops/sec

GDC2-APP

BIZ-APP_RAID6-pool

a.       DATA

1.       Used 23.3T and available 797G

b.       MEMORY

1.       96 GB mem , unused 2.84 G

GDC2-DB

·         Data 8.03 T and 1.15 T available

·         Memory 96.GB , 3.40 GB unused

·         Disk IOPS 1091 ops/sec

·         NFSv3 : 622 ops/sec

·         Cache 13.2 M on disk

GDC3- APP

·         Data -24TB , 1,56TB available

·         Mem 96.Gb, 2.80G unused

·         Iops – 740 ops/sec

·         Nfsv4 7484 ops/sec

GDC3- db

Data – 8.03TB  , 462 G available

Mem- 86 GB , 3.84 G unused

Disk 2011 ops/sec

BabuRamesh

The shared stats are from an existing application

We are upgrading the same project,I would need to calculate IOPS for the application side. I need your suggestion to calculate the same. In the meantime I will completely understand your response

Nik

Hi.

What mean "upgrade project" ?  You try resolve some perfomance issue or increase size of  this project or replace some hardware?

At this moment it's look like You got statistics from idle system.

You should monitor system more long time for got  peak value of iops.

For every share you have NFS IOPS and DISK IOPS.

Regards,

   Nik

BabuRamesh

Thanks, Nik.

Its upgrade project

However, We are facing issues with existing storage ZFS STORAGE 7320 as well.(Hitting maximum IOPS if there is no utilization also)

We are seeing the feasibility to move to new storage. This is one part.

Secondly, We would need to calculate IOPS requirement for Application side for upgrade project-Need your suggestions in this

Regards

Ramesh

Nik

Hi.

Again:

1. Only You can  show how many IOPS required,  becouse  only You can say what speed of Application will enought.

    Arra can show current value of IOPS, but only You can say how many You want.

2. For analyze perfomance issue need see whole  system, not only array.

According provided statistics your array not have any noticeable load.

Regards,

  Nik.

BabuRamesh

Thanks, Nik.

Are there some steps to get IO stats from Db layer?

Based on this we can assess application IOPS

------------------------------

IO activities/usage statistic  from DB layer

BabuRamesh

Hi Nik

Here is my disk utilization as of today, However we are facing lot of issues with the current storage. We are planning to migrate one of the Dr databases to new storage.

to free some space .we want to sustain for another 5 months with this storage configuration.

Pls suggest if any other Db we can target

Nik

Hi.

This screenshot  show space utilization,  not performace.

You say that you have many issues with storage, but not write what kind of issue.

You can open SR for toubleshoot  arrays problems.

Enterprise Manager   is good point for start  troubleshoot  ASM performance.

  https://docs.oracle.com/database/121/OSTMG/GUID-DADF9739-BA8B-4378-973D-AF9B3DF5981A.htm#OSTMG94271

Regards,

  Nik

BabuRamesh

Thanks, Nik for the clear Information

1) Are we referring to Oracle enterprise manager(OEM) as a performance monitoring tool?

2)  Can you give some idea of how to achieve this -IO activities/usage statistic  from DB layer

Storage-How to calculate IOPS requirement for application