0 Replies Latest reply: Jul 2, 2012 3:58 AM by 895623 RSS

    Find the cause of high CPU usr load

    895623
      Hi,

      I've got 2 servers running an application within a jvm. Both of them show high load for this process. Microstate info shows that it belongs to usr:

      PID USERNAME USR SYS TRP TFL DFL LCK SLP LAT VCX ICX SCL SIG PROCESS/LWPID
      910 myuser 26 0.0 0.0 0.0 0.0 74 0.0 0.2 1 594 5 0 java/75
      910 myuser 21 0.0 0.1 0.0 0.0 79 0.0 0.6 3 653 12 0 java/232
      910 myuser 20 0.0 0.0 0.0 0.0 80 0.0 0.2 1 228 5 0 java/63
      910 myuser 19 0.0 0.0 0.0 0.0 81 0.0 0.0 1 196 5 0 java/64
      910 myuser 18 0.0 0.0 0.0 0.0 82 0.0 0.1 1 370 5 0 java/47
      910 myuser 17 0.0 0.0 0.0 0.0 82 0.0 0.1 16 228 19 0 java/13
      910 myuser 17 0.0 0.0 0.0 0.0 83 0.0 0.2 1 438 5 0 java/233
      910 myuser 16 0.0 0.0 0.0 0.5 84 0.0 0.1 3 281 5 0 java/41
      910 myuser 16 0.0 0.0 0.0 0.0 84 0.0 0.1 0 290 1 0 java/72
      910 myuser 15 0.0 0.0 0.0 0.0 85 0.0 0.0 1 18 5 0 java/78
      910 myuser 15 0.0 0.0 0.0 0.0 85 0.0 0.0 1 6 5 0 java/76
      910 myuser 14 0.0 0.0 0.0 0.0 86 0.0 0.0 1 35 5 0 java/231
      910 myuser 14 0.2 0.0 0.0 0.0 85 0.0 0.8 476 361 4K 0 java/11
      910 myuser 14 0.2 0.0 0.0 0.0 85 0.0 0.8 1K 525 2K 0 java/12
      910 myuser 14 0.0 0.0 0.0 0.0 86 0.0 0.1 1 180 5 0 java/46
      910 myuser 14 0.0 0.0 0.0 0.0 86 0.0 0.0 1 169 5 0 java/74
      910 myuser 14 0.0 0.0 0.0 0.7 85 0.0 0.1 6 277 5 0 java/234
      910 myuser 14 0.0 0.0 0.0 0.0 86 0.0 0.1 1 181 6 0 java/39
      910 myuser 13 0.0 0.0 0.0 0.0 87 0.0 0.1 0 153 1 0 java/236
      910 myuser 13 0.0 0.0 0.0 0.5 87 0.0 0.0 4 11 5 0 java/38
      910 myuser 11 0.0 0.0 0.0 0.0 89 0.0 0.0 1 5 6 0 java/50
      910 myuser 6.7 0.0 0.0 0.0 0.0 93 0.0 0.0 0 25 1 0 java/52
      910 myuser 0.4 0.0 0.0 0.0 0.0 100 0.0 0.0 5 2 15 0 java/4
      910 myuser 0.4 0.0 0.0 0.0 0.0 100 0.0 0.0 13 1 32 0 java/6
      910 myuser 0.4 0.0 0.0 0.0 0.0 100 0.0 0.0 8 5 17 0 java/5
      910 myuser 0.4 0.0 0.0 0.0 0.0 100 0.0 0.0 19 3 37 0 java/3
      910 myuser 0.3 0.0 0.0 0.0 0.0 100 0.0 0.1 10 27 18 0 java/8
      910 myuser 0.3 0.0 0.0 0.0 0.0 100 0.0 0.1 13 23 21 0 java/9
      910 myuser 0.3 0.0 0.0 0.0 0.0 100 0.0 0.1 4 38 12 0 java/10
      910 myuser 0.3 0.0 0.0 0.0 0.0 100 0.0 0.2 17 14 28 0 java/7
      910 myuser 0.2 0.0 0.0 0.0 0.0 100 0.0 0.0 10 0 26 0 java/14
      910 myuser 0.1 0.0 0.0 0.0 0.2 100 0.0 0.0 2 4 5 0 java/48
      910 myuser 0.1 0.0 0.0 0.0 0.0 100 0.0 0.0 1 6 5 0 java/77
      910 myuser 0.1 0.0 0.0 0.0 0.0 100 0.0 0.0 1 4 5 0 java/235
      910 myuser 0.1 0.0 0.0 0.0 0.0 100 0.0 0.0 1 0 5 0 java/49
      910 myuser 0.1 0.0 0.0 0.0 0.0 100 0.0 0.0 1 0 5 0 java/68
      910 myuser 0.1 0.0 0.0 0.0 0.0 100 0.0 0.0 1 1 5 0 java/69
      910 myuser 0.1 0.0 0.0 0.0 0.0 100 0.0 0.0 1 0 5 0 java/42
      910 myuser 0.1 0.0 0.0 0.0 0.0 100 0.0 0.0 1 0 5 0 java/70
      910 myuser 0.1 0.0 0.0 0.0 0.0 100 0.0 0.0 1 0 6 0 java/67
      910 myuser 0.1 0.0 0.0 0.0 1.1 99 0.0 0.0 4 5 5 0 java/79
      910 myuser 0.0 0.0 0.0 0.0 0.0 0.2 100 0.0 251 0 251 0 java/45
      910 myuser 0.0 0.0 0.0 0.0 0.0 100 0.0 0.0 84 3 84 0 java/22
      Total: 1 processes, 74 lwps, load averages: 3.37, 3.62, 3.50

      I've tried to catch the cause for that calling the hotuser d script. Unfortunately the function names cannot be resolved by the sym table:

      ...
      ...
      0xfffffd7ffacec7c0 52 1.3%
      0xfffffd7ffacdb3b1 53 1.4%
      0xfffffd7ffad76be7 54 1.4%
      0xfffffd7ffacdb2c4 57 1.5%
      0xfffffd7ffadcc1f9 61 1.6%
      0xfffffd7ffae48040 66 1.7%
      0xfffffd7ffaf54c87 66 1.7%
      0xfffffd7ffaf54c80 73 1.9%
      0xfffffd7ffad76776 76 2.0%
      0xfffffd7ffacdb3ce 87 2.3%
      0xfffffd7ffacdb410 88 2.3%
      0xfffffd7ffad76be0 89 2.3%
      0xfffffd7ffaca6bc9 101 2.6%



      I've disassembled the topmost function to get a glue (0xfffffd7ffaca6bc9::dis -n 0) ,but it did not give me any glue what exactly happens.
      Are there any ways the analyze this?

      thank you,

      kind regards,solst_ice