1 2 Previous Next 18 Replies Latest reply on Dec 9, 2015 7:32 PM by Christy H.

    Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:

    Christy H.

      Hello,

       

      My OS is:

      CentOS release 6.7 (Final)

      LSB_VERSION=base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch

       

      Oracle version:

      SQL*Plus: Release 11.2.0.2.0 Production on Tue Dec 8 08:18:36 2015

       

      Sometime my Oracle crashes. Here is the alert_XE.log output.

       

      Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
      Process W000 died, see its trace file
      Process J000 died, see its trace file
      kkjcre1p: unable to spawn jobq slave process 
      Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
      Tue Dec 08 04:39:56 2015
      Process J000 died, see its trace file
      kkjcre1p: unable to spawn jobq slave process 
      Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
      Process W000 died, see its trace file
      Process J000 died, see its trace file
      kkjcre1p: unable to spawn jobq slave process 
      Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
      Process J000 died, see its trace file
      kkjcre1p: unable to spawn jobq slave process 
      Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
      Process J000 died, see its trace file
      kkjcre1p: unable to spawn jobq slave process 
      Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
      Tue Dec 08 04:40:01 2015
      Process W000 died, see its trace file
      

       

      Please advise what should I do to get rid of this Error

       

      Thanks in anticipation

        • 1. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:

          Christy H. wrote:

           

          Hello,

           

          My OS is:

          CentOS release 6.7 (Final)

          LSB_VERSION=base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch

           

          Oracle version:

          SQL*Plus: Release 11.2.0.2.0 Production on Tue Dec 8 08:18:36 2015

           

          Sometime my Oracle crashes. Here is the alert_XE.log output.

           

          1. Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc: 
          2. Process W000 died, see its trace file 
          3. Process J000 died, see its trace file 
          4. kkjcre1p: unable to spawn jobq slave process  
          5. Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc: 
          6. Tue Dec 08 04:39:56 2015 
          7. Process J000 died, see its trace file 
          8. kkjcre1p: unable to spawn jobq slave process  
          9. Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc: 
          10. Process W000 died, see its trace file 
          11. Process J000 died, see its trace file 
          12. kkjcre1p: unable to spawn jobq slave process  
          13. Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc: 
          14. Process J000 died, see its trace file 
          15. kkjcre1p: unable to spawn jobq slave process  
          16. Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc: 
          17. Process J000 died, see its trace file 
          18. kkjcre1p: unable to spawn jobq slave process  
          19. Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc: 
          20. Tue Dec 08 04:40:01 2015 
          21. Process W000 died, see its trace file 

           

          Please advise what should I do to get rid of this Error

           

          Thanks in anticipation

           

          https://www.google.com/search?q=Process+J000+died%2C+see+its+trace+file

          • 2. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
            Christy H.

            Hello,

             

            I certainly googled but only found that is really near to my problem is Process J000 died Process W000 died and uable connect database

            Unfortunately the answer edited and original reply removed. Only that I am seeing marked as answer is Why I modifid the MEMORY_TARGET from 11g to 8g , the promblem was solved?

             

            Is anybody else facing same problem that I have? Please share with me

            • 3. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
              JuanM

              Hi,

               

              What trace file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc shows you?

               

              Regards,

              Juan M

              • 4. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                Christy H.
                Process J000 is dead (pid=30976 req_ver=2613 cur_ver=2613 state=KSOSP_SPAWNED).
                *** 2015-12-08 04:40:02.199
                
                
                ----- Call Stack Trace -----
                calling              call     entry                argument values in hex    
                location             type     point                (? means dubious value)   
                -------------------- -------- -------------------- ----------------------------
                skdstdst()+36        call     kgdsdst()            000000000 ? 000000000 ?
                                                                   7FFFC4E66248 ? 000000001 ?
                                                                   3000000001 ? 000000002 ?
                ksedst1()+98         call     skdstdst()           000000000 ? 000000000 ?
                                                                   7FFFC4E66248 ? 000000001 ?
                                                                   000000000 ? 000000002 ?
                ksedst()+34          call     ksedst1()            000000000 ? 000000001 ?
                                                                   7FFFC4E66248 ? 000000001 ?
                                                                   000000000 ? 000000002 ?
                0000000007CFA270     call     ksedst()             000000000 ? 000000001 ?
                                                                   7FFFC4E66248 ? 000000001 ?
                                                                   000000000 ? 000000002 ?
                
                
                
                --------------------- Binary Stack Dump ---------------------
                
                
                
                ========== FRAME [1] (skdstdst()+36 -> kgdsdst()) ==========
                defined by frame pointers 0x7fffc4e6ab00  and 0x7fffc4e6aaf0
                CALL TYPE: call   ERROR SIGNALED: no   COMPONENT: (null)
                RDI 0000000000000000 RSI 0000000000000000 RDX 00007FFFC4E66248
                RCX 0000000000000001 R8 0000003000000001 R9 0000000000000002
                RAX 0000000000000000 RBX 000526609885AC9E RBP 00007FFFC4E6AB00
                R10 00007FFFC4E62A80 R11 0000000000000000 R12 0000000000000064
                R13 00007FFFC4E6B3C8 R14 0000000000000000 R15 0000000000000001
                RSP 00007FFFC4E6AB00 RIP 0000000005509894
                Dump of memory from 0x7fffc4e6aaf0 to 0x7fffc4e6ab00
                7FFFC4E6AAF0 C4E6AB00 00007FFF 05509899 00000000  [..........P.....]
                
                
                ========== FRAME [2] (ksedst1()+98 -> skdstdst()) ==========
                defined by frame pointers 0x7fffc4e6abb0  and 0x7fffc4e6ab00
                CALL TYPE: call   ERROR SIGNALED: no   COMPONENT: KSE
                RDI 0000000000000000 RSI 0000000000000000 RDX 00007FFFC4E66248
                RCX 0000000000000001 R8 0000000000000000 R9 0000000000000002
                RAX 0000000000000000 RBX 000526609885AC9E RBP 00007FFFC4E6ABB0
                R10 00007FFFC4E62A80 R11 0000000000000000 R12 0000000000000064
                R13 00007FFFC4E6B3C8 R14 0000000000000000 R15 0000000000000001
                RSP 00007FFFC4E6AB10 RIP 00000000036E8302
                Dump of memory from 0x7fffc4e6ab00 to 0x7fffc4e6abb0
                7FFFC4E6AB00 C4E6ABB0 00007FFF 036E8307 00000000  [..........n.....]
                7FFFC4E6AB10 00858176 00000000 00857F3E 00000000  [v.......>.......]
                        Repeat 1 times
                7FFFC4E6AB30 0A305EC0 00000000 0A305EC0 00000000  [.^0......^0.....]
                7FFFC4E6AB40 89AE79B8 00007FB2 00000100 00000000  [.y..............]
                7FFFC4E6AB50 0A32432C 00000000 00000001 00000000  [,C2.............]
                7FFFC4E6AB60 0A30E040 00000000 00000001 00000000  [@.0.............]
                7FFFC4E6AB70 00000000 00000000 00000000 00000000  [................]
                7FFFC4E6AB80 89D5E710 00007FB2 00000000 00000000  [................]
                7FFFC4E6AB90 0082D800 00000000 081C24B2 00000000  [.........$......]
                7FFFC4E6ABA0 00000003 00000000 9EDD98F0 00000000  [................]
                
                
                ========== FRAME [3] (ksedst()+34 -> ksedst1()) ==========
                defined by frame pointers 0x7fffc4e6ac80  and 0x7fffc4e6abb0
                CALL TYPE: call   ERROR SIGNALED: no   COMPONENT: KSE
                RDI 0000000000000000 RSI 0000000000000001 RDX 00007FFFC4E66248
                RCX 0000000000000001 R8 0000000000000000 R9 0000000000000002
                RAX 0000000000000000 RBX 000526609885AC9E RBP 00007FFFC4E6AC80
                R10 00007FFFC4E62A80 R11 0000000000000000 R12 0000000000000064
                R13 00007FFFC4E6B3C8 R14 000000009EDD98F0 R15 0000000000000003
                RSP 00007FFFC4E6ABC0 RIP 00000000036E834E
                Dump of memory from 0x7fffc4e6abb0 to 0x7fffc4e6ad00
                7FFFC4E6ABB0 C4E6AC80 00007FFF 036E8353 00000000  [........S.n.....]
                7FFFC4E6ABC0 00000000 00000000 70CEAFF0 00000030  [...........p0...]
                7FFFC4E6ABD0 C4E6B114 00007FFF 0A30A380 00000000  [..........0.....]
                7FFFC4E6ABE0 9F774728 00000000 00000000 00000000  [(Gw.............]
                7FFFC4E6ABF0 00000000 00000000 0A30A380 00000000  [..........0.....]
                7FFFC4E6AC00 C4E6B114 00007FFF 000F4240 00000000  [........@B......]
                7FFFC4E6AC10 FFFF0022 00000000 FFFFFFFF 00000000  ["...............]
                7FFFC4E6AC20 002E0002 00007FFF 000F4240 00000000  [........@B......]
                7FFFC4E6AC30 00000000 00007FFF C4F758BC 00007FFF  [.........X......]
                7FFFC4E6AC40 C4E6AC80 00007FFF 08084BE6 00000000  [.........K......]
                7FFFC4E6AC50 C4E6AC80 00007FFF 07F39D75 00000000  [........u.......]
                7FFFC4E6AC60 00000064 00000000 00000000 00000000  [d...............]
                7FFFC4E6AC70 00000003 00000000 00028A5E 00000000  [........^.......]
                7FFFC4E6AC80 C4E6B370 00007FFF 07CFA275 00000000  [p.......u.......]
                7FFFC4E6AC90 C4E6B390 00007FFF C4E6B380 00007FFF  [................]
                7FFFC4E6ACA0 00000004 00000000 C4E6B560 00007FFF  [........`.......]
                7FFFC4E6ACB0 08515C0A 00000000 70C44167 00000030  [.\Q.....gA.p0...]
                7FFFC4E6ACC0 08515C0A 00000000 00000001 00000000  [.\Q.............]
                7FFFC4E6ACD0 00000001 00000000 00000003 00000000  [................]
                7FFFC4E6ACE0 00000003 00000000 00000001 00000000  [................]
                7FFFC4E6ACF0 C4E6AD20 00007FFF 07D0F3E5 00000000  [ ...............]
                
                
                ========== FRAME [4] (0000000007CFA270 -> ksedst()) ==========
                defined by frame pointers 0x0  and 0x7fffc4e6ac80
                CALL TYPE: call   ERROR SIGNALED: yes   COMPONENT: (null)
                RDI 0000000000000000 RSI 0000000000000001 RDX 00007FFFC4E66248
                RCX 0000000000000001 R8 0000000000000000 R9 0000000000000002
                RAX 0000000000000000 RBX 000526609885AC9E RBP 00007FFFC4E6B370
                R10 00007FFFC4E62A80 R11 0000000000000000 R12 0000000000000064
                R13 00007FFFC4E6B3C8 R14 000000009EDD98F0 R15 0000000000000003
                RSP 00007FFFC4E6AC90 RIP 0000000007CFA270
                
                
                
                
                ----- Argument/Register Address Dump -----
                
                
                Argument/Register addr=0x7fffc4e66248.
                Dump of memory from 0x7fffc4e66208 to 0x7fffc4e66348
                7FFFC4E66200                   00000000 00000000          [........]
                7FFFC4E66210 00000000 00000000 00000000 00000000  [................]
                        Repeat 2 times
                7FFFC4E66240 C4E62A80 00007FFF 05509894 00000000  [.*........P.....]
                7FFFC4E66250 73646B73 74736474 00002928 00000000  [skdstdst()......]
                7FFFC4E66260 C4E66494 00007FFF 00000000 00007FFF  [.d..............]
                7FFFC4E66270 89B1BAA6 00007FB2 08085064 00000000  [........dP......]
                7FFFC4E66280 C4E66320 00007FFF 08085255 00000000  [ c......UR......]
                7FFFC4E66290 FFFFFFFF 00000001 07FB1705 00000000  [................]
                7FFFC4E662A0 00000008 00000000 C4E67318 00007FFF  [.........s......]
                7FFFC4E662B0 00000000 00000000 00000000 00000000  [................]
                7FFFC4E662C0 60004658 00000000 C4E664F0 00007FFF  [XF.`.....d......]
                7FFFC4E662D0 00000002 00000000 89D5E710 00007FB2  [................]
                7FFFC4E662E0 00000045 00000000 C4E669E8 00007FFF  [E........i......]
                7FFFC4E662F0 00000002 00000000 00000003 00007FFF  [................]
                7FFFC4E66300 C4E66674 00007FFF 00000024 00000000  [tf......$.......]
                7FFFC4E66310 00000001 00000001 00000000 00000000  [................]
                7FFFC4E66320 06C43873 00000000 7364676B 28747364  [s8......kgdsdst(]
                7FFFC4E66330 00000029 00000030 C4E66380 00007FFF  [)...0....c......]
                7FFFC4E66340 C4E66280 00007FFF                    [.b......]      
                Argument/Register addr=0x7fffc4e6ab00.
                Dump of memory from 0x7fffc4e6aac0 to 0x7fffc4e6ac00
                7FFFC4E6AAC0 30322D25 20732A2E 2E382D25 2520732A  [%-20.*s %-8.*s %]
                7FFFC4E6AAD0 2E30322D 0020732A 0369B7B8 00000000  [-20.*s ...i.....]
                7FFFC4E6AAE0 C4E68F98 00007FFF 00000002 00000000  [................]
                7FFFC4E6AAF0 C4E6AB00 00007FFF 05509899 00000000  [..........P.....]
                7FFFC4E6AB00 C4E6ABB0 00007FFF 036E8307 00000000  [..........n.....]
                7FFFC4E6AB10 00858176 00000000 00857F3E 00000000  [v.......>.......]
                        Repeat 1 times
                7FFFC4E6AB30 0A305EC0 00000000 0A305EC0 00000000  [.^0......^0.....]
                7FFFC4E6AB40 89AE79B8 00007FB2 00000100 00000000  [.y..............]
                7FFFC4E6AB50 0A32432C 00000000 00000001 00000000  [,C2.............]
                7FFFC4E6AB60 0A30E040 00000000 00000001 00000000  [@.0.............]
                7FFFC4E6AB70 00000000 00000000 00000000 00000000  [................]
                7FFFC4E6AB80 89D5E710 00007FB2 00000000 00000000  [................]
                7FFFC4E6AB90 0082D800 00000000 081C24B2 00000000  [.........$......]
                7FFFC4E6ABA0 00000003 00000000 9EDD98F0 00000000  [................]
                7FFFC4E6ABB0 C4E6AC80 00007FFF 036E8353 00000000  [........S.n.....]
                7FFFC4E6ABC0 00000000 00000000 70CEAFF0 00000030  [...........p0...]
                7FFFC4E6ABD0 C4E6B114 00007FFF 0A30A380 00000000  [..........0.....]
                7FFFC4E6ABE0 9F774728 00000000 00000000 00000000  [(Gw.............]
                7FFFC4E6ABF0 00000000 00000000 0A30A380 00000000  [..........0.....]
                Argument/Register addr=0x7fffc4e62a80.
                Dump of memory from 0x7fffc4e62a40 to 0x7fffc4e62b80
                7FFFC4E62A40 C4E62A80 00007FFF 07F0522D 00000000  [.*......-R......]
                7FFFC4E62A50 8D1F5490 00000000 89716DB8 00007FB2  [.T.......mq.....]
                7FFFC4E62A60 C4E62A80 00007FFF 07F05609 00000000  [.*.......V......]
                7FFFC4E62A70 00000000 00000000 07F80AA2 00000000  [................]
                7FFFC4E62A80 C4E6B370 00007FFF 00000002 00000000  [p...............]
                7FFFC4E62A90 C4E6AB10 00007FFF 00001000 00000000  [................]
                7FFFC4E62AA0 00000001 00000005 00000000 00000000  [................]
                7FFFC4E62AB0 00000000 00000000 00000000 00000000  [................]
                7FFFC4E62AC0 00400000 00000000 00000119 00000000  [..@.............]
                7FFFC4E62AD0 8B5E4000 00007FB2 09E05000 00000000  [.@^......P......]
                7FFFC4E62AE0 09E06FFF 00000000 89046000 00007FB2  [.o.......`......]
                7FFFC4E62AF0 0007D000 00000000 002ADFFF 00000000  [..........*.....]
                7FFFC4E62B00 00000000 00000000 00000000 00000000  [................]
                  Repeat 7 times
                Argument/Register addr=0x7fffc4e6b3c8.
                Dump of memory from 0x7fffc4e6b388 to 0x7fffc4e6b4c8
                7FFFC4E6B380                   00000003 00000000          [........]
                7FFFC4E6B390 9798C798 00000000 9798C798 00000000  [................]
                7FFFC4E6B3A0 00000000 00000000 9FAA68F8 00000000  [.........h......]
                7FFFC4E6B3B0 C4E6B580 00007FFF 0094F4B4 00000000  [................]
                7FFFC4E6B3C0 00000001 00000000 00009BA2 0000A0DC  [................]
                7FFFC4E6B3D0 9885AC9D 00052660 9885AC9D 00052660  [....`&......`&..]
                        Repeat 1 times
                7FFFC4E6B3F0 00000000 00000000 9FAA0000 00000000  [................]
                7FFFC4E6B400 60010B10 00000000 C4E6B540 00007FFF  [...`....@.......]
                7FFFC4E6B410 C4E6B490 00007FFF 07F4F132 000005A0  [........2.......]
                7FFFC4E6B420 00000001 00000000 083EA804 00000000  [..........>.....]
                7FFFC4E6B430 00000046 00000000 00002EE0 00000166  [F...........f...]
                7FFFC4E6B440 00000000 00000000 00000000 00000000  [................]
                        Repeat 1 times
                7FFFC4E6B460 9EB37168 00000000 60010B30 00000000  [hq......0..`....]
                7FFFC4E6B470 9EB37168 00000000 0A306070 00000000  [hq......p`0.....]
                7FFFC4E6B480 00000001 00000000 9EB37168 00000000  [........hq......]
                7FFFC4E6B490 C4E6B580 00007FFF 0094DE22 00000000  [........".......]
                7FFFC4E6B4A0 9F774268 00000000 9FAA68F8 00000000  [hBw......h......]
                7FFFC4E6B4B0 9797F788 00000000 C4E6C288 00007FFF  [................]
                7FFFC4E6B4C0 964FE5D8 00000000                    [..O.....]      
                Argument/Register addr=0x5509894.
                Dump of memory from 0x5509854 to 0x5509994
                005509850          EE7AE8C0 8948FB34 90C35DEC      [..z.4.H..]..]
                005509860 E5894855 000001B8 EC894800 9090C35D  [UH.......H..]...]
                005509870 E5894855 0001B841 C9330000 4400FE83  [UH..A.....3....D]
                005509880 B8C1440F 00000002 0F00FA83 0B44C845  [.D..........E.D.]
                005509890 C68944C1 7399E5E8 EC894801 9090C35D  [.D.....s.H..]...]
                0055098A0 E5894855 B0EC8148 4C000000 4CE07D89  [UH..H......L.}.L]
                0055098B0 4CE87589 4CF06D89 49F86589 8949CF89  [.u.L.m.L.e.I..I.]
                0055098C0 F58949D6 66FC8949 49C0EF0F 000007C7  [.I..I..f...I....]
                0055098D0 41660000 0045D60F D60F4166 41660845  [..fA..E.fA..E.fA]
                0055098E0 1045D60F D60F4166 41661845 2045D60F  [..E.fA..E.fA..E ]
                0055098F0 D60F4166 8D482845 FFFF50B5 E8FF33FF  [fA..E(H..P...3..]
                005509900 FB321264 8C0FC085 000000DB 01C6F749  [d.2.........I...]
                005509910 74000000 8569481A FFFFFF50 000F4240  [...t.Hi.P...@B..]
                005509920 58850348 49FFFFFF 49004589 49010F83  [H..X...I.E.I...I]
                005509930 0002C6F7 1A740000 60856948 40FFFFFF  [......t.Hi.`...@]
                005509940 48000F42 FF688503 8949FFFF 83490845  [B..H..h...I.E.I.]
                005509950 F749020F 000004C6 482F7400 FF508569  [..I......t/Hi.P.]
                005509960 4240FFFF 6948000F FFFF6095 0F4240FF  [..@B..Hi.`...@B.]
                005509970 85034800 FFFFFF58 68950348 48FFFFFF  [.H..X...H..h...H]
                005509980 8949D003 83491055 F749040F 000008C6  [..I.U.I...I.....]
                005509990 480C7400                             [.t.H]          
                Argument/Register addr=0x7fffc4e6abb0.
                Dump of memory from 0x7fffc4e6ab70 to 0x7fffc4e6acb0
                7FFFC4E6AB70 00000000 00000000 00000000 00000000  [................]
                7FFFC4E6AB80 89D5E710 00007FB2 00000000 00000000  [................]
                7FFFC4E6AB90 0082D800 00000000 081C24B2 00000000  [.........$......]
                7FFFC4E6ABA0 00000003 00000000 9EDD98F0 00000000  [................]
                7FFFC4E6ABB0 C4E6AC80 00007FFF 036E8353 00000000  [........S.n.....]
                7FFFC4E6ABC0 00000000 00000000 70CEAFF0 00000030  [...........p0...]
                7FFFC4E6ABD0 C4E6B114 00007FFF 0A30A380 00000000  [..........0.....]
                7FFFC4E6ABE0 9F774728 00000000 00000000 00000000  [(Gw.............]
                7FFFC4E6ABF0 00000000 00000000 0A30A380 00000000  [..........0.....]
                7FFFC4E6AC00 C4E6B114 00007FFF 000F4240 00000000  [........@B......]
                7FFFC4E6AC10 FFFF0022 00000000 FFFFFFFF 00000000  ["...............]
                7FFFC4E6AC20 002E0002 00007FFF 000F4240 00000000  [........@B......]
                7FFFC4E6AC30 00000000 00007FFF C4F758BC 00007FFF  [.........X......]
                7FFFC4E6AC40 C4E6AC80 00007FFF 08084BE6 00000000  [.........K......]
                7FFFC4E6AC50 C4E6AC80 00007FFF 07F39D75 00000000  [........u.......]
                7FFFC4E6AC60 00000064 00000000 00000000 00000000  [d...............]
                7FFFC4E6AC70 00000003 00000000 00028A5E 00000000  [........^.......]
                7FFFC4E6AC80 C4E6B370 00007FFF 07CFA275 00000000  [p.......u.......]
                7FFFC4E6AC90 C4E6B390 00007FFF C4E6B380 00007FFF  [................]
                7FFFC4E6ACA0 00000004 00000000 C4E6B560 00007FFF  [........`.......]
                Argument/Register addr=0x36e8302.
                Dump of memory from 0x36e82c2 to 0x36e8402
                0036E82C0 C3A4133D BF28E806 8D48FF22 FFFF60BD  [=.....(.".H..`..]
                0036E82D0 F68944FF 171D1FE8 35058BFD 8506C3C0  [.D.........5....]
                0036E82E0 480874C0 00D045C7 C7000000 C3C01F05  [.t.H.E..........]
                0036E82F0 00000106 BD8D4800 FFFFFF60 44F68944  [.....H..`...D..D]
                0036E8300 69E8FA89 4801E215 A3CA3D8B 05C706C3  [...i...H.=......]
                0036E8310 06C3BFFC 00000000 D3E8F631 4CFF22BE  [........1....".L]
                0036E8320 4CF8758B 48F07D8B C35DEC89 E5894855  [.u.L.}.H..].UH..]
                0036E8330 C0EC8148 4C000000 8BF07D89 C3BFDF05  [H......L.}......]
                0036E8340 BAF63106 00000001 0F00F883 4DE8F244  [.1..........D..M]
                0036E8350 48FFFFFF BACE3D8B 85C706C3 FFFFFF60  [...H.=......`...]
                0036E8360 00000000 0FFF8548 0000F484 778B4800  [....H........H.w]
                0036E8370 F6854808 B8485474 00000000 00400000  [.H..tTH.......@.]
                0036E8380 74068548 46F74845 00000108 BA3B7400  [H..tEH.F.....t;.]
                0036E8390 01160001 050036B9 458D4C02 A77EE8E8  [.....6...L.E..~.]
                0036E83A0 C08504A0 8B482474 C3BA7B3D 458B4C06  [....t$H.={...L.E]
                0036E83B0 0036BEE8 FFBA0205 B9000000 00002004  [..6.......... ..]
                0036E83C0 89C7E1E8 C7894903 BF4106EB 00002004  [.....I....A.. ..]
                0036E83D0 06C7F749 0F000000 00008484 00B84800  [I............H..]
                0036E83E0 00000000 49400000 3B74C785 353D8B48  [......@I..t;H.=5]
                0036E83F0 BE06C3BA 02050036 2404C748 08247670  [....6...H..$pv$.]
                0036E8400 2444C748                             [H.D$]          
                Argument/Register addr=0x7fffc4e6ac80.
                Dump of memory from 0x7fffc4e6ac40 to 0x7fffc4e6ad80
                7FFFC4E6AC40 C4E6AC80 00007FFF 08084BE6 00000000  [.........K......]
                7FFFC4E6AC50 C4E6AC80 00007FFF 07F39D75 00000000  [........u.......]
                7FFFC4E6AC60 00000064 00000000 00000000 00000000  [d...............]
                7FFFC4E6AC70 00000003 00000000 00028A5E 00000000  [........^.......]
                7FFFC4E6AC80 C4E6B370 00007FFF 07CFA275 00000000  [p.......u.......]
                7FFFC4E6AC90 C4E6B390 00007FFF C4E6B380 00007FFF  [................]
                7FFFC4E6ACA0 00000004 00000000 C4E6B560 00007FFF  [........`.......]
                7FFFC4E6ACB0 08515C0A 00000000 70C44167 00000030  [.\Q.....gA.p0...]
                7FFFC4E6ACC0 08515C0A 00000000 00000001 00000000  [.\Q.............]
                7FFFC4E6ACD0 00000001 00000000 00000003 00000000  [................]
                7FFFC4E6ACE0 00000003 00000000 00000001 00000000  [................]
                7FFFC4E6ACF0 C4E6AD20 00007FFF 07D0F3E5 00000000  [ ...............]
                7FFFC4E6AD00 C4E6B270 00007FFF 9EDD7B40 00000000  [p.......@{......]
                7FFFC4E6AD10 08515C08 00000000 00000000 00000000  [.\Q.............]
                7FFFC4E6AD20 C4E6B0E0 00007FFF 00000000 00000000  [................]
                7FFFC4E6AD30 C4E6B2DC 00007FFF C4E6B2F8 00007FFF  [................]
                7FFFC4E6AD40 000030FC 00000000 C4E6B318 00007FFF  [.0..............]
                7FFFC4E6AD50 00000000 00000000 00000001 00000001  [................]
                7FFFC4E6AD60 C4E6AFF0 00007FFF 07D6D3C5 00000000  [................]
                7FFFC4E6AD70 00000000 00000000 00000000 00000000  [................]
                Argument/Register addr=0x9edd98f0.
                Dump of memory from 0x9edd98b0 to 0x9edd99f0
                09EDD98B0 965DB010 00000000 965DB240 00000000  [..].....@.].....]
                09EDD98C0 00000000 FFFFFFFF 0000FFFF 00000000  [................]
                09EDD98D0 00000000 00000000 00000000 00000000  [................]
                        Repeat 1 times
                09EDD98F0 00009BA2 0000A0DC 9885AC9D 00052660  [............`&..]
                09EDD9900 9885AC9E 00052660 9885AC9D 00052660  [....`&......`&..]
                09EDD9910 9885AC9E 00052660 000F4240 00000000  [....`&..@B......]
                09EDD9920 00000001 00000000 9885AC9E 00052660  [............`&..]
                09EDD9930 9885AC9E 00052660 000F4240 00000000  [....`&..@B......]
                09EDD9940 00000064 000005A0 00000001 00000000  [d...............]
                09EDD9950 083EA804 00000000 00000046 00000000  [..>.....F.......]
                09EDD9960 00002EE0 00000166 00000000 00000000  [....f...........]
                09EDD9970 00000000 00000000 00000000 00000000  [................]
                  Repeat 7 times
                Argument/Register addr=0x36e834e.
                Dump of memory from 0x36e830e to 0x36e844e
                0036E8300                            05C706C3              [....]
                0036E8310 06C3BFFC 00000000 D3E8F631 4CFF22BE  [........1....".L]
                0036E8320 4CF8758B 48F07D8B C35DEC89 E5894855  [.u.L.}.H..].UH..]
                0036E8330 C0EC8148 4C000000 8BF07D89 C3BFDF05  [H......L.}......]
                0036E8340 BAF63106 00000001 0F00F883 4DE8F244  [.1..........D..M]
                0036E8350 48FFFFFF BACE3D8B 85C706C3 FFFFFF60  [...H.=......`...]
                0036E8360 00000000 0FFF8548 0000F484 778B4800  [....H........H.w]
                0036E8370 F6854808 B8485474 00000000 00400000  [.H..tTH.......@.]
                0036E8380 74068548 46F74845 00000108 BA3B7400  [H..tEH.F.....t;.]
                0036E8390 01160001 050036B9 458D4C02 A77EE8E8  [.....6...L.E..~.]
                0036E83A0 C08504A0 8B482474 C3BA7B3D 458B4C06  [....t$H.={...L.E]
                0036E83B0 0036BEE8 FFBA0205 B9000000 00002004  [..6.......... ..]
                0036E83C0 89C7E1E8 C7894903 BF4106EB 00002004  [.....I....A.. ..]
                0036E83D0 06C7F749 0F000000 00008484 00B84800  [I............H..]
                0036E83E0 00000000 49400000 3B74C785 353D8B48  [......@I..t;H.=5]
                0036E83F0 BE06C3BA 02050036 2404C748 08247670  [....6...H..$pv$.]
                0036E8400 2444C748 24785808 B9D23108 000000FF  [H.D$.Xx$.1......]
                0036E8410 C7F8894D 2A102444 4500000D E5E8C931  [M...D$.*...E1...]
                0036E8420 850389C5 B93A74C0 02050036 F5158B48  [.....t:.6...H...]
                0036E8430 4806C3B9 FF60BD8D 3145FFFF 685241D2  [...H..`...E1.ARh]
                0036E8440 08248E54 BEA703BE 68006ABE 08247670  [T.$......j.hpv$.]
                Argument/Register addr=0x7fffc4e6b370.
                Dump of memory from 0x7fffc4e6b330 to 0x7fffc4e6b470
                7FFFC4E6B330 00000000 00000064 00000064 00000001  [....d...d.......]
                7FFFC4E6B340 9E6FDC18 00000000 000003E8 00000064  [..o.........d...]
                7FFFC4E6B350 00000000 00000000 C4F70000 00000003  [................]
                7FFFC4E6B360 00000000 00000000 00000040 00000000  [........@.......]
                7FFFC4E6B370 C4E6B3B0 00007FFF 07CF7331 00000000  [........1s......]
                7FFFC4E6B380 80BC3919 00000000 00000003 00000000  [.9..............]
                7FFFC4E6B390 9798C798 00000000 9798C798 00000000  [................]
                7FFFC4E6B3A0 00000000 00000000 9FAA68F8 00000000  [.........h......]
                7FFFC4E6B3B0 C4E6B580 00007FFF 0094F4B4 00000000  [................]
                7FFFC4E6B3C0 00000001 00000000 00009BA2 0000A0DC  [................]
                7FFFC4E6B3D0 9885AC9D 00052660 9885AC9D 00052660  [....`&......`&..]
                        Repeat 1 times
                7FFFC4E6B3F0 00000000 00000000 9FAA0000 00000000  [................]
                7FFFC4E6B400 60010B10 00000000 C4E6B540 00007FFF  [...`....@.......]
                7FFFC4E6B410 C4E6B490 00007FFF 07F4F132 000005A0  [........2.......]
                7FFFC4E6B420 00000001 00000000 083EA804 00000000  [..........>.....]
                7FFFC4E6B430 00000046 00000000 00002EE0 00000166  [F...........f...]
                7FFFC4E6B440 00000000 00000000 00000000 00000000  [................]
                        Repeat 1 times
                7FFFC4E6B460 9EB37168 00000000 60010B30 00000000  [hq......0..`....]
                Argument/Register addr=0x7cfa270.
                Dump of memory from 0x7cfa230 to 0x7cfa370
                007CFA230 F883FFFF 8B840F2D 83FFFFDC 840F2CF8  [....-........,..]
                007CFA240 FFFFDC82 8D3D8B48 48026284 881E358B  [....H.=..b.H.5..]
                007CFA250 24BA0262 4C08256B 01B9C863 45000000  [b..$k%.Lc......E]
                007CFA260 C031C031 F05415E8 DC58E9FE FF31FFFF  [1.1...T...X...1.]
                007CFA270 9EE0B7E8 3D8B48FB 0262845C 8D1D8B48  [.....H.=\.b.H...]
                007CFA280 48005438 FDA4958D 8B48FFFF 01E81F34  [8T.H......H.4...]
                007CFA290 48FEF08C FF68858B 8548FFFF 8B6574C0  [...H..h...H..te.]
                007CFA2A0 C085CC45 8B481174 FFFF2885 0080C7FF  [E...t.H..(......]
                007CFA2B0 00000003 48000000 FF60958B C031FFFF  [.......H..`...1.]
                007CFA2C0 8B028966 C985A84D FF310774 000ED1E8  [f...M...t.1.....]
                007CFA2D0 858B4800 FFFFFF28 8948C931 00015888  [.H..(...1.H..X..]
                007CFA2E0 958B4800 FFFFFF28 608A8948 48000001  [.H..(...H..`...H]
                007CFA2F0 FF289D8B 8948FFFF 0001688B 1D8B4800  [..(...H..h...H..]
                007CFA300 0054380C CD3D8B48 44026283 FDA4858B  [.8T.H.=..b.D....]
                007CFA310 A8BAFFFF B908254F 08256B14 1F348B48  [....O%...k%.H.4.]
                007CFA320 19E8C031 E9FAC1B2 FFFFDB60 A578C5E8  [1.......`.....x.]
                007CFA330 DB48E9FB 058BFFFF 5831089C 9C56053B  [..H.......1X;.V.]
                007CFA340 05760262 CF8267E8 19058BF8 A8583108  [b.v..g.......1X.]
                007CFA350 77850F01 48000002 847A0D8B 918B0262  [...w...H..z.b...]
                007CFA360 00000130 1000C2F7 850F0000 000001D5  [0...............]
                call stack performance statistics:
                total                  : 0.300000 sec
                setup                  : 0.110000 sec
                stack unwind           : 0.110000 sec
                symbol translation     : 0.000000 sec
                printing the call stack: 0.000000 sec
                printing frame data    : 0.080000 sec
                printing argument data : 0.000000 sec
                ----- End of Call Stack Trace -----
                ----- Process Map Dump -----
                ******************* Dumping process map ****************
                00400000-0a0c3000 r-xp 00000000 08:02 524596                             /u01/app/oracle/product/11.2.0/xe/bin/oracle
                0a1c2000-0a306000 rwxp 09cc2000 08:02 524596                             /u01/app/oracle/product/11.2.0/xe/bin/oracle
                0a306000-0a344000 rwxp 00000000 00:00 0
                0aa78000-0aabc000 rwxp 00000000 00:00 0                                  [heap]
                60000000-60001000 r-xs 00000000 00:10 1848691                            /dev/shm/ora_XE_753665_0
                60001000-60400000 rwxs 00001000 00:10 1848691                            /dev/shm/ora_XE_753665_0
                3070400000-3070420000 r-xp 00000000 08:02 531431                         /lib64/ld-2.12.so
                307061f000-3070620000 r-xp 0001f000 08:02 531431                         /lib64/ld-2.12.so
                3070620000-3070621000 rwxp 00020000 08:02 531431                         /lib64/ld-2.12.so
                3070621000-3070622000 rwxp 00000000 00:00 0
                3070800000-3070801000 r-xp 00000000 08:02 525354                         /lib64/libaio.so.1.0.1
                3070801000-3070a00000 ---p 00001000 08:02 525354                         /lib64/libaio.so.1.0.1
                3070a00000-3070a01000 rwxp 00000000 08:02 525354                         /lib64/libaio.so.1.0.1
                3070c00000-3070d8a000 r-xp 00000000 08:02 531432                         /lib64/libc-2.12.so
                3070d8a000-3070f8a000 ---p 0018a000 08:02 531432                         /lib64/libc-2.12.so
                3070f8a000-3070f8e000 r-xp 0018a000 08:02 531432                         /lib64/libc-2.12.so
                3070f8e000-3070f8f000 rwxp 0018e000 08:02 531432                         /lib64/libc-2.12.so
                3070f8f000-3070f94000 rwxp 00000000 00:00 0
                3071000000-3071017000 r-xp 00000000 08:02 542981                         /lib64/libpthread-2.12.so
                3071017000-3071217000 ---p 00017000 08:02 542981                         /lib64/libpthread-2.12.so
                3071217000-3071218000 r-xp 00017000 08:02 542981                         /lib64/libpthread-2.12.so
                3071218000-3071219000 rwxp 00018000 08:02 542981                         /lib64/libpthread-2.12.so
                3071219000-307121d000 rwxp 00000000 00:00 0
                3071800000-3071883000 r-xp 00000000 08:02 545769                         /lib64/libm-2.12.so
                3071883000-3071a82000 ---p 00083000 08:02 545769                         /lib64/libm-2.12.so
                3071a82000-3071a83000 r-xp 00082000 08:02 545769                         /lib64/libm-2.12.so
                3071a83000-3071a84000 rwxp 00083000 08:02 545769                         /lib64/libm-2.12.so
                3071c00000-3071c07000 r-xp 00000000 08:02 543148                         /lib64/librt-2.12.so
                3071c07000-3071e06000 ---p 00007000 08:02 543148                         /lib64/librt-2.12.so
                3071e06000-3071e07000 r-xp 00006000 08:02 543148                         /lib64/librt-2.12.so
                3071e07000-3071e08000 rwxp 00007000 08:02 543148                         /lib64/librt-2.12.so
                3073000000-3073016000 r-xp 00000000 08:02 524363                         /lib64/libnsl-2.12.so
                3073016000-3073215000 ---p 00016000 08:02 524363                         /lib64/libnsl-2.12.so
                3073215000-3073216000 r-xp 00015000 08:02 524363                         /lib64/libnsl-2.12.so
                3073216000-3073217000 rwxp 00016000 08:02 524363                         /lib64/libnsl-2.12.so
                3073217000-3073219000 rwxp 00000000 00:00 0
                7fb289277000-7fb289297000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289297000-7fb2892b7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2892b7000-7fb2892d7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2892d7000-7fb2892e7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2892e7000-7fb289307000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289307000-7fb289327000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289327000-7fb289347000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289347000-7fb289367000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289367000-7fb289387000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289387000-7fb2893a7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2893a7000-7fb289477000 rwxp 00627000 00:05 3883                       /dev/zero
                7fb289477000-7fb289487000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289487000-7fb289497000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289497000-7fb2894a7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2894a7000-7fb2894b7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2894b7000-7fb2894c7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2894c7000-7fb2894d7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2894d7000-7fb2894e7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2894e7000-7fb2894f7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2894f7000-7fb289507000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289507000-7fb289517000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289517000-7fb289527000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289527000-7fb289537000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289537000-7fb289547000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289547000-7fb289557000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289557000-7fb289567000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289567000-7fb289577000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289577000-7fb289587000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289587000-7fb2895a7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2895a7000-7fb2895b7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2895b7000-7fb2895d7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2895d7000-7fb2895f7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2895f7000-7fb289617000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289617000-7fb289637000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289637000-7fb289657000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289657000-7fb289677000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289677000-7fb289687000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289687000-7fb289697000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289697000-7fb2896a7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2896a7000-7fb2896b7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2896b7000-7fb2896c7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2896c7000-7fb2896d7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2896d7000-7fb2896e7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2896e7000-7fb2896f7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2896f7000-7fb289707000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289707000-7fb289717000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289717000-7fb289727000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289727000-7fb289737000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289737000-7fb289747000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289747000-7fb289757000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289757000-7fb289767000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289767000-7fb289777000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289777000-7fb289787000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289787000-7fb289797000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289797000-7fb2897a7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2897a7000-7fb2897b7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2897b7000-7fb2897c7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2897c7000-7fb2897d7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2897d7000-7fb2897e7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2897e7000-7fb2897f7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2897f7000-7fb289807000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289807000-7fb289817000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289817000-7fb289827000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289827000-7fb289837000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289837000-7fb289847000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289847000-7fb289857000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289857000-7fb289867000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289867000-7fb289877000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289877000-7fb289887000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289887000-7fb289897000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289897000-7fb2898a7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2898a7000-7fb2898b7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2898b7000-7fb2898c7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2898c7000-7fb2898d7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2898d7000-7fb2898e7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2898e7000-7fb2898f7000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb2898f7000-7fb289900000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289900000-7fb289910000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289910000-7fb289920000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289920000-7fb289930000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289930000-7fb289940000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289940000-7fb289950000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289950000-7fb289960000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289960000-7fb289970000 rwxp 00000000 00:05 3883                       /dev/zero
                7fb289970000-7fb289977000 rwxp 00079000 00:05 3883                       /dev/zero
                7fb289977000-7fb289b20000 rwxp 00000000 00:00 0
                7fb289b20000-7fb289b2c000 r-xp 00000000 08:02 524339                     /lib64/libnss_files-2.12.so
                7fb289b2c000-7fb289d2c000 ---p 0000c000 08:02 524339                     /lib64/libnss_files-2.12.so
                7fb289d2c000-7fb289d2d000 r-xp 0000c000 08:02 524339                     /lib64/libnss_files-2.12.so
                7fb289d2d000-7fb289d2e000 rwxp 0000d000 08:02 524339                     /lib64/libnss_files-2.12.so
                7fb289d3a000-7fb289e9e000 rwxp 00000000 00:00 0
                7fb289e9e000-7fb289ea8000 r-xp 00000000 08:02 139444                     /usr/lib64/libnuma.so.1
                7fb289ea8000-7fb28a0a8000 ---p 0000a000 08:02 139444                     /usr/lib64/libnuma.so.1
                7fb28a0a8000-7fb28a0a9000 rwxp 0000a000 08:02 139444                     /usr/lib64/libnuma.so.1
                7fb28a0a9000-7fb28a0ad000 rwxp 00000000 00:00 0
                7fb28a0ad000-7fb28a0af000 r-xp 00000000 08:02 531435                     /lib64/libdl-2.12.so
                7fb28a0af000-7fb28a2af000 ---p 00002000 08:02 531435                     /lib64/libdl-2.12.so
                7fb28a2af000-7fb28a2b0000 r-xp 00002000 08:02 531435                     /lib64/libdl-2.12.so
                7fb28a2b0000-7fb28a2b1000 rwxp 00003000 08:02 531435                     /lib64/libdl-2.12.so
                7fb28a2b1000-7fb28a2b2000 rwxp 00000000 00:00 0
                7fb28a2b2000-7fb28a2bd000 r-xp 00000000 08:02 548590                     /u01/app/oracle/product/11.2.0/xe/lib/libocrutl11.so
                7fb28a2bd000-7fb28a3bc000 ---p 0000b000 08:02 548590                     /u01/app/oracle/product/11.2.0/xe/lib/libocrutl11.so
                7fb28a3bc000-7fb28a3bd000 rwxp 0000a000 08:02 548590                     /u01/app/oracle/product/11.2.0/xe/lib/libocrutl11.so
                7fb28a3bd000-7fb28a45a000 r-xp 00000000 08:02 548589                     /u01/app/oracle/product/11.2.0/xe/lib/libocrb11.so
                7fb28a45a000-7fb28a55a000 ---p 0009d000 08:02 548589                     /u01/app/oracle/product/11.2.0/xe/lib/libocrb11.so
                7fb28a55a000-7fb28a55c000 rwxp 0009d000 08:02 548589                     /u01/app/oracle/product/11.2.0/xe/lib/libocrb11.so
                7fb28a55c000-7fb28a55d000 rwxp 00000000 00:00 0
                7fb28a55d000-7fb28a601000 r-xp 00000000 08:02 548588                     /u01/app/oracle/product/11.2.0/xe/lib/libocr11.so
                7fb28a601000-7fb28a700000 ---p 000a4000 08:02 548588                     /u01/app/oracle/product/11.2.0/xe/lib/libocr11.so
                7fb28a700000-7fb28a703000 rwxp 000a3000 08:02 548588                     /u01/app/oracle/product/11.2.0/xe/lib/libocr11.so
                7fb28a703000-7fb28a705000 r-xp 00000000 08:02 548595                     /u01/app/oracle/product/11.2.0/xe/lib/libskgxn2.so
                7fb28a705000-7fb28a804000 ---p 00002000 08:02 548595                     /u01/app/oracle/product/11.2.0/xe/lib/libskgxn2.so
                7fb28a804000-7fb28a805000 rwxp 00001000 08:02 548595                     /u01/app/oracle/product/11.2.0/xe/lib/libskgxn2.so
                7fb28a805000-7fb28aeb1000 r-xp 00000000 08:02 548577                     /u01/app/oracle/product/11.2.0/xe/lib/libhasgen11.so
                7fb28aeb1000-7fb28afb0000 ---p 006ac000 08:02 548577                     /u01/app/oracle/product/11.2.0/xe/lib/libhasgen11.so
                7fb28afb0000-7fb28afd2000 rwxp 006ab000 08:02 548577                     /u01/app/oracle/product/11.2.0/xe/lib/libhasgen11.so
                7fb28afd2000-7fb28afd9000 rwxp 00000000 00:00 0
                7fb28afd9000-7fb28affb000 r-xp 00000000 08:02 548575                     /u01/app/oracle/product/11.2.0/xe/lib/libdbcfg11.so
                7fb28affb000-7fb28b0fa000 ---p 00022000 08:02 548575                     /u01/app/oracle/product/11.2.0/xe/lib/libdbcfg11.so
                7fb28b0fa000-7fb28b0fc000 rwxp 00021000 08:02 548575                     /u01/app/oracle/product/11.2.0/xe/lib/libdbcfg11.so
                7fb28b0fc000-7fb28b114000 r-xp 00000000 08:02 548573                     /u01/app/oracle/product/11.2.0/xe/lib/libclsra11.so
                7fb28b114000-7fb28b213000 ---p 00018000 08:02 548573                     /u01/app/oracle/product/11.2.0/xe/lib/libclsra11.so
                7fb28b213000-7fb28b214000 rwxp 00017000 08:02 548573                     /u01/app/oracle/product/11.2.0/xe/lib/libclsra11.so
                7fb28b214000-7fb28b499000 r-xp 00000000 08:02 548583                     /u01/app/oracle/product/11.2.0/xe/lib/libnnz11.so
                7fb28b499000-7fb28b598000 ---p 00285000 08:02 548583                     /u01/app/oracle/product/11.2.0/xe/lib/libnnz11.so
                7fb28b598000-7fb28b5da000 rwxp 00284000 08:02 548583                     /u01/app/oracle/product/11.2.0/xe/lib/libnnz11.so
                7fb28b5da000-7fb28b5dd000 rwxp 00000000 00:00 0
                7fb28b5e6000-7fb28b5e7000 rwxs 00000000 08:02 551317                     /u01/app/oracle/product/11.2.0/xe/dbs/hc_XE.dat
                7fb28b5e7000-7fb28b5e9000 rwxp 00000000 00:00 0
                7fb28b5e9000-7fb28b6bd000 r-xp 00000000 08:02 548597                     /u01/app/oracle/product/11.2.0/xe/lib/libskgxp11.so
                7fb28b6bd000-7fb28b7bd000 ---p 000d4000 08:02 548597                     /u01/app/oracle/product/11.2.0/xe/lib/libskgxp11.so
                7fb28b7bd000-7fb28b7bf000 rwxp 000d4000 08:02 548597                     /u01/app/oracle/product/11.2.0/xe/lib/libskgxp11.so
                7fb28b7bf000-7fb28b819000 r-xp 00000000 08:02 548571                     /u01/app/oracle/product/11.2.0/xe/lib/libcell11.so
                7fb28b819000-7fb28b918000 ---p 0005a000 08:02 548571                     /u01/app/oracle/product/11.2.0/xe/lib/libcell11.so
                7fb28b918000-7fb28b921000 rwxp 00059000 08:02 548571                     /u01/app/oracle/product/11.2.0/xe/lib/libcell11.so
                7fb28b921000-7fb28b923000 rwxp 00000000 00:00 0
                7fb28b923000-7fb28b924000 r-xp 00000000 08:02 548591                     /u01/app/oracle/product/11.2.0/xe/lib/libodm11.so
                7fb28b924000-7fb28ba24000 ---p 00001000 08:02 548591                     /u01/app/oracle/product/11.2.0/xe/lib/libodm11.so
                7fb28ba24000-7fb28ba25000 rwxp 00001000 08:02 548591                     /u01/app/oracle/product/11.2.0/xe/lib/libodm11.so
                7fb28ba25000-7fb28ba26000 rwxp 00000000 00:00 0
                7fffc4e3d000-7fffc4e70000 rwxp 00000000 00:00 0                          [stack]
                7fffc4f75000-7fffc4f76000 r-xp 00000000 00:00 0                          [vdso]
                ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
                ******************* End of process map dump ************
                -------------------------------------------------------------------------------
                Trace Bucket Dump Begin: default bucket for process 30 (osid: 13770, CJQ0)
                TIME(*=approx):SEQ:COMPONENT:FILE@LINE:FUNCTION:SECT/DUMP: [EVENT#:PID:SID] DATA
                -------------------------------------------------------------------------------
                2015-12-08 04:39:40.142433 :80BC3090:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:40.142498 :80BC3099:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:40.142498 :80BC309A:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:41.143456 :80BC3109:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:41.143469 :80BC3111:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:41.143470 :80BC3112:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:42.144433 :80BC315B:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:42.144437 :80BC315D:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:42.144511 :80BC315E:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[2] comment=[KSB action for X-instance calls]
                2015-12-08 04:39:42.144511 :80BC315F:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[18] comment=[KSB action for ksbxic() calls]
                2015-12-08 04:39:42.144511 :80BC3160:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[104] comment=[Scumnt mount lock]
                2015-12-08 04:39:42.144511 :80BC3161:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[105] comment=[Poll system events broadcast channel]
                2015-12-08 04:39:42.144512 :80BC3162:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[332] comment=[Check for async messages from other instances]
                2015-12-08 04:39:43.145335 :80BC31B2:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[2] comment=[KSB action for X-instance calls]
                2015-12-08 04:39:43.145336 :80BC31B3:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[18] comment=[KSB action for ksbxic() calls]
                2015-12-08 04:39:43.145336 :80BC31B4:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[104] comment=[Scumnt mount lock]
                2015-12-08 04:39:43.145337 :80BC31B5:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[105] comment=[Poll system events broadcast channel]
                2015-12-08 04:39:43.145337 :80BC31B6:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[332] comment=[Check for async messages from other instances]
                2015-12-08 04:39:43.145339 :80BC31B7:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[0] comment=[Monitor Cleanup]
                2015-12-08 04:39:43.145339 :80BC31B8:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[3] comment=[KSB action for bast checking]
                2015-12-08 04:39:43.145339 :80BC31B9:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[205] comment=[Job Queue Timout]
                2015-12-08 04:39:43.145463 :80BC31BA:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:43.145463 :80BC31BB:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:43.145464 :80BC31BC:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:43.145475 :80BC31BF:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:43.145475 :80BC31C0:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:44.147460 :80BC3233:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:44.147469 :80BC3236:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:44.147550 :80BC323F:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:44.147551 :80BC3240:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:45.148459 :80BC3288:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:45.148473 :80BC328F:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:45.148473 :80BC3290:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:46.149427 :80BC32F5:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:46.149430 :80BC32F7:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:46.149495 :80BC32F8:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:46.149495 :80BC32F9:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:46.149497 :80BC32FA:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:46.149506 :80BC32FD:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:46.149506 :80BC32FE:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:47.150447 :80BC3368:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:47.150452 :80BC336A:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:47.150519 :80BC336B:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:47.150520 :80BC336C:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:47.150522 :80BC336D:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:47.150534 :80BC3370:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:47.150534 :80BC3371:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:48.151435 :80BC33BD:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:48.151446 :80BC33C0:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:48.151526 :80BC33C9:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[2] comment=[KSB action for X-instance calls]
                2015-12-08 04:39:48.151526 :80BC33CA:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[18] comment=[KSB action for ksbxic() calls]
                2015-12-08 04:39:48.151527 :80BC33CB:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[104] comment=[Scumnt mount lock]
                2015-12-08 04:39:48.151527 :80BC33CC:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[105] comment=[Poll system events broadcast channel]
                2015-12-08 04:39:48.151527 :80BC33CD:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[332] comment=[Check for async messages from other instances]
                2015-12-08 04:39:49.152336 :80BC3424:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[2] comment=[KSB action for X-instance calls]
                2015-12-08 04:39:49.152337 :80BC3425:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[18] comment=[KSB action for ksbxic() calls]
                2015-12-08 04:39:49.152337 :80BC3426:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[104] comment=[Scumnt mount lock]
                2015-12-08 04:39:49.152338 :80BC3427:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[105] comment=[Poll system events broadcast channel]
                2015-12-08 04:39:49.152338 :80BC3428:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[332] comment=[Check for async messages from other instances]
                2015-12-08 04:39:49.152340 :80BC3429:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[0] comment=[Monitor Cleanup]
                2015-12-08 04:39:49.152340 :80BC342A:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[3] comment=[KSB action for bast checking]
                2015-12-08 04:39:49.152340 :80BC342B:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[205] comment=[Job Queue Timout]
                2015-12-08 04:39:49.152476 :80BC342C:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:49.152476 :80BC342D:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:49.153656 :80BC3435:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:49.153667 :80BC343B:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:49.153667 :80BC343C:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:50.154429 :80BC34AD:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:50.154433 :80BC34AF:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:50.154499 :80BC34B0:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:50.154499 :80BC34B1:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:50.154501 :80BC34B2:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:50.154511 :80BC34B5:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:50.154511 :80BC34B6:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:51.155419 :80BC34F9:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:51.155423 :80BC34FB:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:51.155488 :80BC34FC:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:51.155488 :80BC34FD:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:51.155490 :80BC34FE:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:51.155500 :80BC3501:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:51.155500 :80BC3502:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:52.156414 :80BC3564:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:52.156424 :80BC3567:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:52.156489 :80BC3570:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:52.156489 :80BC3571:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:53.157458 :80BC35E0:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:53.157470 :80BC35E7:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:53.157471 :80BC35E8:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:54.159519 :80BC3632:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:54.159523 :80BC3634:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:54.159602 :80BC3635:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[2] comment=[KSB action for X-instance calls]
                2015-12-08 04:39:54.159602 :80BC3636:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[18] comment=[KSB action for ksbxic() calls]
                2015-12-08 04:39:54.159602 :80BC3637:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[104] comment=[Scumnt mount lock]
                2015-12-08 04:39:54.159603 :80BC3638:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[105] comment=[Poll system events broadcast channel]
                2015-12-08 04:39:54.159603 :80BC3639:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[332] comment=[Check for async messages from other instances]
                2015-12-08 04:39:55.160333 :80BC3689:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[2] comment=[KSB action for X-instance calls]
                2015-12-08 04:39:55.160334 :80BC368A:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[18] comment=[KSB action for ksbxic() calls]
                2015-12-08 04:39:55.160335 :80BC368B:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[104] comment=[Scumnt mount lock]
                2015-12-08 04:39:55.160335 :80BC368C:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[105] comment=[Poll system events broadcast channel]
                2015-12-08 04:39:55.160335 :80BC368D:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[332] comment=[Check for async messages from other instances]
                2015-12-08 04:39:55.160337 :80BC368E:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[0] comment=[Monitor Cleanup]
                2015-12-08 04:39:55.160337 :80BC368F:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[3] comment=[KSB action for bast checking]
                2015-12-08 04:39:55.160337 :80BC3690:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[205] comment=[Job Queue Timout]
                2015-12-08 04:39:55.160470 :80BC3691:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:55.160470 :80BC3692:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:55.160472 :80BC3693:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:55.160482 :80BC3696:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:55.160483 :80BC3697:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:56.161438 :80BC370A:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:56.161449 :80BC370D:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:56.161522 :80BC3716:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:56.161522 :80BC3717:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:57.162600 :80BC375F:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:57.162620 :80BC3767:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:57.162620 :80BC3768:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:58.163428 :80BC37C8:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:58.163432 :80BC37CA:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:58.163496 :80BC37CB:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:58.163497 :80BC37CC:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:58.163499 :80BC37CD:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:58.163508 :80BC37D0:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:58.163508 :80BC37D1:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:39:59.164432 :80BC383B:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:39:59.164438 :80BC383D:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:39:59.164503 :80BC383E:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:39:59.164503 :80BC383F:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:39:59.164506 :80BC3840:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:39:59.164516 :80BC3843:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:39:59.164516 :80BC3844:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:40:00.165433 :80BC389A:db_trace:ksb.c@3146:ksbsrv(): [10254:30:358] KSBSRV: end callback function called
                2015-12-08 04:40:00.165444 :80BC389D:db_trace:ksb.c@3189:ksbsrv(): [10254:30:358] KSBSRV: done with active = 0
                2015-12-08 04:40:00.165518 :80BC38A6:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[2] comment=[KSB action for X-instance calls]
                2015-12-08 04:40:00.165518 :80BC38A7:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[18] comment=[KSB action for ksbxic() calls]
                2015-12-08 04:40:00.165518 :80BC38A8:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[104] comment=[Scumnt mount lock]
                2015-12-08 04:40:00.165519 :80BC38A9:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[105] comment=[Poll system events broadcast channel]
                2015-12-08 04:40:00.165519 :80BC38AA:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[332] comment=[Check for async messages from other instances]
                2015-12-08 04:40:01.166326 :80BC3901:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[2] comment=[KSB action for X-instance calls]
                2015-12-08 04:40:01.166327 :80BC3902:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[18] comment=[KSB action for ksbxic() calls]
                2015-12-08 04:40:01.166327 :80BC3903:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[104] comment=[Scumnt mount lock]
                2015-12-08 04:40:01.166327 :80BC3904:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[105] comment=[Poll system events broadcast channel]
                2015-12-08 04:40:01.166328 :80BC3905:db_trace:ksb.c@1763:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (interrupt action) : acnum=[332] comment=[Check for async messages from other instances]
                2015-12-08 04:40:01.166330 :80BC3906:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[0] comment=[Monitor Cleanup]
                2015-12-08 04:40:01.166347 :80BC3907:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[3] comment=[KSB action for bast checking]
                2015-12-08 04:40:01.166347 :80BC3908:db_trace:ksb.c@1789:ksbcti(): [10254:30:358] KSBCTI: (CJQ0) : (timeout action)   : acnum=[205] comment=[Job Queue Timout]
                2015-12-08 04:40:01.166481 :80BC3913:db_trace:ksb.c@2906:ksbsrv(): [10254:30:358] KSBSRV: enter for server = 2521818584
                2015-12-08 04:40:01.166481 :80BC3914:db_trace:ksb.c@2938:ksbsrv(): [10254:30:358] KSBSRV: obtained PR enqueue
                2015-12-08 04:40:01.166483 :80BC3915:db_trace:ksb.c@2996:ksbsrv(): [10254:30:358] KSBSRV: called start callback function
                2015-12-08 04:40:01.166493 :80BC3918:db_trace:ksb.c@3079:ksbsrv(): [10254:30:358] KSBSRV: oracle executable name validated proc=[J000]
                2015-12-08 04:40:01.166493 :80BC3919:db_trace:ksb.c@3082:ksbsrv(): [10254:30:358] KSBSRV: starting to wait for 12000 seconds
                2015-12-08 04:40:02.495848 :80BC3984:db_trace:ksb.c@3132:ksbsrv(): [10254:30:358] KSBSRV: unexpected error during process spawn OER(27157)
                -------------------------------------------------------------------------------
                Trace Bucket Dump End: default bucket for process 30 (osid: 13770, CJQ0)
                error 27157 detected in background process
                OPIRIP: Uncaught error 447. Error stack:
                ORA-00447: fatal error in background process
                ORA-27157: OS post/wait facility removed
                ORA-27300: OS system dependent operation:semop failed with status: 43
                ORA-27301: OS failure message: Identifier removed
                ORA-27302: failure occurred at: sskgpwwait1
                
                
                • 5. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:

                  ORA-27157: OS post/wait facility removed

                  ORA-27300: OS system dependent operation:semop failed with status: 43

                  ORA-27301: OS failure message: Identifier removed

                   

                  Oracle is victim; not culprit

                   

                  what clues exist within OS message file?

                  • 6. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                    jgarry

                    That means something is asking for resources that the OS is unable to provide.  Since you are on XE you shouldn't be running into anything, as the XE itself is memory limited.  Show us the memory definitions you are using with the OS and the Oracle init parameters, as well as the trace files.  In particular, I think the parameter is called job_queue_processes.  Are you running into any other strange things, like excessive tablespace growth?

                    • 7. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                      Christy H.
                      ]# cat /etc/sysctl.conf
                      # Kernel sysctl configuration file for Red Hat Linux
                      #
                      # For binary values, 0 is disabled, 1 is enabled.  See sysctl(8) and
                      # sysctl.conf(5) for more details.
                      
                      
                      # Controls IP packet forwarding
                      net.ipv4.ip_forward = 0
                      
                      
                      # Controls source route verification
                      net.ipv4.conf.default.rp_filter = 1
                      
                      
                      # Do not accept source routing
                      net.ipv4.conf.default.accept_source_route = 0
                      
                      
                      # Controls the System Request debugging functionality of the kernel
                      kernel.sysrq = 0
                      
                      
                      # Controls whether core dumps will append the PID to the core filename.
                      # Useful for debugging multi-threaded applications.
                      kernel.core_uses_pid = 1
                      
                      
                      # Controls the use of TCP syncookies
                      net.ipv4.tcp_syncookies = 1
                      
                      
                      # Controls the default maxmimum size of a mesage queue
                      kernel.msgmnb = 65536
                      
                      
                      # Controls the maximum size of a message, in bytes
                      kernel.msgmax = 65536
                      
                      
                      # Controls the maximum shared segment size, in bytes
                      kernel.shmmax = 68719476736
                      
                      
                      # Controls the maximum number of shared memory segments, in pages
                      kernel.shmall = 4294967296
                      net.ipv4.tcp_syncookies = 1
                      net.ipv4.tcp_synack_retries = 2
                      ###########
                      # Oracle Database 11g Express Edition Recommended Values
                      kernel.sem = 250 32000 100 128
                      fs.file-max = 6815744
                      ########
                      
                      SQL> SHOW PARAMETERS
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      O7_DICTIONARY_ACCESSIBILITY          boolean     FALSE
                      active_instance_count                integer
                      aq_tm_processes                      integer     0
                      archive_lag_target                   integer     0
                      asm_diskgroups                       string
                      asm_diskstring                       string
                      asm_power_limit                      integer     1
                      asm_preferred_read_failure_groups    string
                      audit_file_dest                      string      /u01/app/oracle/admin/XE/adump
                      audit_sys_operations                 boolean     FALSE
                      audit_syslog_level                   string
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      audit_trail                          string      NONE
                      background_core_dump                 string      partial
                      background_dump_dest                 string      /u01/app/oracle/diag/rdbms/xe/
                                                                       XE/trace
                      backup_tape_io_slaves                boolean     FALSE
                      bitmap_merge_area_size               integer     1048576
                      blank_trimming                       boolean     FALSE
                      buffer_pool_keep                     string
                      buffer_pool_recycle                  string
                      cell_offload_compaction              string      ADAPTIVE
                      cell_offload_decryption              boolean     TRUE
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      cell_offload_parameters              string
                      cell_offload_plan_display            string      AUTO
                      cell_offload_processing              boolean     TRUE
                      circuits                             integer
                      client_result_cache_lag              big integer 3000
                      client_result_cache_size             big integer 0
                      cluster_database                     boolean     FALSE
                      cluster_database_instances           integer     1
                      cluster_interconnects                string
                      commit_logging                       string
                      commit_point_strength                integer     1
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      commit_wait                          string
                      commit_write                         string
                      compatible                           string      11.2.0.0.0
                      control_file_record_keep_time        integer     7
                      control_files                        string      /u01/app/oracle/oradata/XE/con
                                                                       trol.dbf
                      control_management_pack_access       string      NONE
                      core_dump_dest                       string      /u01/app/oracle/diag/rdbms/xe/
                                                                       XE/cdump
                      cpu_count                            integer     8
                      create_bitmap_area_size              integer     8388608
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      create_stored_outlines               string
                      cursor_bind_capture_destination      string      memory+disk
                      cursor_sharing                       string      EXACT
                      cursor_space_for_time                boolean     FALSE
                      db_16k_cache_size                    big integer 0
                      db_2k_cache_size                     big integer 0
                      db_32k_cache_size                    big integer 0
                      db_4k_cache_size                     big integer 0
                      db_8k_cache_size                     big integer 0
                      db_block_buffers                     integer     0
                      db_block_checking                    string      FALSE
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      db_block_checksum                    string      TYPICAL
                      db_block_size                        integer     8192
                      db_cache_advice                      string      ON
                      db_cache_size                        big integer 0
                      db_create_file_dest                  string
                      db_create_online_log_dest_1          string
                      db_create_online_log_dest_2          string
                      db_create_online_log_dest_3          string
                      db_create_online_log_dest_4          string
                      db_create_online_log_dest_5          string
                      db_domain                            string
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      db_file_multiblock_read_count        integer     39
                      db_file_name_convert                 string
                      db_files                             integer     200
                      db_flash_cache_file                  string
                      db_flash_cache_size                  big integer 0
                      db_flashback_retention_target        integer     1440
                      db_keep_cache_size                   big integer 0
                      db_lost_write_protect                string      NONE
                      db_name                              string      XE
                      db_recovery_file_dest                string      /var/oracle/oracle_fra
                      db_recovery_file_dest_size           big integer 20G
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      db_recycle_cache_size                big integer 0
                      db_securefile                        string      PERMITTED
                      db_ultra_safe                        string      OFF
                      db_unique_name                       string      XE
                      db_unrecoverable_scn_tracking        boolean     TRUE
                      db_writer_processes                  integer     1
                      dbwr_io_slaves                       integer     0
                      ddl_lock_timeout                     integer     0
                      deferred_segment_creation            boolean     TRUE
                      dg_broker_config_file1               string      /u01/app/oracle/product/11.2.0
                                                                       /xe/dbs/dr1XE.dat
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      dg_broker_config_file2               string      /u01/app/oracle/product/11.2.0
                                                                       /xe/dbs/dr2XE.dat
                      dg_broker_start                      boolean     FALSE
                      diagnostic_dest                      string      /u01/app/oracle
                      disk_asynch_io                       boolean     TRUE
                      dispatchers                          string      (PROTOCOL=TCP) (SERVICE=XEXDB)
                      distributed_lock_timeout             integer     60
                      dml_locks                            integer     2440
                      dst_upgrade_insert_conv              boolean     TRUE
                      enable_ddl_logging                   boolean     FALSE
                      event                                string
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      fal_client                           string
                      fal_server                           string
                      fast_start_io_target                 integer     0
                      fast_start_mttr_target               integer     0
                      fast_start_parallel_rollback         string      LOW
                      file_mapping                         boolean     FALSE
                      fileio_network_adapters              string
                      filesystemio_options                 string      none
                      fixed_date                           string
                      gcs_server_processes                 integer     0
                      global_context_pool_size             string
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      global_names                         boolean     FALSE
                      global_txn_processes                 integer     1
                      hash_area_size                       integer     131072
                      hi_shared_memory_address             integer     0
                      hs_autoregister                      boolean     TRUE
                      ifile                                file
                      instance_groups                      string
                      instance_name                        string      XE
                      instance_number                      integer     0
                      instance_type                        string      RDBMS
                      java_jit_enabled                     boolean     TRUE
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      java_max_sessionspace_size           integer     0
                      java_pool_size                       big integer 0
                      java_soft_sessionspace_limit         integer     0
                      job_queue_processes                  integer     950
                      large_pool_size                      big integer 0
                      ldap_directory_access                string      NONE
                      ldap_directory_sysauth               string      no
                      license_max_sessions                 integer     0
                      license_max_users                    integer     0
                      license_sessions_warning             integer     0
                      listener_networks                    string
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      local_listener                       string
                      lock_name_space                      string
                      lock_sga                             boolean     FALSE
                      log_archive_config                   string
                      log_archive_dest                     string
                      log_archive_dest_1                   string
                      log_archive_dest_10                  string
                      log_archive_dest_11                  string
                      log_archive_dest_12                  string
                      log_archive_dest_13                  string
                      log_archive_dest_14                  string
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      log_archive_dest_15                  string
                      log_archive_dest_16                  string
                      log_archive_dest_17                  string
                      log_archive_dest_18                  string
                      log_archive_dest_19                  string
                      log_archive_dest_2                   string
                      log_archive_dest_20                  string
                      log_archive_dest_21                  string
                      log_archive_dest_22                  string
                      log_archive_dest_23                  string
                      log_archive_dest_24                  string
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      log_archive_dest_25                  string
                      log_archive_dest_26                  string
                      log_archive_dest_27                  string
                      log_archive_dest_28                  string
                      log_archive_dest_29                  string
                      log_archive_dest_3                   string
                      log_archive_dest_30                  string
                      log_archive_dest_31                  string
                      log_archive_dest_4                   string
                      log_archive_dest_5                   string
                      log_archive_dest_6                   string
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      log_archive_dest_7                   string
                      log_archive_dest_8                   string
                      log_archive_dest_9                   string
                      log_archive_dest_state_1             string      enable
                      log_archive_dest_state_10            string      enable
                      log_archive_dest_state_11            string      enable
                      log_archive_dest_state_12            string      enable
                      log_archive_dest_state_13            string      enable
                      log_archive_dest_state_14            string      enable
                      log_archive_dest_state_15            string      enable
                      log_archive_dest_state_16            string      enable
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      log_archive_dest_state_17            string      enable
                      log_archive_dest_state_18            string      enable
                      log_archive_dest_state_19            string      enable
                      log_archive_dest_state_2             string      enable
                      log_archive_dest_state_20            string      enable
                      log_archive_dest_state_21            string      enable
                      log_archive_dest_state_22            string      enable
                      log_archive_dest_state_23            string      enable
                      log_archive_dest_state_24            string      enable
                      log_archive_dest_state_25            string      enable
                      log_archive_dest_state_26            string      enable
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      log_archive_dest_state_27            string      enable
                      log_archive_dest_state_28            string      enable
                      log_archive_dest_state_29            string      enable
                      log_archive_dest_state_3             string      enable
                      log_archive_dest_state_30            string      enable
                      log_archive_dest_state_31            string      enable
                      log_archive_dest_state_4             string      enable
                      log_archive_dest_state_5             string      enable
                      log_archive_dest_state_6             string      enable
                      log_archive_dest_state_7             string      enable
                      log_archive_dest_state_8             string      enable
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      log_archive_dest_state_9             string      enable
                      log_archive_duplex_dest              string
                      log_archive_format                   string      %t_%s_%r.dbf
                      log_archive_local_first              boolean     TRUE
                      log_archive_max_processes            integer     4
                      log_archive_min_succeed_dest         integer     1
                      log_archive_start                    boolean     FALSE
                      log_archive_trace                    integer     0
                      log_buffer                           integer     5271552
                      log_checkpoint_interval              integer     0
                      log_checkpoint_timeout               integer     1800
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      log_checkpoints_to_alert             boolean     FALSE
                      log_file_name_convert                string
                      max_dispatchers                      integer
                      max_dump_file_size                   string      unlimited
                      max_enabled_roles                    integer     150
                      max_shared_servers                   integer
                      memory_max_target                    big integer 1G
                      memory_target                        big integer 1G
                      nls_calendar                         string      GREGORIAN
                      nls_comp                             string      BINARY
                      nls_currency                         string      $
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      nls_date_format                      string      DD-MON-RR
                      nls_date_language                    string      AMERICAN
                      nls_dual_currency                    string      $
                      nls_iso_currency                     string      AMERICA
                      nls_language                         string      AMERICAN
                      nls_length_semantics                 string      BYTE
                      nls_nchar_conv_excp                  string      FALSE
                      nls_numeric_characters               string      .,
                      nls_sort                             string      BINARY
                      nls_territory                        string      AMERICA
                      nls_time_format                      string      HH.MI.SSXFF AM
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      nls_time_tz_format                   string      HH.MI.SSXFF AM TZR
                      nls_timestamp_format                 string      DD-MON-RR HH.MI.SSXFF AM
                      nls_timestamp_tz_format              string      DD-MON-RR HH.MI.SSXFF AM TZR
                      object_cache_max_size_percent        integer     10
                      object_cache_optimal_size            integer     102400
                      olap_page_pool_size                  big integer 0
                      open_cursors                         integer     500
                      open_links                           integer     4
                      open_links_per_instance              integer     4
                      optimizer_capture_sql_plan_baselines boolean     FALSE
                      optimizer_dynamic_sampling           integer     2
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      optimizer_features_enable            string      11.2.0.2
                      optimizer_index_caching              integer     0
                      optimizer_index_cost_adj             integer     100
                      optimizer_mode                       string      ALL_ROWS
                      optimizer_secure_view_merging        boolean     TRUE
                      optimizer_use_invisible_indexes      boolean     FALSE
                      optimizer_use_pending_statistics     boolean     FALSE
                      optimizer_use_sql_plan_baselines     boolean     TRUE
                      os_authent_prefix                    string      ops$
                      os_roles                             boolean     FALSE
                      parallel_adaptive_multi_user         boolean     TRUE
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      parallel_automatic_tuning            boolean     FALSE
                      parallel_degree_limit                string      CPU
                      parallel_degree_policy               string      MANUAL
                      parallel_execution_message_size      integer     16384
                      parallel_force_local                 boolean     FALSE
                      parallel_instance_group              string
                      parallel_io_cap_enabled              boolean     FALSE
                      parallel_max_servers                 integer     0
                      parallel_min_percent                 integer     0
                      parallel_min_servers                 integer     0
                      parallel_min_time_threshold          string      AUTO
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      parallel_server                      boolean     FALSE
                      parallel_server_instances            integer     1
                      parallel_servers_target              integer     128
                      parallel_threads_per_cpu             integer     2
                      permit_92_wrap_format                boolean     TRUE
                      pga_aggregate_target                 big integer 0
                      plscope_settings                     string      IDENTIFIERS:NONE
                      plsql_ccflags                        string
                      plsql_code_type                      string      INTERPRETED
                      plsql_debug                          boolean     FALSE
                      plsql_optimize_level                 integer     2
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      plsql_v2_compatibility               boolean     FALSE
                      plsql_warnings                       string      DISABLE:ALL
                      pre_page_sga                         boolean     FALSE
                      processes                            integer     500
                      query_rewrite_enabled                string      TRUE
                      query_rewrite_integrity              string      enforced
                      rdbms_server_dn                      string
                      read_only_open_delayed               boolean     FALSE
                      recovery_parallelism                 integer     0
                      recyclebin                           string      on
                      redo_transport_user                  string
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      remote_dependencies_mode             string      TIMESTAMP
                      remote_listener                      string
                      remote_login_passwordfile            string      EXCLUSIVE
                      remote_os_authent                    boolean     FALSE
                      remote_os_roles                      boolean     FALSE
                      replication_dependency_tracking      boolean     TRUE
                      resource_limit                       boolean     FALSE
                      resource_manager_cpu_allocation      integer     8
                      resource_manager_plan                string
                      result_cache_max_result              integer     5
                      result_cache_max_size                big integer 0
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      result_cache_mode                    string      MANUAL
                      result_cache_remote_expiration       integer     0
                      resumable_timeout                    integer     0
                      rollback_segments                    string
                      sec_case_sensitive_logon             boolean     TRUE
                      sec_max_failed_login_attempts        integer     10
                      sec_protocol_error_further_action    string      CONTINUE
                      sec_protocol_error_trace_action      string      TRACE
                      sec_return_server_release_banner     boolean     FALSE
                      serial_reuse                         string      disable
                      service_names                        string      XE
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      session_cached_cursors               integer     50
                      session_max_open_files               integer     10
                      sessions                             integer     776
                      sga_max_size                         big integer 1G
                      sga_target                           big integer 0
                      shadow_core_dump                     string      partial
                      shared_memory_address                integer     0
                      shared_pool_reserved_size            big integer 20761804
                      shared_pool_size                     big integer 0
                      shared_server_sessions               integer
                      shared_servers                       integer     4
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      skip_unusable_indexes                boolean     TRUE
                      smtp_out_server                      string
                      sort_area_retained_size              integer     0
                      sort_area_size                       integer     65536
                      spfile                               string      /u01/app/oracle/product/11.2.0
                                                                       /xe/dbs/spfileXE.ora
                      sql92_security                       boolean     FALSE
                      sql_trace                            boolean     FALSE
                      sqltune_category                     string      DEFAULT
                      standby_archive_dest                 string      ?/dbs/arch
                      standby_file_management              string      MANUAL
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      star_transformation_enabled          string      FALSE
                      statistics_level                     string      TYPICAL
                      streams_pool_size                    big integer 0
                      tape_asynch_io                       boolean     TRUE
                      thread                               integer     0
                      timed_os_statistics                  integer     0
                      timed_statistics                     boolean     TRUE
                      trace_enabled                        boolean     TRUE
                      tracefile_identifier                 string
                      transactions                         integer     610
                      transactions_per_rollback_segment    integer     5
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      undo_management                      string      AUTO
                      undo_retention                       integer     900
                      undo_tablespace                      string      UNDOTBS1
                      use_indirect_data_buffers            boolean     FALSE
                      use_large_pages                      string      TRUE
                      user_dump_dest                       string      /u01/app/oracle/diag/rdbms/xe/
                                                                       XE/trace
                      utl_file_dir                         string
                      workarea_size_policy                 string      AUTO
                      xml_db_events                        string      enable
                      SQL>
                      
                      
                      SQL> show parameter job
                      
                      
                      NAME                                 TYPE        VALUE
                      ------------------------------------ ----------- ------------------------------
                      job_queue_processes                  integer     950
                      
                      
                      • 8. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                        jgarry

                        Poking about the tubes with the messages sol.beach posted, now wondering what you have in the way of swap space.

                         

                        Why not use OEL?

                        • 9. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                          Christy H.
                          # grep Huge /proc/meminfo
                          AnonHugePages:   1196032 kB
                          HugePages_Total:       0
                          HugePages_Free:        0
                          HugePages_Rsvd:        0
                          HugePages_Surp:        0
                          Hugepagesize:       2048 kB
                          
                          # free -m
                                       total       used       free     shared    buffers     cached
                          Mem:          7830       7631        199       3232        251       4765
                          -/+ buffers/cache:       2614       5216
                          Swap:         3071        237       2834
                          [root@hakim-group ~]#
                          
                          • 10. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                            jgarry

                            Are there recommendations that swap should be twice real memory?

                             

                            I believe setting AMM memory_target is incompatible with hugepages, I'm sure someone will correct me if that has changed.

                            • 11. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                              Christy H.

                              Thanks for your comments.

                               

                              What should I do?

                              • 12. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                                jgarry

                                Google: How to disable oracle AMM for hugepages.  memory_* variables control it (I think, I wouldn't be the first to get all these acronyms and parameters confused).

                                Or you could turn hugepages off, since it's possible for a misconfiguration to define hugepages while Oracle can't use them.  Hugepages are generally considered the in thing these days, but of course you're on your own with a relatively small memory on a strange OS.

                                 

                                Edit:  Note there is also an XE space around here somewhere, someone may have opinions about what you should do.

                                • 13. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                                  Christy H.

                                  Thank you very much. I am also waiting from yesterday to have reply but my bad still nobody have written comments that can fix my problem

                                  • 14. Re: Errors in file /u01/app/oracle/diag/rdbms/xe/XE/trace/XE_cjq0_13770.trc:
                                    jgarry

                                    In general, if you have mysterious problems coming and going, you want to be sure you are in the correct ballpark.  (Which means be sure all configuration makes sense).  You might then have other problems, but at least you aren't driving into the bay next to the ballpark.

                                    1 2 Previous Next