11 Replies Latest reply on May 30, 2013 2:07 AM by 1000662

    Process J000 died Process W000 died and uable connect database

    1000662
      Database can startup normally ,but after 2 hours


      When I attempted to conn db
      [oracle@p49drzdb ~]$ sqlplus / as sysdba

      SQL*Plus: Release 11.2.0.3.0 Production on Mon May 27 14:33:59 2013

      Copyright (c) 1982, 2011, Oracle. All rights reserved.

      Connected to an idle instance.




      ALERT LOG:
      Mon May 27 16:23:16 2013
      Process m000 died, see its trace file
      Process J000 died, see its trace file
      kkjcre1p: unable to spawn jobq slave process
      Errors in file /home/oracle/app/diag/rdbms/appstore/appstore/trace/appstore_cjq0_3479.trc:
      Process J000 died, see its trace file
      kkjcre1p: unable to spawn jobq slave process
      Errors in file /home/oracle/app/diag/rdbms/appstore/appstore/trace/appstore_cjq0_3479.trc:
      Process W000 died, see its trace file
      Process J000 died, see its trace file
      DATABASE STATUS
      SQL> show parameter job

      NAME TYPE VALUE

      job_queue_processes integer 1000

      SQL> select count(*) from v$process;

      COUNT(*)

      30

      SQL> show parameter mem

      NAME TYPE VALUE

      hi_shared_memory_address integer 0
      memory_max_target big integer 11168M
      memory_target big integer 11168M
      shared_memory_address integer 0

      [root@p49drzdb ~]# cat /proc/meminfo
      MemTotal: 16435928 kB
      MemFree: 1524468 kB
      Buffers: 22576 kB
      Cached: 8848068 kB
      SwapCached: 0 kB
      Active: 2260364 kB
      Inactive: 7294820 kB
      HighTotal: 0 kB
      HighFree: 0 kB
      LowTotal: 16435928 kB
      LowFree: 1524468 kB
      SwapTotal: 4194296 kB
      SwapFree: 4194148 kB
      Dirty: 204 kB
      Writeback: 0 kB
      AnonPages: 684536 kB
      Mapped: 1291840 kB
      Slab: 155148 kB
      PageTables: 204704 kB
      NFS_Unstable: 0 kB
      Bounce: 0 kB
      CommitLimit: 12412260 kB
      Committed_AS: 9049332 kB
      VmallocTotal: 34359738367 kB
      VmallocUsed: 264964 kB
      VmallocChunk: 34359472887 kB
      HugePages_Total: 0
      HugePages_Free: 0
      HugePages_Rsvd: 0
      Hugepagesize: 2048 kB

      Edited by: 997659 on 2013-5-27 上午2:39

      Edited by: 997659 on 2013-5-27 上午2:40

      Edited by: 997659 on 2013-5-27 上午2:41

      Edited by: 997659 on 2013-5-27 上午2:41

      Edited by: 997659 on 2013-5-27 上午2:42
        • 2. Re: Process J000 died Process W000 died and uable connect database
          1000662
          RESOURCE_NAME CURRENT_UTILIZATION MAX_UTILIZATION INITIAL_ALLOCATION LIMIT_VALUE


          processes 213 214 1024 1024
          sessions 211 214 1560 1560
          enqueue_locks 201 204 18508 18508
          enqueue_resources 33 33 7084 UNLIMITED
          ges_procs 0 0 0 0
          ges_ress 0 0 0 UNLIMITED
          ges_locks 0 0 0 UNLIMITED
          ges_cache_ress 0 0 0 UNLIMITED
          ges_reg_msgs 0 0 0 UNLIMITED
          ges_big_msgs 0 0 0 UNLIMITED
          ges_rsv_msgs 0 0 0 0
          gcs_resources 0 0 UNLIMITED UNLIMITED
          gcs_shadows 0 0 UNLIMITED UNLIMITED
          smartio_overhead_memory 0 0 0 UNLIMITED
          smartio_buffer_memory 0 0 0 UNLIMITED
          smartio_metadata_memory 0 0 0 UNLIMITED
          smartio_sessions 0 0 0 UNLIMITED
          dml_locks 10 10 6864 UNLIMITED
          temporary_table_locks 0 0 UNLIMITED UNLIMITED
          transactions 1 1 1716 UNLIMITED
          branches 0 0 1716 UNLIMITED
          cmtcallbk 0 1 1716 UNLIMITED
          max_rollback_segments 11 11 1716 65535
          sort_segment_locks 1 1 UNLIMITED UNLIMITED
          k2q_locks 0 0 3120 UNLIMITED
          max_shared_servers 1 1 UNLIMITED UNLIMITED
          parallel_max_servers 7 7 320 3600

          Edited by: 997659 on 2013-5-27 上午1:50
          • 3. Re: Process J000 died Process W000 died and uable connect database
            1000662
            Thanks

            I read The note you give me ,and I find my resource limit is normal.
            • 5. Re: Process J000 died Process W000 died and uable connect database
              rp0428
              >
              Process W000 died, see its trace file
              Process J000 died, see its trace file
              >
              What did those trace files show?
              • 6. Re: Process J000 died Process W000 died and uable connect database
                1000662
                Trace file  show the same infomation Process J000 is dead (pid=19330 req_ver=262 cur_ver=262 state=KSOSP_SPAWNED).


                Trace file /home/oracle/app/diag/rdbms/appstore/appstore/trace/appstore_cjq0_14231.trc
                Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
                With the Partitioning, OLAP, Data Mining and Real Application Testing options
                ORACLE_HOME = /home/oracle/app/product/11.2.0/dbhome_1
                System name: Linux
                Node name: p49drzdb
                Release: 2.6.18-308.el5
                Version: #1 SMP Fri Jan 27 17:17:51 EST 2012
                Machine: x86_64
                VM name: VMWare Version: 6
                Instance name: appstore
                Redo thread mounted by this instance: 1
                Oracle process number: 19
                Unix process pid: 14231, image: oracle@p49drzdb (CJQ0)


                *** 2013-05-27 18:07:04.701
                *** SESSION ID:(588.7) 2013-05-27 18:07:04.701
                *** CLIENT ID:() 2013-05-27 18:07:04.701
                *** SERVICE NAME:(SYS$BACKGROUND) 2013-05-27 18:07:04.701
                *** MODULE NAME:() 2013-05-27 18:07:04.701
                *** ACTION NAME:() 2013-05-27 18:07:04.701

                Process J000 is dead (pid=19316 req_ver=266 cur_ver=266 state=KSOSP_SPAWNED).

                *** 2013-05-27 18:07:05.735
                Process J000 is dead (pid=19330 req_ver=262 cur_ver=262 state=KSOSP_SPAWNED).

                *** 2013-05-27 18:07:11.738
                Process J000 is dead (pid=19400 req_ver=267 cur_ver=267 state=KSOSP_SPAWNED).

                *** 2013-05-27 18:07:12.739
                Process J000 is dead (pid=19414 req_ver=263 cur_ver=263 state=KSOSP_SPAWNED)

                .........................................................
                • 7. Re: Process J000 died Process W000 died and uable connect database
                  rp0428
                  What is your setting for JOB_QUEUE_PROCESSES?
                  • 8. Re: Process J000 died Process W000 died and uable connect database
                    1000662
                    SQL> show parameter job

                    NAME TYPE VALUE

                    job_queue_processes integer 1000
                    • 9. Re: Process J000 died Process W000 died and uable connect database
                      startup
                      Hi,

                      let us know what your kernel parameters you had specified for memory.This is most probably outage of memory.If outage of memory raises, the background process will not start of SMCO.pls give us the output of cat /etc/sysctl.conf
                      1 person found this helpful
                      • 10. Re: Process J000 died Process W000 died and uable connect database
                        1000662
                        # Kernel sysctl configuration file for Red Hat Linux
                        #
                        # For binary values, 0 is disabled, 1 is enabled. See sysctl(8) and
                        # sysctl.conf(5) for more details.

                        # Controls IP packet forwarding
                        net.ipv4.ip_forward = 0

                        # Controls source route verification
                        net.ipv4.conf.default.rp_filter = 1

                        # Do not accept source routing
                        net.ipv4.conf.default.accept_source_route = 0

                        # Controls the System Request debugging functionality of the kernel
                        kernel.sysrq = 0

                        # Controls whether core dumps will append the PID to the core filename
                        # Useful for debugging multi-threaded applications
                        kernel.core_uses_pid = 1

                        # Controls the use of TCP syncookies
                        net.ipv4.tcp_syncookies = 1

                        # Controls the maximum size of a message, in bytes
                        kernel.msgmnb = 65536

                        # Controls the default maxmimum size of a mesage queue
                        kernel.msgmax = 65536

                        # Controls the maximum shared segment size, in bytes
                        kernel.shmmax = 68719476736

                        # Controls the maximum number of shared memory segments, in pages
                        kernel.shmall = 4294967296

                        net.ipv4.tcp_max_syn_backlog = 8192

                        kernel.sem = 250 32000 100 128
                        fs.file-max = 6815744
                        net.ipv4.ip_local_port_range = 9000 65500
                        net.core.rmem_default = 262144
                        net.core.wmem_default = 262144
                        net.core.rmem_max = 4194304
                        net.core.wmem_max = 1048576
                        fs.aio-max-nr = 1048576
                        kernel.shmmax = 13589934592
                        kernel.shmmni = 4096
                        kernel.shmall = 4194304

                        Edited by: 997659 on 2013-5-27 下午11:29
                        • 11. Re: Process J000 died Process W000 died and uable connect database
                          1000662
                          Why I modifid the MEMORY_TARGET from 11g to 8g , the promblem was solved?

                          my OS mem is 16g and my shm is 14g Why cann't I set the MEMORY_TARGET to 11g?