6 Replies Latest reply on Sep 16, 2016 3:22 PM by Yunus-Oracle

    The problems of the communication channel causes an error ORA-600 and ORA-07445

    2698798

      Win 2008 x64

      ORACLE 11.2.0.3 BP 39; all the patches are installed;

      In the database created a lot of snapshots read-only - CREATE MATERIALIZED VIEW - data comes from different databases, which located in different network segments.

      When the problems of the communication channel, of course, arise update error snapshots.If these many errors, the database stops accepting connections, errors of this kind:

       

      Alert log:

      ORA-07445: exception encountered: core dump [kglGetSO()+120] [ACCESS_VIOLATION] [ADDR:0x28] [PC:0x176A078] [UNABLE_TO_READ] []

      ------

      ORA-07445: exception encountered: core dump [PC:0x49B1006E] [ACCESS_VIOLATION] [ADDR:0x49B1006E] [PC:0x49B1006E] [UNABLE_TO_WRITE] []

      ORA-01001: invalid cursor

      ORA-02050: transaction 83.29.103428 rolled back, some remote DBs may be in-doubt

      ORA-03114: not connected to ORACLE

      ORA-02063: preceding line from XXX.XXX.XXX.XXXX

      ------

      Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0x24] [PC:0x17349FE, kglpim()+2010]

      ORA-07445: exception encountered: core dump [kglpim()+2010] [ACCESS_VIOLATION] [ADDR:0x24] [PC:0x17349FE] [UNABLE_TO_READ] []

      ORA-03150: Message 3150 not found;  product=RDBMS; facility=ORA

      ORA-02063: preceding line from YYY.YYY.YYY.YYYY

      ------

      ORA-07445: exception encountered: core dump [kocedc()+13] [ACCESS_VIOLATION] [ADDR:0x130] [PC:0x1249F51] [UNABLE_TO_READ] []

      ORA-00600: internal error code, arguments: [kglssr], [216], [217], [], [], [], [], [], [], [], [], []

      ------

      ORA-07445: caught exception [ACCESS_VIOLATION] at [kghsrch()+19] [0x00000000013322B7]

      Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0xFFFFFFFFFFFFFFFF] [PC:0x13322B7, kghsrch()+19]

      ------

      Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0x24] [PC:0x11260AB, kglpim()+2105]

      ERROR: Unable to normalize symbol name for the following short stack (at offset 213):

      dbgexProcessError()+200<-dbgeExecuteForError()+65<-dbgePostErrorKGE()+2255<-dbkePostKGE_kgsf()+77<-kgeade()+563<-kgerelv()+151<-kgerev()+45<-kgerec5()+60<-sss_xcpt_EvalFilterEx()+1862<-sss_xcpt_EvalFilter()+174<-.1.4_5+59<-00000000775078C8<-0000000077517E8D<-00000000775084CF<-000000007753BAC8<-kglpim()+2105<-qcdlgtd()+260<-qcsfplob()+166<-qcsprfro()+505<-qcsprfro_tree()+292<-qcsprfro_tree()+373<-qcspafq()+280<-qcspqbDescendents()+227<-qcspqb()+263<-qcsevw()+942<-qcsfpsq()+120<-kkmfcbsq()+683<-PGOSF174_kkmpfcbk()+1110<-qcsprfro()+552<-qcsprfro_tree()+292<-qcsprfro_tree()+373<-qcspafq()+280<-qcspqbDescendents()+227<-qcspqb()+263<-kkmdrv()+98<-opiSem()+23311<-opiprs()+676<-kksParseChildCursor()+2184<-rpiswu2()+3039<-kksLoadChild()+8116<-kxsGetRuntimeLock()+2489<-kksfbc()+13129<-kkspsc0()+4112<-kksParseCursor()+148<-opiosq0()+3233<-opiall0()+7057<-opikpr()+699<-opiodr()+1644<-rpidrus()+979<-rpidru()+157

      ORA-07445: exception encountered: core dump [kglpim()+2105] [ACCESS_VIOLATION] [ADDR:0x24] [PC:0x11260AB] [UNABLE_TO_READ] []

      ORA-03135: connection lost contact

      ORA-02063: preceding line from ZZZ.ZZZ.ZZZ.ZZZZ

      ------

      Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0x24] [PC:0x11260AB, kglpim()+2105]

      ORA-07445: exception encountered: core dump [kglpim()+2105] [ACCESS_VIOLATION] [ADDR:0x24] [PC:0x11260AB] [UNABLE_TO_READ] []

      ORA-03150: end-of-file on communication channel for database link

      ORA-02063: preceding line from VVV.VVV.VVV.VVVV

         

      В trace:

      Dump continued from file: D:\ORACLE\diag\rdbms\trace\_j008_16608.trc

      ORA-07445: exception encountered: core dump [kglpim()+2105] [ACCESS_VIOLATION] [ADDR:0x24] [PC:0x11260AB] [UNABLE_TO_READ] []

      ORA-03150: end-of-file on communication channel for database link

      ORA-02063: preceding line from XXX.XXX.XXX.XXXX

       

      ========= Dump for incident 341803 (ORA 7445 [kglpim()+2105]) ========

      ----- Beginning of Customized Incident Dump(s) -----

      Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0x24] [PC:0x11260AB, kglpim()+2105]

       

      Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production

      Process Id: 0x00003470  Thread Id : 0x000040e0    Time : Thu Sep 15 03:25:08

      1. Excp. Code: 0xc0000005  Excp. Type: ACCESS_VIO    Flags: 0x00000000

       

      ------------------- Registers ----------------------------

      ip=00000000011260AB sp=000000006B323B20 rp=000000006B323B80

      r1=0000000000000000 r2=00000000DB594AE0 r3=0000000BE5870F70

      r4=0000000000000000 r5=000000006B323B20 r6=000000006B323B80 r7=0000000B6DBA4F38

      r8=0000000B6DBA4C08 r9=0000000000000000 r10=0000000000000000 r11=0000000000000000

      r12=0000000000000000 r13=000000075AE59ED8 r14=000000075AE5A878 r15=00000000DB594AE0

      ------------------- End of Registers ---------------------

       

       

      *** 2016-09-15 03:25:08.727

      dbkedDefDump(): Starting a non-incident diagnostic dump (flags=0x3, level=3, mask=0x0)

      ----- Current SQL Statement for this session (sql_id=0p8gnprc1cv88) -----

      SELECT /*+ remote_mapped("XXX.XXX.XXX.XXXX ") */ DISTINCT LOG$."SK_1" , LOG$."PL_1" , LOG$."ZB2_1" FROM (SELECT MLOG$."SK_1" , MLOG$."PL_1" , MLOG$."ZB2_1" FROM "DB207"."MLOG$_PLAST"@" XXX.XXX.XXX.XXXX " MLOG$ WHERE "SNAPTIME$$" > :1 AND ("DMLTYPE$$" != 'I')) LOG$ WHERE (LOG$."SK_1" , LOG$."PL_1" , LOG$."ZB2_1") NOT IN (SELECT MAS_TAB$."SK_1" , MAS_TAB$."PL_1" , MAS_TAB$."ZB2_1" FROM "DB207"."PLAST"@" XXX.XXX.XXX.XXXX " "MAS_TAB$" WHERE LOG$."SK_1" = MAS_TAB$."SK_1" AND LOG$."PL_1" = MAS_TAB$."PL_1" AND LOG$."ZB2_1" = MAS_TAB$."ZB2_1")

      ----- PL/SQL Stack -----

      ----- PL/SQL Call Stack -----

        object      line  object

        handle    number  name

      0000000BE7FAA088        84  package body SYS.DBMS_SNAPSHOT

      0000000BE7FAA088       900  package body SYS.DBMS_SNAPSHOT

      0000000BE7FAA088      1893  package body SYS.DBMS_SNAPSHOT

      0000000BE7FAA088      2524  package body SYS.DBMS_SNAPSHOT

      0000000BE7FAA088      2776  package body SYS.DBMS_SNAPSHOT

      0000000BBF62EC70       685  package body SYS.DBMS_IREFRESH

      0000000BDFEA6388       195  package body SYS.DBMS_REFRESH

      0000000BC30FCE30         2  anonymous block

      ----------- messages from pre-loading .sym files:

      Symbol file D:\ORACLE\ORA11\BIN\orannzsbb11.SYM does not match binary.

      Symbol TimeStamp=53a3d18a, Module TimeStamp=553a9dff are different

      ------

      Dump file D:\ORACLE\diag\...\incdir_342173\_qmnc_7368_i342173.trc

      Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production

      With the Partitioning, OLAP, Data Mining and Real Application Testing options

      Windows NT Version V6.1 Service Pack 1

      CPU                 : 32 - type 8664, 16 Physical Cores

      Process Affinity    : 0x0x0000000000000000

      Memory (Avail/Total): Ph:29726M/65501M, Ph+PgF:186069M/226000M

      Instance name:

      Redo thread mounted by this instance: 1

      Oracle process number: 91

      Windows thread id: 7368, image: ORACLE.EXE (QMNC)

       

       

      *** 2016-09-15 07:06:54.036

      *** SESSION ID:(1298.3) 2016-09-15 07:06:54.036

      *** CLIENT ID:() 2016-09-15 07:06:54.036

      *** SERVICE NAME:(SYS$BACKGROUND) 2016-09-15 07:06:54.036

      *** MODULE NAME:(Streams) 2016-09-15 07:06:54.036

      *** ACTION NAME:(QMON Coordinator) 2016-09-15 07:06:54.036

      Dump continued from file: D:\ORACLE\diag\rdbms\trace\_qmnc_7368.trc

      ORA-00445: background process "q004" did not start after 120 seconds

       

      ========= Dump for incident 342173 (ORA 445) ========

      ----- Beginning of Customized Incident Dump(s) -----

      -------------------------------------------------------------------------------

      Trace Bucket Dump Begin: default bucket for process 91 (osid: 7368, QMNC)

      TIME(*=approx):SEQ:COMPONENT:FILE@LINE:FUNCTION:SECT/DUMP: [EVENT#:PID:SID] DATA

       

      ------

       

      Need your help how to solve the problem.

        • 1. Re: The problems of the communication channel causes an error ORA-600 and ORA-07445
          Gbenga Ajakaye

          2698798 wrote:

           

          Win 2008 x64

          ORACLE 11.2.0.3 BP 39; all the patches are installed;

          In the database created a lot of snapshots read-only - CREATE MATERIALIZED VIEW - data comes from different databases, which located in different network segments.

          When the problems of the communication channel, of course, arise update error snapshots.If these many errors, the database stops accepting connections, errors of this kind:

           

          Alert log:

          ORA-07445: exception encountered: core dump [kglGetSO()+120] [ACCESS_VIOLATION] [ADDR:0x28] [PC:0x176A078] [UNABLE_TO_READ] []

          ------

           

          Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0x24] [PC:0x17349FE, kglpim()+2010]

          ORA-07445: exception encountered: core dump [kglpim()+2010] [ACCESS_VIOLATION] [ADDR:0x24] [PC:0x17349FE] [UNABLE_TO_READ] []

           

          Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0x24] [PC:0x11260AB, kglpim()+2105]

          ERROR: Unable to normalize symbol name for the following short stack (at offset 213):

          dbgexProcessError()+200<-dbgeExecuteForError()+65<-dbgePostErrorKGE()+2255<-dbkePostKGE_kgsf()+77<-kgeade()+563<-kgerelv()+151<-kgerev()+45<-kgerec5()+60<-sss_xcpt_EvalFilterEx()+1862<-sss_xcpt_EvalFilter()+174<-.1.4_5+59<-00000000775078C8<-0000000077517E8D<-00000000775084CF<-000000007753BAC8<-kglpim()+2105<-qcdlgtd()+260<-qcsfplob()+166<-qcsprfro()+505<-qcsprfro_tree()+292<-qcsprfro_tree()+373<-qcspafq()+280<-qcspqbDescendents()+227<-qcspqb()+263<-qcsevw()+942<-qcsfpsq()+120<-kkmfcbsq()+683<-PGOSF174_kkmpfcbk()+1110<-qcsprfro()+552<-qcsprfro_tree()+292<-qcsprfro_tree()+373<-qcspafq()+280<-qcspqbDescendents()+227<-qcspqb()+263<-kkmdrv()+98<-opiSem()+23311<-opiprs()+676<-kksParseChildCursor()+2184<-rpiswu2()+3039<-kksLoadChild()+8116<-kxsGetRuntimeLock()+2489<-kksfbc()+13129<-kkspsc0()+4112<-kksParseCursor()+148<-opiosq0()+3233<-opiall0()+7057<-opikpr()+699<-opiodr()+1644<-rpidrus()+979<-rpidru()+157

          ORA-07445: exception encountered: core dump [kglpim()+2105] [ACCESS_VIOLATION] [ADDR:0x24] [PC:0x11260AB] [UNABLE_TO_READ] []

          ORA-03135: connection lost contact

          ORA-02063: preceding line from ZZZ.ZZZ.ZZZ.ZZZZ

          ------

          Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0x24] [PC:0x11260AB, kglpim()+2105]

          ORA-07445: exception encountered: core dump [kglpim()+2105] [ACCESS_VIOLATION] [ADDR:0x24] [PC:0x11260AB] [UNABLE_TO_READ] []

          ORA-03150: end-of-file on communication channel for database link

          ORA-02063: preceding line from VVV.VVV.VVV.VVVV

           

          В trace:

          Dump continued from file: D:\ORACLE\diag\rdbms\trace\_j008_16608.trc

          ORA-07445: exception encountered: core dump [kglpim()+2105] [ACCESS_VIOLATION] [ADDR:0x24] [PC:0x11260AB] [UNABLE_TO_READ] []

          ORA-03150: end-of-file on communication channel for database link

          ORA-02063: preceding line from XXX.XXX.XXX.XXXX

           

           

          Need your help how to solve the problem.

          What exactly were you doing when the error happen? You mentioned something about creating MVs?

           

          Quick glance of your log file reviews:

          • ORA-03114: not connected to ORACLE - which means:
            • ORA-03114 not connected to ORACLE
            • A call to Oracle was attempted when no connection was established. Usually this happens because a user-written program has not logged on. It may also happen if communication trouble causes a disconnection.
          • ORA-07445 : ACCESS_VIOLATION, UNABLE_TO_READ]
            • ORA-07445 you might have to log a service request (SR) with Oracle Technical support

              See MOSC Note 153788.1 titled "Troubleshoot an ORA-600 or ORA-7445 Error Using the Error Lookup Tool" to get more insight on how to resolve the issue.

          ORA-03114 not connected to ORACLE

           

          Cause: A call to Oracle was attempted when no connection was established. Usually this happens because a user-written program has not logged on. It may also happen if communication trouble causes a disconnection.

          • 3. Re: The problems of the communication channel causes an error ORA-600 and ORA-07445
            2698798
            "You mentioned something about creating MVs?" - The database has a lot of MATERIALIZED VIEW, which are updated from remote databases over the network. as soon as there are some network problems, these errors appear, the database no longer work properly.

             

            • 4. Re: The problems of the communication channel causes an error ORA-600 and ORA-07445
              Gbenga Ajakaye

              Can you follow the steps below and paste the output.

              From your os:

              • lsnrctl status (paste result) (if you have multiple homes. Do . oraenv and enter your db name and press enter).
              • If your listener is work, then try connecting to the database.
                • sqlplus / as sysdba (paste result).
              • 5. Re: The problems of the communication channel causes an error ORA-600 and ORA-07445
                2698798

                C:\>lsnrctl status
                LSNRCTL for 64-bit Windows: Version 11.2.0.3.0 - Production on 16-SEP-2016 13:42:20
                Copyright (c) 1991, 2011, Oracle.  All rights reserved.
                Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=TT.TT.TT.T)(PORT=1521)))
                STATUS of the LISTENER
                ------------------------
                Alias                     LISTENER
                Version                   TNSLSNR for 64-bit Windows: Version 11.2.0.3.0 - Production
                Start Date                01-AUG-2016 09:04:54
                Uptime                    46 days 4 hr. 37 min. 30 sec
                Trace Level               user
                Security                  ON: Local OS Authentication
                SNMP                      OFF
                Listener Parameter File   D:\ORACLE\ORA11\network\admin\listener.ora
                Listener Log File         D:\ORACLE\diag\tnslsnr\AAAAA\listener\alert\log.xml
                Listener Trace File       D:\ORACLE\diag\tnslsnr\AAAAA\listener\trace\ora_11756_12228.trc
                Listening Endpoints Summary...
                  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST= TT.TT.TT.T)(PORT=1521)))
                  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=\\.\pipe\EXTPROC1521ipc)))
                Services Summary...
                Service "CLRExtProc" has 1 instance(s).
                  Instance "CLRExtProc", status UNKNOWN, has 1 handler(s) for this service...
                Service "XXXX.XXX.XX.XX" has 1 instance(s).
                  Instance "XXXX", status UNKNOWN, has 1 handler(s) for this service...
                Service " YYYY.YYY.YY.YY" has 1 instance(s).
                  Instance "YYYY", status UNKNOWN, has 1 handler(s) for this service...
                The command completed successfully

                C:\Windows\System32>set oracle_sid= YYYY
                C:\Windows\System32>sqlplus "sys/password as sysdba"
                SQL*Plus: Release 11.2.0.3.0 Production on Fri Sep 16 13:47:56 2016
                Copyright (c) 1982, 2011, Oracle.  All rights reserved.
                Connected to:
                Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
                With the Partitioning, OLAP, Data Mining and Real Application Testing options
                SQL>

                • 6. Re: The problems of the communication channel causes an error ORA-600 and ORA-07445
                  Yunus-Oracle

                  Please check below MOS Note for you issue. Check any of the database that you have dblink connection to see if any of below pathes applied

                  Bug 5702977 or Bug 18973907