1 Reply Latest reply: Jun 3, 2013 10:40 AM by gdarling - oracle RSS

    oracle service goes down intermittently

    User550057 - Oracle
      ENV:single instance db 11.2.0.3 on 64bit windows 2008 server R2

      no errors found in alert.log,oracle service goes down intermittently.

      Following is the last lines in alert.log:

      +2013-05-29 20:54:59.890000 -06:00+
      Starting background process SMCO
      SMCO started with pid=70, OS id=22636

      +2013-05-29 21:16:59.697000 -06:00+
      Time drift detected. Please check VKTM trace file for more details.

      contents of the VKTM trace file:

      Trace file C:\APP\ORACLE\DIAG1\diag\rdbms\vis\vis\trace\vis_vktm_25308.trc
      Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
      With the Partitioning, OLAP, Data Mining and Real Application Testing options
      Windows NT Version V6.1

      CPU                 : 6 - type 8664, 6 Physical Cores
      Process Affinity    : 0x0x0000000000000000
      Memory (Avail/Total): Ph:27412M/31899M, PhPgF:41016M/63797M+

      Instance name: vis
      Redo thread mounted by this instance: 0 <none>
      Oracle process number: 4
      Windows thread id: 25308, image: ORACLE.EXE (VKTM)


      *** 2013-05-29 20:50:32.274
      *** SESSION ID:(2017.1) 2013-05-29 20:50:32.274
      *** CLIENT ID:() 2013-05-29 20:50:32.274
      *** SERVICE NAME:() 2013-05-29 20:50:32.274
      *** MODULE NAME:() 2013-05-29 20:50:32.274
      *** ACTION NAME:() 2013-05-29 20:50:32.274

      kstmmainvktm: succeeded in setting elevated priority
      highres_enabled

      *** 2013-05-29 20:50:32.274
      VKTM running at (10)millisec precision with DBRM quantum (100)ms
      +[Start] HighResTick = 842214976721+
      kstmrmtickcnt = 0 : ksudbrmseccnt[0] = 1369882232
      kstmchkdrift (kstmhighrestimecntkeeper:highres): Time jumped forward by (7478947)usec at (843798718318) whereas (1000000) is allowed


      From windows event viewer,can found application error,following is the detail:

      Log Name:      Application
      Source:        Application Error
      Date:          5/29/2013 9:16:52 PM
      Event ID:      1000
      Task Category: (100)
      Level:         Error
      Keywords:      Classic
      User:          N/A
      Computer:      SLC03OMO.us.oracle.com
      Description:
      Faulting application name: ORACLE.EXE, version: 11.2.0.3, time stamp: 0x4eb21f4b
      Faulting module name: unknown, version: 0.0.0.0, time stamp: 0x00000000
      Exception code: 0xc0000005
      Fault offset: 0x000000006e8a00b6
      Faulting process id: 0x3524
      Faulting application start time: 0x01ce5ce060341504
      Faulting application path: c:\app\oracle\product\11.2.0\bin\ORACLE.EXE
      Faulting module path: unknown
      Report Id: 5eec0ca0-c8d7-11e2-a59d-fc9cad5d59a7
      Event Xml:
      +<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">+
      +<System>+
      +<Provider Name="Application Error" />+
      +<EventID Qualifiers="0">1000</EventID>+
      +<Level>2</Level>+
      +<Task>100</Task>+
      +<Keywords>0x80000000000000</Keywords>+
      +<TimeCreated SystemTime="2013-05-30T03:16:52.000000000Z" />+
      +<EventRecordID>33818</EventRecordID>+
      +<Channel>Application</Channel>+
      +<Computer>SLC03OMO.us.oracle.com</Computer>+
      +<Security />+
      +</System>+
      +<EventData>+
      +<Data>ORACLE.EXE</Data>+
      +<Data>11.2.0.3</Data>+
      +<Data>4eb21f4b</Data>+
      +<Data>unknown</Data>+
      +<Data>0.0.0.0</Data>+
      +<Data>00000000</Data>+
      +<Data>c0000005</Data>+
      +<Data>000000006e8a00b6</Data>+
      +<Data>3524</Data>+
      +<Data>01ce5ce060341504</Data>+
      +<Data>c:\app\oracle\product\11.2.0\bin\ORACLE.EXE</Data>+
      +<Data>unknown</Data>+
      +<Data>5eec0ca0-c8d7-11e2-a59d-fc9cad5d59a7</Data>+
      +</EventData>+
      +</Event>+

      can found another windows error reporting* occured almost the same time as the above application error:*

      Log Name:      Application
      Source:        Windows Error Reporting
      Date:          5/29/2013 9:17:14 PM
      Event ID:      1001
      Task Category: None
      Level:         Information
      Keywords:      Classic
      User:          N/A
      Computer:      SLC03OMO.us.oracle.com
      Description:
      Fault bucket , type 0
      Event Name: APPCRASH
      Response: Not available
      Cab Id: 0

      Problem signature:
      P1: ORACLE.EXE
      P2: 11.2.0.3
      P3: 4eb21f4b
      P4: StackHash_2264
      P5: 0.0.0.0
      P6: 00000000
      P7: c0000005
      P8: 000000006e8a00b6
      P9:

      P10:


      Attached files:
      C:\Windows\Temp\WER753D.tmp.appcompat.txt
      C:\Windows\Temp\WER757D.tmp.WERInternalMetadata.xml
      C:\Windows\Temp\WER757E.tmp.hdmp
      C:\Windows\Temp\WER93C5.tmp.mdmp

      These files may be available here:
      C:\ProgramData\Microsoft\Windows\WER\ReportQueue\AppCrash_ORACLE.EXE_74241b6d51d6043166543f6b75dacacb44b54_cab_274194bc

      Analysis symbol:

      Rechecking for solution: 0
      Report Id: 5eec0ca0-c8d7-11e2-a59d-fc9cad5d59a7
      Report Status: 4
      Event Xml:
      +<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">+
      +<System>+
      +<Provider Name="Windows Error Reporting" />+
      +<EventID Qualifiers="0">1001</EventID>+
      +<Level>4</Level>+
      +<Task>0</Task>+
      +<Keywords>0x80000000000000</Keywords>+
      +<TimeCreated SystemTime="2013-05-30T03:17:14.000000000Z" />+
      +<EventRecordID>33819</EventRecordID>+
      +<Channel>Application</Channel>+
      +<Computer>SLC03OMO.us.oracle.com</Computer>+
      +<Security />+
      +</System>+
      +<EventData>+
      +<Data>+
      +</Data>+
      +<Data>0</Data>+
      +<Data>APPCRASH</Data>+
      +<Data>Not available</Data>+
      +<Data>0</Data>+
      +<Data>ORACLE.EXE</Data>+
      +<Data>11.2.0.3</Data>+
      +<Data>4eb21f4b</Data>+
      +<Data>StackHash_2264</Data>+
      +<Data>0.0.0.0</Data>+
      +<Data>00000000</Data>+
      +<Data>c0000005</Data>+
      +<Data>000000006e8a00b6</Data>+
      +<Data>+
      +</Data>+
      +<Data>+
      +</Data>+
      +<Data>+
      C:\Windows\Temp\WER753D.tmp.appcompat.txt
      C:\Windows\Temp\WER757D.tmp.WERInternalMetadata.xml
      C:\Windows\Temp\WER757E.tmp.hdmp
      C:\Windows\Temp\WER93C5.tmp.mdmp</Data>
      +<Data>C:\ProgramData\Microsoft\Windows\WER\ReportQueue\AppCrash_ORACLE.EXE_74241b6d51d6043166543f6b75dacacb44b54_cab_274194bc</Data>+
      +<Data>+
      +</Data>+
      +<Data>0</Data>+
      +<Data>5eec0ca0-c8d7-11e2-a59d-fc9cad5d59a7</Data>+
      +<Data>4</Data>+
      +</EventData>+
      +</Event>+

      and following is the log of windows control manager:

      Log Name:      System
      Source:        Service Control Manager
      Date:          5/29/2013 9:17:15 PM
      Event ID:      7034
      Task Category: None
      Level:         Error
      Keywords:      Classic
      User:          N/A
      Computer:      SLC03OMO.us.oracle.com
      Description:
      The OracleServiceVIS service terminated unexpectedly.  It has done this 3 time(s).
      Event Xml:
      +<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">+
      +<System>+
      +<Provider Name="Service Control Manager" Guid="{555908d1-a6d7-4695-8e1e-26931d2012f4}" EventSourceName="Service Control Manager" />+
      +<EventID Qualifiers="49152">7034</EventID>+
      +<Version>0</Version>+
      +<Level>2</Level>+
      +<Task>0</Task>+
      +<Opcode>0</Opcode>+
      +<Keywords>0x8080000000000000</Keywords>+
      +<TimeCreated SystemTime="2013-05-30T03:17:15.208132800Z" />+
      +<EventRecordID>88710</EventRecordID>+
      +<Correlation />+
      +<Execution ProcessID="512" ThreadID="5532" />+
      +<Channel>System</Channel>+
      +<Computer>SLC03OMO.us.oracle.com</Computer>+
      +<Security />+
      +</System>+
      +<EventData>+
      +<Data Name="param1">OracleServiceVIS</Data>+
      +<Data Name="param2">3</Data>+
      +</EventData>+
      +</Event>+

      Wondering how to fix the issue.

      Thanks