6 Replies Latest reply: Jan 18, 2013 10:25 AM by kamilp RSS

    rescue data

    kamilp
      Hi,

      I am running two node RAC Oracle Database 11g, we had issue with shared storage - controller failure. After replacing the controller I see the ASM groups but the database is not starting due to errors. What is the best way to salvage the data ? I need some company that provides service to export several objects from one schema in the database. I believe that most of the database is unaffected by the controller failure, and I need to salvage the data from there.
      Anyone has good experience with such company / service ?

      Regards and thanks for advices.
        • 1. Re: rescue data
          P.Forstmann
          What are the exact errors that you get ?
          Do you have any backups for this database ?

          Normally the best way "to salvage data" is simply to restore from backup. If you don't have any backup and have an Oracle Support contract you can ask Oracle Support for help: they have a tool named DUL for this kind of problems. See also http://www.oracle-internals.com/?p=17%20Blvd.
          • 2. Re: rescue data
            JohnWatson
            Are you asking for consultancy services? If so, I'm sure my boss would be happy to quote. We have staff qualified up to Oracle Certified Master (me) level. I'm not sure that this forum is meant for commercial messages, though. You can find us at http://skillbuilders.com
            • 3. Re: rescue data
              Osama_Mustafa
              Could You provide us with Logs Alertlog, Crs Logs ?
              • 4. Re: rescue data
                kamilp
                No backup available :(

                Alert log since last startup is very long, exceeds 30000 characters limit. So I can not paste it all...


                Thu Jan 17 20:36:23 2013
                Starting ORACLE instance (normal)
                LICENSE_MAX_SESSION = 0
                LICENSE_SESSIONS_WARNING = 0
                Interface type 1 eth1 10.10.10.0 configured from GPnP Profile for use as a cluster interconnect
                Interface type 1 eth0 192.168.140.0 configured from GPnP Profile for use as a public interface
                Picked latch-free SCN scheme 3
                Using LOG_ARCHIVE_DEST_1 parameter default value as USE_DB_RECOVERY_FILE_DEST
                Autotune of undo retention is turned on.
                LICENSE_MAX_USERS = 0
                SYS auditing is disabled
                Starting up:
                Oracle Database 11g Release 11.2.0.1.0 - 64bit Production
                With the Real Application Clusters option.
                Using parameter settings in server-side pfile /u01/app/oracle/product/11.2.0/dbhome_1/dbs/initracdb2.ora
                System parameters with non-default values:
                processes = 150
                spfile = "+RACDB1/racdb/spfileracdb.ora"
                sga_target = 1536M
                control_files = "+RACDB1/racdb/controlfile/current.256.718117737"
                control_files = "+FRAVOL1/racdb/controlfile/current.256.718117737"
                db_block_size = 8192
                compatible = "11.2.0.0.0"
                cluster_database = TRUE
                db_create_file_dest = "+RACDB1"
                db_recovery_file_dest = "+FRAVOL1"
                db_recovery_file_dest_size= 900000M
                thread = 2
                undo_tablespace = "UNDOTBS2"
                undo_retention = 36000
                instance_number = 2
                sec_case_sensitive_logon = FALSE
                remote_login_passwordfile= "EXCLUSIVE"
                db_domain = "site"
                dispatchers = "(PROTOCOL=TCP) (SERVICE=racdbXDB)"
                remote_listener = "orcl-cluster-scan:1521"
                audit_file_dest = "/u01/app/oracle/admin/racdb/adump"
                audit_trail = "DB"
                db_name = "racdb"
                open_cursors = 300
                pga_aggregate_target = 3216M
                control_management_pack_access= "DIAGNOSTIC+TUNING"
                diagnostic_dest = "/u01/app/oracle"
                Cluster communication is configured to use the following interface(s) for this instance
                10.10.10.2
                cluster interconnect IPC version:Oracle UDP/IP (generic)
                IPC Vendor 1 proto 2
                Thu Jan 17 20:36:25 2013
                PMON started with pid=2, OS id=6667
                Thu Jan 17 20:36:25 2013
                VKTM started with pid=3, OS id=6672 at elevated priority
                VKTM running at (10)millisec precision with DBRM quantum (100)ms
                Thu Jan 17 20:36:25 2013
                GEN0 started with pid=4, OS id=6679
                Thu Jan 17 20:36:25 2013
                DIAG started with pid=5, OS id=6684
                Thu Jan 17 20:36:25 2013
                DBRM started with pid=6, OS id=6689
                Thu Jan 17 20:36:25 2013
                PING started with pid=7, OS id=6694
                Thu Jan 17 20:36:25 2013
                PSP0 started with pid=8, OS id=6699
                Thu Jan 17 20:36:25 2013
                ACMS started with pid=9, OS id=6704
                Thu Jan 17 20:36:25 2013
                DIA0 started with pid=10, OS id=6709
                Thu Jan 17 20:36:25 2013
                LMON started with pid=11, OS id=6714
                Thu Jan 17 20:36:28 2013
                LMD0 started with pid=12, OS id=6719
                Thu Jan 17 20:36:28 2013
                LMS0 started with pid=13, OS id=6725 at elevated priority
                Thu Jan 17 20:36:28 2013
                LMS1 started with pid=14, OS id=6732 at elevated priority
                Thu Jan 17 20:36:28 2013
                RMS0 started with pid=15, OS id=6739
                Thu Jan 17 20:36:28 2013
                LMHB started with pid=16, OS id=6744
                Thu Jan 17 20:36:28 2013
                MMAN started with pid=17, OS id=6749
                Thu Jan 17 20:36:28 2013
                DBW0 started with pid=18, OS id=6754
                Thu Jan 17 20:36:28 2013
                LGWR started with pid=19, OS id=6759
                Thu Jan 17 20:36:28 2013
                CKPT started with pid=20, OS id=6764
                Thu Jan 17 20:36:28 2013
                SMON started with pid=21, OS id=6769
                Thu Jan 17 20:36:28 2013
                RECO started with pid=22, OS id=6774
                Thu Jan 17 20:36:28 2013
                RBAL started with pid=23, OS id=6779
                Thu Jan 17 20:36:28 2013
                ASMB started with pid=24, OS id=6784
                Thu Jan 17 20:36:28 2013
                MMON started with pid=25, OS id=6789
                Thu Jan 17 20:36:28 2013
                MMNL started with pid=26, OS id=6794
                starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
                starting up 1 shared server(s) ...
                lmon registered with NM - instance number 2 (internal mem no 1)
                NOTE: initiating MARK startup
                Starting background process MARK
                Thu Jan 17 20:36:29 2013
                MARK started with pid=29, OS id=6817
                NOTE: MARK has subscribed
                Reconfiguration started (old inc 0, new inc 2)
                List of instances:
                2 (myinst: 2)
                Global Resource Directory frozen
                * allocate domain 0, invalid = TRUE
                Communication channels reestablished
                Master broadcasted resource hash value bitmaps
                Non-local Process blocks cleaned out
                LMS 1: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
                LMS 0: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
                Set master node info
                Submitted all remote-enqueue requests
                Dwn-cvts replayed, VALBLKs dubious
                All grantable enqueues granted
                Post SMON to start 1st pass IR
                Submitted all GCS remote-cache requests
                Post SMON to start 1st pass IR
                Fix write in gcs resources
                Reconfiguration complete
                Thu Jan 17 20:36:29 2013
                LCK0 started with pid=31, OS id=6832
                Starting background process RSMN
                Thu Jan 17 20:36:29 2013
                RSMN started with pid=30, OS id=6837
                ORACLE_BASE not set in environment. It is recommended
                that ORACLE_BASE be set in the environment
                Reusing ORACLE_BASE from an earlier startup = /u01/app/grid
                Thu Jan 17 20:36:30 2013
                ALTER DATABASE MOUNT
                This instance was first to mount
                NOTE: Loaded library: /opt/oracle/extapi/64/asm/orcl/1/libasm.so
                NOTE: Loaded library: System
                SUCCESS: diskgroup RACDB1 was mounted
                SUCCESS: diskgroup FRAVOL1 was mounted
                NOTE: dependency between database racdb and diskgroup resource ora.RACDB1.dg is established
                NOTE: dependency between database racdb and diskgroup resource ora.FRAVOL1.dg is established
                Successful mount of redo thread 2, with mount id 802584910
                Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
                Lost write protection disabled
                Completed: ALTER DATABASE MOUNT
                ALTER DATABASE OPEN
                This instance was first to open
                Beginning crash recovery of 2 threads
                Started redo scan
                Thu Jan 17 20:36:45 2013
                Completed redo scan
                read 1083826 KB redo, 13599 data blocks need recovery
                Hex dump of (file 12, block 1153034) in trace file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_ora_6842.trc
                Corrupt block relative dba: 0x0311980a (file 12, block 1153034)
                Fractured block found during crash/instance recovery
                Data in bad block:
                type: 6 format: 2 rdba: 0x0311980a
                last change scn: 0x0001.8a43c844 seq: 0x1 flg: 0x06
                spare1: 0x0 spare2: 0x0 spare3: 0x0
                consistency value in tail: 0x72440601
                check value in block header: 0xf410
                computed block checksum: 0xaf5f
                Reading datafile '+RACDB1/racdb/datafile/users.265.796923935' for corruption at rdba: 0x0311980a (file 12, block 1153034)
                Reread (file 12, block 1153034) found same corrupt data
                Hex dump of (file 5, block 1471246) in trace file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_ora_6842.trc
                Corrupt block relative dba: 0x0156730e (file 5, block 1471246)
                Bad header found during crash/instance recovery
                Data in bad block:
                type: 36 format: 6 rdba: 0x730e0000
                last change scn: 0x8a44.460d0156 seq: 0x1 flg: 0x00
                spare1: 0x6 spare2: 0xa2 spare3: 0x33b4
                consistency value in tail: 0x06012e4a
                check value in block header: 0x401
                block checksum disabled
                Reading datafile '+RACDB1/racdb/datafile/users.264.718117759' for corruption at rdba: 0x0156730e (file 5, block 1471246)
                Reread (file 5, block 1471246) found same corrupt data
                Hex dump of (file 7, block 1722218) in trace file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_ora_6842.trc
                Corrupt block relative dba: 0x01da476a (file 7, block 1722218)
                Bad header found during crash/instance recovery
                Data in bad block:
                type: 46 format: 2 rdba: 0x476a0000
                last change scn: 0x8a44.464201da seq: 0x1 flg: 0x00
                spare1: 0x6 spare2: 0xa2 spare3: 0xa15d
                consistency value in tail: 0x0601ff4e
                check value in block header: 0x401
                block checksum disabled


                ..................................... ANOTHER PART OF ALERT LOG........................................

                Reading datafile '+RACDB1/racdb/datafile/sysaux.260.718117743' for corruption at rdba: 0x00816b0f (file 2, block 92943)
                Reread (file 2, block 92943) found same corrupt data
                Hex dump of (file 2, block 93039) in trace file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_ora_6842.trc
                Corrupt block relative dba: 0x00816b6f (file 2, block 93039)
                Bad header found during crash/instance recovery
                Data in bad block:
                type: 43 format: 6 rdba: 0x6b6f0000
                last change scn: 0x8a44.46240081 seq: 0x1 flg: 0x00
                spare1: 0x6 spare2: 0xa2 spare3: 0xc491
                consistency value in tail: 0x0601095b
                check value in block header: 0x401
                block checksum disabled



                ..................................... ANOTHER PART OF ALERT LOG........................................


                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0xB3BCF8, {empty}] [flags: 0x8, count: 2]
                Thu Jan 17 20:36:55 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_d000_6804.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0xB3BCF8, {empty}] [flags: 0x8, count: 2]
                Thu Jan 17 20:36:55 2013
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35B112A, ksxpchkrcfg()+58] [flags: 0x0, count: 1]
                Thu Jan 17 20:36:55 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_o000_6857.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x1] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Thu Jan 17 20:36:56 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_mmon_6789.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0xC8] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_pmon_6667.trc (incident=67294):
                ORA-07445: exception encountered: core dump [PC:0xB3BCF8] [SIGSEGV] [ADDR:0x0] [PC:0xB3BCF8] [SI_KERNEL(general_protection)] []
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x7C43878, {empty}] [flags: 0xA, count: 3]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_lms0_6725.trc (incident=67382):
                ORA-07445: exception encountered: core dump [ksxpchkrcfg()+58] [SIGSEGV] [ADDR:0x0] [PC:0x35B112A] [SI_KERNEL(general_protection)] []
                Incident details in: /u01/app/oracle/diag/rdbms/racdb/racdb2/incident/incdir_67382/racdb2_lms0_6725_i67382.trc
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x53A0C40, ssexhd()+2306] [flags: 0x0, count: 2]
                Thu Jan 17 20:36:56 2013
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_o001_6868.trc (incident=67550):
                ORA-00600: internal error code, arguments: [kspgsp2], [0x0BE5978C8], [2388], [tracefile_identifier], [], [], [], [], [], [], [], []
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_dbw0_6754.trc (incident=67423):
                ORA-07445: exception encountered: core dump [kcldle()+2147] [SIGSEGV] [ADDR:0x76F2DE57FFC9] [PC:0x3E3464D] [Address not mapped to object] []
                ORA-00600: internal error code, arguments: [kcbbvr_verify_disk_blk_1], [], [], [], [], [], [], [], [], [], [], []
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_o001_6868.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.
                ORA-00600: internal error code, arguments: [kspgsp2], [0x0BE5978C8], [2388], [tracefile_identifier], [], [], [], [], [], [], [], []

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x20000001C] [PC:0x7C43878, {empty}] [flags: 0x8, count: 2]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/incident/incdir_67550/racdb2_o001_6868_i67550.trc:
                ORA-07445: exception encountered: core dump [PC:0x7C43878] [SIGSEGV] [ADDR:0x20000001C] [PC:0x7C43878] [Address not mapped to object] []
                ORA-00600: internal error code, arguments: [kspgsp2], [0x0BE5978C8], [2388], [tracefile_identifier], [], [], [], [], [], [], [], []
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_o000_6857.trc (incident=67542):
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0x1] [PC:0x7C44154] [Address not mapped to object] []
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x1E] [PC:0x7C43897, {empty}] [flags: 0xA, count: 3]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_lms0_6725.trc (incident=67383):
                ORA-07445: exception encountered: core dump [ssexhd()+2306] [SIGSEGV] [ADDR:0x0] [PC:0x53A0C40] [SI_KERNEL(general_protection)] []
                ORA-07445: exception encountered: core dump [ksxpchkrcfg()+58] [SIGSEGV] [ADDR:0x0] [PC:0x35B112A] [SI_KERNEL(general_protection)] []
                Incident details in: /u01/app/oracle/diag/rdbms/racdb/racdb2/incident/incdir_67383/racdb2_lms0_6725_i67383.trc
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_d000_6804.trc (incident=67494):
                ORA-07445: exception encountered: core dump [PC:0xB3BCF8] [SIGSEGV] [ADDR:0x0] [PC:0xB3BCF8] [Address not mapped to object] []
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C43878, {empty}] [flags: 0xA, count: 3]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_mmon_6789.trc (incident=67478):
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0xC8] [PC:0x7C44154] [Address not mapped to object] []
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x12] [PC:0x7C43897, {empty}] [flags: 0xA, count: 3]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C43878, kspgip()+166] [flags: 0x0, count: 3]
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, ksxp_crash_reset()+132] [flags: 0x0, count: 4]
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x39D8270, kfk_get_oss_ctx()+38] [flags: 0x0, count: 5]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/incident/incdir_67383/racdb2_lms0_6725_i67383.trc:
                ORA-00600: internal error code, arguments: [kspgsp2], [0x0B8BD2678], [1559], [core_dump_dest], [], [], [], [], [], [], [], []
                ORA-07445: exception encountered: core dump [kfk_get_oss_ctx()+38] [SIGSEGV] [ADDR:0x0] [PC:0x39D8270] [SI_KERNEL(general_protection)] []
                ORA-07445: exception encountered: core dump [ssexhd()+2306] [SIGSEGV] [ADDR:0x0] [PC:0x53A0C40] [SI_KERNEL(general_protection)] []
                ORA-07445: exception encountered: core dump [ksxpchkrcfg()+58] [SIGSEGV] [ADDR:0x0] [PC:0x35B112A] [SI_KERNEL(general_protection)] []
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, {empty}] [flags: 0xA, count: 4]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C43D9D, {empty}] [flags: 0xA, count: 5]
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, {empty}] [flags: 0xA, count: 4]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C43D9D, {empty}] [flags: 0xA, count: 5]
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, {empty}] [flags: 0xA, count: 4]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x1] [PC:0x7C43DBC, {empty}] [flags: 0xA, count: 5]
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, {empty}] [flags: 0xA, count: 4]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C43D9D, {empty}] [flags: 0xA, count: 5]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C43878, {empty}] [flags: 0x8, count: 3]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/incident/incdir_67550/racdb2_o001_6868_i67550.trc:
                ORA-07445: exception encountered: core dump [PC:0x7C43878] [SIGSEGV] [ADDR:0x0] [PC:0x7C43878] [Address not mapped to object] []
                ORA-07445: exception encountered: core dump [PC:0x7C43878] [SIGSEGV] [ADDR:0x20000001C] [PC:0x7C43878] [Address not mapped to object] []
                ORA-00600: internal error code, arguments: [kspgsp2], [0x0BE5978C8], [2388], [tracefile_identifier], [], [], [], [], [], [], [], []
                Thu Jan 17 20:36:56 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_mmnl_6794.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0xC8] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_mmnl_6794.trc (incident=67486):
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0xC8] [PC:0x7C44154] [Address not mapped to object] []
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x12] [PC:0x7C43897, {empty}] [flags: 0xA, count: 3]
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, {empty}] [flags: 0x8, count: 4]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/incident/incdir_67550/racdb2_o001_6868_i67550.trc:
                ORA-07445: exception encountered: core dump [PC:0x35A05AA] [SIGSEGV] [ADDR:0x0] [PC:0x35A05AA] [SI_KERNEL(general_protection)] []
                ORA-07445: exception encountered: core dump [PC:0x7C43878] [SIGSEGV] [ADDR:0x0] [PC:0x7C43878] [Address not mapped to object] []
                ORA-07445: exception encountered: core dump [PC:0x7C43878] [SIGSEGV] [ADDR:0x20000001C] [PC:0x7C43878] [Address not mapped to object] []
                ORA-00600: internal error code, arguments: [kspgsp2], [0x0BE5978C8], [2388], [tracefile_identifier], [], [], [], [], [], [], [], []
                Thu Jan 17 20:36:57 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_ckpt_6764.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0xC8] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, {empty}] [flags: 0xA, count: 4]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x1] [PC:0x7C43DBC, {empty}] [flags: 0xA, count: 5]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_ckpt_6764.trc (incident=67438):
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0xC8] [PC:0x7C44154] [Address not mapped to object] []
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x12] [PC:0x7C43897, {empty}] [flags: 0xA, count: 3]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C43D9D, {empty}] [flags: 0x8, count: 5]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/incident/incdir_67550/racdb2_o001_6868_i67550.trc:
                ORA-07445: exception encountered: core dump [PC:0x7C43D9D] [SIGSEGV] [ADDR:0x0] [PC:0x7C43D9D] [Address not mapped to object] []
                ORA-07445: exception encountered: core dump [PC:0x35A05AA] [SIGSEGV] [ADDR:0x0] [PC:0x35A05AA] [SI_KERNEL(general_protection)] []
                ORA-07445: exception encountered: core dump [PC:0x7C43878] [SIGSEGV] [ADDR:0x0] [PC:0x7C43878] [Address not mapped to object] []
                ORA-07445: exception encountered: core dump [PC:0x7C43878] [SIGSEGV] [ADDR:0x20000001C] [PC:0x7C43878] [Address not mapped to object] []
                ORA-00600: internal error code, arguments: [kspgsp2], [0x0BE5978C8], [2388], [tracefile_identifier], [], [], [], [], [], [], [], []
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, {empty}] [flags: 0xA, count: 4]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x1] [PC:0x7C43DBC, {empty}] [flags: 0xA, count: 5]
                Thu Jan 17 20:36:58 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_gen0_6679.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0xC8] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Thu Jan 17 20:36:58 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_rms0_6739.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Thu Jan 17 20:36:58 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_dbrm_6689.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0xC8] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_gen0_6679.trc (incident=67310):
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0xC8] [PC:0x7C44154] [Address not mapped to object] []
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x12] [PC:0x7C43897, {empty}] [flags: 0xA, count: 3]
                Thu Jan 17 20:36:58 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_psp0_6699.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_rms0_6739.trc (incident=67398):
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0x0] [PC:0x7C44154] [Address not mapped to object] []
                Thu Jan 17 20:36:58 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_acms_6704.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0xC8] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Thu Jan 17 20:36:58 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_lgwr_6759.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0xC8] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_dbrm_6689.trc (incident=67326):
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0xC8] [PC:0x7C44154] [Address not mapped to object] []
                Thu Jan 17 20:36:58 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_smon_6769.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                Writing to the above trace file is disabled for now on...
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0xC8] [PC:0x7C44154, {empty}] [flags: 0x8, count: 2]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_psp0_6699.trc (incident=67342):
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0x0] [PC:0x7C44154] [Address not mapped to object] []
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, {empty}] [flags: 0x8, count: 3]
                Thu Jan 17 20:36:58 2013
                Non critical error ORA-07202 caught while writing to trace file "/u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_reco_6774.trc"
                Error message: ORA-07202: sltln: invalid parameter to sltln.

                ..................................... ANOTHER PART OF ALERT LOG........................................


                mapped to object] []
                ORA-07445: exception encountered: core dump [PC:0x35A05AA] [SIGSEGV] [ADDR:0x0] [PC:0x35A05AA] [SI_KERNEL(general_protection)] []
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0xC8] [PC:0x7C44154] [Address not mapped to object] []
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x12] [PC:0x7C43897, {empty}] [flags: 0xA, count: 5]
                Errors in file /u01/app/oracle/diag/rdbms/racdb/racdb2/trace/racdb2_rbal_6779.trc (incident=67464):
                ORA-07445: exception encountered: core dump [PC:0x7C43DBC] [SIGSEGV] [ADDR:0x1] [PC:0x7C43DBC] [Address not mapped to object] []
                ORA-07445: exception encountered: core dump [PC:0x35A05AA] [SIGSEGV] [ADDR:0x0] [PC:0x35A05AA] [SI_KERNEL(general_protection)] []
                ORA-07445: exception encountered: core dump [PC:0x7C44154] [SIGSEGV] [ADDR:0xC8] [PC:0x7C44154] [Address not mapped to object] []
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x12] [PC:0x7C43897, {empty}] [flags: 0xA, count: 5]
                Exception [type: SIGSEGV, SI_KERNEL(general_protection)] [ADDR:0x0] [PC:0x35A05AA, {empty}] [flags: 0xA, count: 4]
                Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x0] [PC:0x7C43D9D, {empty}] [flags: 0xA, count: 5]
                • 5. Re: rescue data
                  Osama_Mustafa
                  lot of errors as i see
                  Corrupt block relative dba file 7
                  this file indicate to Tablespace
                  ORA-07445: exception encountered: core dump [PC:0x7C43DBC] [SIGSEGV] [ADDR:0x1] [PC:0x7C43DBC] [Address not mapped to object] []
                  This indicate for bug and should Open SR

                  Please What Is DB version (4 digit), Os version
                  • 6. Re: rescue data
                    kamilp
                    I managed to recover the data using the AUL (MyDUL)