14 Replies Latest reply: Jul 10, 2007 3:51 AM by 587241 RSS

    ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive

    540215
      I want to restore a database from cold backup. I don't think the cold backup is
      consistent. It's the image of hard drive when other drive of the server crashed.

      I did following steps successfully
      ALTER DATABASE RECOVER DATAFILE SYSTEM01.DBF
      ALTER DATABASE RECOVER DATAFILE UNDOTBS01.DBF
      RECOVER DATABASE;
      However when I get the following error messages when I try to startup the db:
      alter database open
      *
      ERROR at line 1:
      ORA-01092: ORACLE instance terminated. Disconnection forced
      Error message in trace file :
       Tue Jan 09 18:26:24 2007
      Errors in file e:\oracle\admin\athendb\udump\testdb_ora_2244.trc:
      ORA-00704: bootstrap process failure
      ORA-00604: error occurred at recursive SQL level 2
      ORA-08103: object no longer exists
      and in testdb_ora_2244.trc it says
      *** 2007-01-09 18:26:23.000
      KCRA: start recovery claims for 0 data blocks
      *** 2007-01-09 18:26:23.000
      KCRA: buffers claimed = 0/0, eliminated = 0
      ORA-00704: bootstrap process failure
      ORA-00604: error occurred at recursive SQL level 2
      ORA-08103: object no longer exists
      I also took away UNDO part in pfile and spfile. As suggested in
      http://www.dbasupport.com/forums/archive/index.php/t-44944.html
      but it didn't help.

      I am using Windows 2000 Version 5.0 Service Pack 4 and
      Oracle9i Enterprise Edition Release 9.2.0.1.0.

      Thanks in advance for any suggestion.
        • 1. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recur
          427492
          Did you restore all dbf, ctl, redo, etc? Perform nomount, then mount, then issue:
          select distinct checkpint_change# from v$datafile;
          If this comes back with just 1 number, then your dbf are consistent, then attempt to open the db. What does the alert log say?
          • 2. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recur
            540215
            I have all the files.
            SQL> select distinct checkpoint_change# from v$datafile;

            CHECKPOINT_CHANGE#
            ------------------
                    8.3815E+12
            DB can be mounted successfully.
            When I tried to open the db, I got the same error as in my original post.
            • 3. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recur
              427492
              ORA-704 suggests that Oracle Support Services be contacted.
              • 4. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                531427
                bootstrap segment is very important.
                It's called cache segment .
                When 'create database' , it was created by sql.bsq script.
                While DB open, it help the dictionary cache intialization.
                If bootstrap was failed, cannot open the database.

                It can only open from regular recovery.

                If you don't have any backup, can recover by "adjust_scn" command & some events.

                Message was edited by:
                Min Angel (Yeon Hong Min)

                If you make requests, I'll offer the recovery method.
                • 5. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                  540215
                  It would be much appreciated if you could offer your solution.
                  • 6. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                    531427
                    It's the worst case. Hidden solution for me..;;

                    before action. backup 2 copy by another media tapes.

                    below is my expreience.
                    I'm Korean DBA in Seoul. 12th Oracle9i Certified Master in Korea.
                    I'm pool at english use..
                    Please understand me..;;

                    --------------------------------------------------------------------------------

                    alert log message.
                    ORA-00704: bootstrap process failure
                    ORA-00704: bootstrap process failure
                    ORA-00600: internal error code, arguments: [4000], [9], [], [], [], [], [], []

                    My solution..
                    It can also use the online backup , not be archive file.
                    When System change number is far..

                    1. SELECT V1.GROUP#, MEMBER, SEQUENCE#, FIRST_CHANGE#
                    FROM V$LOG V1, V$LOGFILE V2
                    WHERE V1.GROUP# = V2.GROUP# ;

                    2. SELECT FILE#, CHANGE# FROM V$RECOVER_FILE;

                    If CHANGE# > minimum FIRST_CHANGE#
                    It cannot recover.

                    but If CHANGE# <= minimum FIRST_CHANGE#
                    it can recover. create backup controlfile trace
                    and edit the control file trace NORESETLOGS=>RESETLOGS.
                    then create controlfile and resetlogs open.
                    You can recover the database.


                    below ..
                    use only CHANGE# > minimum FIRST_CHANGE#
                    when system change number is far..

                    (1) set the parameter

                    event = '10015 trace name context forever, level 10'
                    event = '10510 trace name context forever, level 10'
                    event = '10511 trace name context forever, level 10'
                    allowresetlogs_corruption = true
                    # UNDO_MANAGEMENT=AUTO => MANUAL~!!!
                    offlinerollback_segments = (_SYSSMU1$,_SYSSMU2$,_SYSSMU3 $,_SYSSMU4$,_SYSSMU5$,_SYSSMU6$,_SYSSMU7$,_SYSSMU8$,_SYSSMU9$,_SYSSMU10$)
                    corruptedrollback_segments =(_SYSSMU1$,_SYSSMU2$,_SYSSMU3 $,_SYSSMU4$,_SYSSMU5$,_SYSSMU6$,_SYSSMU7$,_SYSSMU8$,_SYSSMU9$,_SYSSMU10$)

                    (2) 1st recovery

                    SQL> recover database until cancel;
                    ORA-00283: recovery session canceled due to errors
                    ORA-01190: controlfile or data file 1 is from before the last RESETLOGS
                    ORA-01110: data file 1: '~~~/system01.dbf

                    SQL> alter database open resetlogs;

                    Sun Aug 7 10:07:44 2005
                    Errors in file ~~~/snp7_5768.trc:
                    ORA-00600: internal error code, arguments: [2662], [2057], [557414704], [2057],]
                    Sun Aug 7 10:07:46 2005
                    Shutting down instance (abort)
                    License high water mark = 11
                    Instance terminated by USER, pid = 5775

                    (3) 2st recovery

                    SQL> alter session set events 'immediate trace name adjust_scn level 1';
                    ERROR:
                    ORA-00600: internal error code, arguments: [2256], [0], [1073741824], [2057],
                    [562550308], [], [], []

                    (3) 3st recovery

                    SQL> startup mount
                    SQL> alter session set events '10015 trace name adjust_scn level 1';
                    Session altered.
                    SQL> recover database until cancel;
                    cancel
                    SQL> alter database open resetlogs;

                    SQL> shutdown

                    SQL> startup

                    Must be caution~~~~~!!!
                    under 10g , if you use the locally managed tablespace,
                    , if you create the table, ORA-600 error .

                    Bug 3204542 OERI[ktssinseg3] / cannot recover locally managed tablespace

                    If you finish this recovery,
                    export the database, and create database and import~!

                    Message was edited by:
                    Min Angel (Yeon Hong Min)

                    If fail, up the adjust_scn level from 1 to 10 and recover~

                    pool at english use -_-;;                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       
                    • 7. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                      531427
                      It's the oracle internal progress..
                      If you request the oracle company, this solution will not recommend..
                      They say, DUL util can only recover.
                      • 8. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                        540215
                        Hi Min Angel,

                        I didn't get any result from V$RECOVER_FILE. Is the db still recoverable?

                        To be clear I am using Oracle9i on Win2000 with Noarchivelog.
                        SQL> SELECT V1.GROUP#, MEMBER, SEQUENCE#, FIRST_CHANGE#
                          2  FROM V$LOG V1, V$LOGFILE V2
                          3  WHERE V1.GROUP# = V2.GROUP# ;

                            GROUP# MEMBER                                    SEQUENCE# FIRST_CHANGE#
                        ---------- ---------------------------------------- ---------- -------------
                                 1 E:\ORACLE\ORADATA\ATHENDB\REDO01.LOG           1340    8.3815E+12
                                 2 E:\ORACLE\ORADATA\ATHENDB\REDO02.LOG           1341    8.3815E+12
                                 3 E:\ORACLE\ORADATA\ATHENDB\REDO03.LOG           1342    8.3815E+12
                        SQL> SELECT FILE#, CHANGE# FROM V$RECOVER_FILE;


                        no rows selected
                        Error message when opening the db in trace file :
                        alter database open
                        Wed Jan 10 10:58:12 2007
                        Beginning crash recovery of 1 threads
                        Wed Jan 10 10:58:12 2007
                        Started first pass scan
                        Wed Jan 10 10:58:12 2007
                        Completed first pass scan
                        1 redo blocks read, 0 data blocks need recovery
                        Wed Jan 10 10:58:13 2007
                        Started recovery at
                        Thread 1: logseq 1341, block 2, scn 1951.2054821953
                        Recovery of Online Redo Log: Thread 1 Group 2 Seq 1341 Reading mem 0
                          Mem# 0 errs 0: E:\ORACLE\ORADATA\TESTDB\REDO02.LOG
                        Wed Jan 10 10:58:13 2007
                        Ended recovery at
                        Thread 1: logseq 1341, block 3, scn 1951.2054841954
                        0 data blocks read, 0 data blocks written, 1 redo blocks read
                        Crash recovery completed successfully
                        Wed Jan 10 10:58:13 2007
                        Thread 1 advanced to log sequence 1342
                        Thread 1 opened at log sequence 1342
                          Current log# 3 seq# 1342 mem# 0: E:\ORACLE\ORADATA\TESTDB\REDO03.LOG
                        Successful open of redo thread 1.
                        Wed Jan 10 10:58:13 2007
                        SMON: enabling cache recovery
                        Wed Jan 10 10:58:14 2007
                        Errors in file e:\oracle\admin\TESTDB\udump\TESTDB_ora_2020.trc:
                        ORA-00704: bootstrap process failure
                        ORA-00604: error occurred at recursive SQL level 2
                        ORA-08103: object no longer exists
                        • 9. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                          531427
                          Hoops..
                          ORA-8103 : object no longer exists
                          In this case recovery, this usually occured in old system tablespace backup restore.
                          but if adjust_scn recover -> export full database-> create database -> import, you can recover..
                          • 10. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                            540215
                            Hi Min Angel,

                            There's one thing I didn't know how to take care of, do you think it's critical ?
                            SQL> recover database until cancel;
                            ORA-00279: change 8381536056455 generated at 01/10/2007 14:31:24 needed for
                            thread 1
                            ORA-00289: suggestion : E:\ORACLE\ORA92\RDBMS\ARC01343.001
                            ORA-00280: change 8381536056455 for thread 1 is in sequence #1343


                            Specify log: {<RET>=suggested | filename | AUTO | CANCEL}
                            There's only sub folders in RDBMS folder.
                            I always type CANCEL to cancel the operation.
                            • 11. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                              531427
                              Is the database is no archive mode?
                              But irrelative~. You can recover database 'until cancel command' if some case.
                              and can use adjust_scn..

                              SQL> archive log list
                              NO archive mode?

                              ----------------------------------------------------------------------------------------

                              Also in no archive mode, there are datafile and controlfile offline backup,
                              but not be redo log file. If that, you can do "until cancel comnand".
                              But the Backup is only offline backup;
                              While database was opended, if you did backup the database,
                              system change number is far. It only can recover the database using "adjust_scn".


                              Below is the test.

                              (1) data confimation

                              sql> select count(*) from hr.emphist;
                              COUNT(*)
                              ----------
                              20

                              ==> offline backup


                              (2) failure creation

                              $sqlplus '/as sysdba'

                              sql> startup

                              sql> @moreemphist => data insert sql
                              COUNT(*)
                              ----------
                              31


                              (3) failure .
                              sql> !rm /data/oradata/min/users01.dbf
                              ...
                              --> DML transaction
                              ...
                              sql> shutdown abort
                              sql> startup
                              ORA-01157: cannot identify/lock data file 3 - see DBWR trace file
                              ORA-01110: data file 3: '/data/oradata/min/users01.dbf'
                              sq> shutdown abort

                              (4) restore( Because of no archive mode, it's the offline backup~!!)

                              $cp /data/oradata/BACKUP/*.dbf /data/oradata/min/
                              $cp /data/oradata/BACKUP/*.ctl /data/oradata/min/

                              $ sqlplus '/as sysdba'
                              sql> startup
                              Database mounted.
                              ORA-00314: log 1 of thread 1, expected sequence# doesn't match
                              ORA-00312: online log 1 thread 1: '/data/oradata/min/log1a.log'
                              ORA-00312: online log 1 thread 1: '/data/oradata/min/log1b.log'
                              sql> select * from v$log;

                              GROUP# THREAD# SEQUENCE# BYTES MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIM
                              ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- ---------
                              1 1 23 10485760 2 NO CURRENT 53595 27-OCT-04
                              2 1 22 10485760 2 NO INACTIVE 52259 27-OCT-04

                              (5) recovery
                              sql> recover database until cancel;
                              Media recovery complete.
                              sql> alter database open resetlogs;

                              sql> select * from v$log; ==> resetlogs sequence number 1 .

                              GROUP# THREAD# SEQUENCE# BYTES MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIM
                              ---------- ---------- ---------- ---------- ---------- --- ---------------- ------------- ---------
                              1 1 1 10485760 2 NO CURRENT 55070 27-OCT-04
                              2 1 0 10485760 2 YES UNUSED 0

                              sql> select * from hr.emphist;
                              COUNT(*)
                              ----------
                              20

                              only can recover until backup time.


                              ----------------------------------------------------------------------------------

                              In Korea.. Black night.. I was sleeping..;;
                              This time is daylight.^^

                              Message was edited by:
                              Min Angel (Yeon Hong Min)

                              I'm pool at english skill ;;
                              Did you understand that solution?
                              • 12. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                                531427
                                I can understand that.
                                The database was opened. but bootstrap was crashed..
                                You can only recover. export-> create database -> import.
                                If bootstrap faillure, can only recover from exp/imp.

                                Message was edited by:
                                Min Angel (Yeon Hong Min, Korean)

                                'Adjust scn' should be used at instance crash & not open & not recover.
                                • 13. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recursive
                                  540215
                                  At last I reinstalled Oracle, replace data/control/p files, and startup db. Everything went well and db is open within 1 minutes.

                                  Thank you Min Angel for all your help and time.
                                  • 14. Re: ORA-00704: bootstrap process failure ORA-00604: error occurred at recur
                                    587241
                                    we write a direct unload data tools like DUL ,and we released it to our BBS,welcome to download i.

                                    www.sosdb.com/dul/MyJDUL.rar