1 Reply Latest reply: Aug 3, 2012 10:05 AM by Jspalmer-Oracle RSS

    timesten auto Recovery

    852456
      an error happened on my timesten, it dosen‘t work ,After about 30 minutes,it Recovered .
      why dose this error happened, i Didn’t do anything. who can help me ???




      20:28:52.04 Err : : 4839: 6757/6000000000743ff0: Assertion failed: (((np)->flags) & ((sbTnFlag_t) 0x8)) || (((np)->flags) & ((sbTnFlag_t) 0x4)) [ttree.c:4.391:tnInsert:8652] PID 6757 (timestenrepd) CONN 208 (RECEIVER) 2012-08-01 20:28:51.998
      20:28:52.14 Err : : 4839: 6757/6000000000743ff0: Data store marked invalid [ttree.c:4.391:tnInsert:8652] PID 6757 (timestenrepd) CONN 208 (RECEIVER) Context 0x6000000000743ff0
      20:28:52.29 Err : : 4839: 4842/6000000000f23ff0: Checkpoint failure (db.c, line 19415). Apparent cause is database invalidation by another connection.
      20:28:52.29 Warn: : 4839: 4842/6000000000ee5010: Forced Disconnect /ttdata/ocs/data1
      20:28:52.30 Err : : 4842: TT14000: TimesTen daemon internal error: subd: flusher thread failed in sb_dbLogFlusherSvc, tt error 994 (TT0994: Data store connection terminated. Please reconnect. -- file "dbAPI.c", lineno 9535, procedure "sb_dbLogFlusherSvc")
      20:28:52.30 Err : : 4842: TT14000: TimesTen daemon internal error: subd: flusher thread failed to disconnect, tt error 0 (TT0846: Data store connection invalid or not current -- file "dbAPI.c", lineno 3135, procedure "sb_dbDisconnect()").
      20:28:52.30 Warn: : 4839: 4842/6000000000f23ff0: Forced Disconnect /ttdata/ocs/data1
      20:28:52.30 Warn: : 4839: 4842 ----------: Disconnecting from an old instance
      20:28:52.30 Err : : 4842: subd: scheduled checkpoint failed, error TT0994: Data store connection terminated. Please reconnect. -- file "dbAPI.c", lineno 3478, procedure "sb_dbCkpt()"
      20:28:52.33 Warn: : 4842: Stopping subdaemon monitor for /ttdata/ocs/data1 because db is invalid.
      20:28:52.38 Warn: : 4839: 4842/6000000001043ff0: Forced Disconnect /ttdata/ocs/data1
      20:28:52.38 Warn: : 4839: 4842 ----------: Disconnecting from an old instance
      20:28:52.38 Err : : 4842: TT14000: TimesTen daemon internal error: subd: monitor thread failed in sb_dbCgExistWithOraObj, tt error 994
      20:28:52.38 Err : : 4842: TT14000: TimesTen daemon internal error: subd: monitor thread failed to disconnect, tt error 846.
      20:28:52.40 Err : : 4842: TT14000: TimesTen daemon internal error: subd: checkpoint thread failed to disconnect, tt error 846.
      20:28:52.52 Warn: : 4839: 28451 60000000001b60e0: Data store in process of loading, try later
      20:28:52.64 Warn: : 4839: 11525/6000000000060650: Forced Disconnect /ttdata/ocs/data1
      20:28:52.64 Warn: : 4839: 11525 ----------: Disconnecting from an old instance
      20:28:52.90 Warn: : 4839: 4842 ------------------: subdaemon process exited
      20:28:52.90 Warn: : 4839: 4842 exited while connected to data store '/ttdata/ocs/data1' shm 371461879 count=3
      20:28:52.90 Warn: : 4839: daRecovery: subdaemon 4842, managing data store, failed: invalidate (failcode=202)
      20:28:53.09 Warn: : 4839: 11175/6000000000311620: Forced Disconnect /ttdata/ocs/data1
      20:28:53.09 Warn: : 4839: 11175 ----------: Disconnecting from an old instance
      20:28:53.35 Warn: : 4839: 6757 exited while connected to data store '/ttdata/ocs/data1' shm 371461879 count=7
      20:28:53.35 Err : : 4839: TT14000: TimesTen daemon internal error: Could not find the sole user of the data store
      20:28:53.35 Err : : 4839: TT14000: TimesTen daemon internal error: Could not find the sole user of the data store
      20:28:53.35 Err : : 4839: TT14000: TimesTen daemon internal error: Could not find the sole user of the data store
      20:28:53.40 Err : : 4839: TT14000: TimesTen daemon internal error: Could not find the sole user of the data store
      20:28:53.40 Err : : 4839: TT14000: TimesTen daemon internal error: Could not find the sole user of the data store
      20:28:53.40 Warn: : 4839: Couldn't find data store's user: invalidate
      20:28:53.41 Warn: : 4839: 7765/60000000007fe350: Forced Disconnect /ttdata/ocs/data1
      20:28:53.41 Warn: : 4839: 7765 ----------: Disconnecting from an old instance
      20:28:53.42 Warn: : 4839: 7765/6000000000778f60: Forced Disconnect /ttdata/ocs/data1
      20:28:53.42 Warn: : 4839: 7765 ----------: Disconnecting from an old instance
      20:28:53.42 Warn: : 4839: 7765/60000000005f59c0: Forced Disconnect /ttdata/ocs/data1
      20:28:53.42 Warn: : 4839: 7765 ----------: Disconnecting from an old instance
      20:28:53.51 Warn: : 4839: 12205/6000000000060650: Forced Disconnect /ttdata/ocs/data1

      20:28:58.34 Warn: : 4839: 11709 ----------: Disconnecting from an old instance
      20:28:58.48 Warn: : 4839: 11668/6000000000060650: Forced Disconnect /ttdata/ocs/data1
      20:28:58.48 Warn: : 4839: 11668 ----------: Disconnecting from an old instance
      20:28:58.95 Warn: : 4839: 7765/600000000064cd90: Forced Disconnect /ttdata/ocs/data1
      20:28:58.95 Warn: : 4839: 7765 ----------: Disconnecting from an old instance
      20:28:58.95 Warn: : 4839: 7765/6000000000182900: Forced Disconnect /ttdata/ocs/data1
      20:28:58.95 Warn: : 4839: 7765 ----------: Disconnecting from an old instance
      20:28:58.95 Warn: ORA: 7765: ora-7765-0001-xxagent04639: Warning: Statement SQLDisconnect(agentHdbc)
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01017: Error: [TimesTen]TT0994: Data store connection terminated. Please reconnect. -- file "dbAPI.c", lineno 3132, procedure "sb_dbDisconnect()", ODBC SQL state = S1000, Additional Warning = 994
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01042: Detected invalid data store.
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01017: Error: [TimesTen]TT0994: Data store connection terminated. Please reconnect. -- file "db.c", lineno 14954, procedure "sbDbAppExit()", ODBC SQL state = S1000, Additional Warning = 994
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01042: Detected invalid data store.
      20:28:58.95 Warn: : 4839: 7765/60000000003083a0: Forced Disconnect /ttdata/ocs/data1
      20:28:58.95 Warn: : 4839: 7765 ----------: Disconnecting from an old instance
      20:28:58.95 Warn: ORA: 7765: ora-7765-0001-xxagent04645: Warning: Statement SQLDisconnect(timerHdbc)
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01017: Error: [TimesTen]TT0994: Data store connection terminated. Please reconnect. -- file "dbAPI.c", lineno 3132, procedure "sb_dbDisconnect()", ODBC SQL state = S1000, Additional Warning = 994
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01042: Detected invalid data store.
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01017: Error: [TimesTen]TT0994: Data store connection terminated. Please reconnect. -- file "db.c", lineno 14954, procedure "sbDbAppExit()", ODBC SQL state = S1000, Additional Warning = 994
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01042: Detected invalid data store.
      20:28:58.95 Warn: : 4839: 7765/60000000004083a0: Forced Disconnect /ttdata/ocs/data1
      20:28:58.95 Warn: : 4839: 7765 ----------: Disconnecting from an old instance
      20:28:58.95 Warn: ORA: 7765: ora-7765-0001-xxagent04652: Warning: Statement SQLDisconnect(agingHdbc)
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01017: Error: [TimesTen]TT0994: Data store connection terminated. Please reconnect. -- file "dbAPI.c", lineno 3132, procedure "sb_dbDisconnect()", ODBC SQL state = S1000, Additional Warning = 994
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01042: Detected invalid data store.
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01017: Error: [TimesTen]TT0994: Data store connection terminated. Please reconnect. -- file "db.c", lineno 14954, procedure "sbDbAppExit()", ODBC SQL state = S1000, Additional Warning = 994
      20:28:58.95 Err : ORA: 7765: ora-7765-0001-bcStuff01042: Detected invalid data store.
      20:28:59.00 Warn: : 4839: 11174/6000000000060650: Forced Disconnect /ttdata/ocs/data1
      20:28:59.00 Warn: : 4839: 11174 ----------: Disconnecting from an old instance
      20:28:59.38 Warn: : 4839: 11685/6000000000311620: Forced Disconnect /ttdata/ocs/data1
      20:28:59.38 Warn: : 4839: 11685 ----------: Disconnecting from an old instance
      20:28:59.84 Warn: : 4839: 11661/6000000000311620: Forced Disconnect /ttdata/ocs/data1
      20:28:59.84 Warn: : 4839: 11661 ----------: Disconnecting from an old instance
      20:28:59.89 Warn: : 4839: 9707/6000000000311620: Forced Disconnect /ttdata/ocs/data1
      20:28:59.89 Warn: : 4839: 9707 ----------: Disconnecting from an old instance
      20:29:00.15 Warn: : 4839: 11167/6000000000311620: Forced Disconnect /ttdata/ocs/data1
      20:29:00.15 Warn: : 4839: 11167 ----------: Disconnecting from an old instance
      20:29:00.15 Warn: : 4839: 11724/6000000000060650: Forced Disconnect /ttdata/ocs/data1
      20:29:00.15 Warn: : 4839: 11724 ----------: Disconnecting from an old instance
      20:29:00.92 Warn: : 4839: 11700/6000000000060650: Forced Disconnect /ttdata/ocs/data1
      20:29:00.92 Warn: : 4839: 11700 ----------: Disconnecting from an old instance
      20:29:00.92 Warn: : 4839: 12217/6000000000311620: Forced Disconnect /ttdata/ocs/data1
      20:29:00.92 Warn: : 4839: 12217 ----------: Disconnecting from an old instance
      20:29:01.03 Warn: : 4839: 11717/6000000000311620: Forced Disconnect /ttdata/ocs/data1
      20:29:01.03 Warn: : 4839: 11717 ----------: Disconnecting from an old instance
      20:29:01.37 Warn: : 4839: 11676/6000000000060650: Forced Disconnect /ttdata/ocs/data1
      20:29:01.37 Warn: : 4839: 11676 ----------: Disconnecting from an old instance
      20:29:01.49 Warn: : 4839: 11175 exited while connected to data store '/ttdata/ocs/data1' shm 371461879 count=11
      20:29:01.95 Warn: : 4839: 11693/6000000000311620: Forced Disconnect /ttdata/ocs/data1
      20:29:01.95 Warn: : 4839: 11693 ----------: Disconnecting from an old instance
      20:29:02.30 Warn: : 4839: 11669/6000000000311620: Forced Disconnect /ttdata/ocs/data1
      20:29:02.30 Warn: : 4839: 11669 ----------: Disconnecting from an old instance
      20:29:03.39 Warn: : 4839: 11725 exited while connected to data store '/ttdata/ocs/data1' shm 371461879 count=11
      20:29:03.97 Warn: : 4839: 11677 exited while connected to data store '/ttdata/ocs/data1' shm 371461879 count=11
      20:29:28.27 Warn: : 4839: 11527 exited while connected to data store '/ttdata/ocs/data1' shm 371461879 count=11
      20:29:31.86 Warn: : 4839: 11661 exited while connected to data store '/ttdata/ocs/data1' shm 371461879 count=11
      20:29:32.22 Warn: : 4839: 9707 exited while connected to data store '/ttdata/ocs/data1' shm 371461879 count=11
      20:36:53.19 Warn: : 4839: 4843/60000000000c0020: Recovery started
      21:08:35.34 Warn: : 4843: subd: Warning identified in [sub.c: line 3188]
      21:08:35.34 Warn: : 4843: subd: (Warning 20100): TT20100: This connection required recovery due to an improper shutdown -- file "db.c", lineno 11566, procedure "sbDbConnect"
      21:08:35.34 Warn: : 4843: file "db.c", lineno 11566, procedure "sbDbConnect"
      21:08:35.35 Warn: : 4843: subd: connect trouble, rc 2, reason 20100
      21:08:35.35 Warn: : 4843: Warn 20100: TT20100: This connection required recovery due to an improper shutdown -- file "db.c", lineno 11566, procedure "sbDbConnect"
      21:08:39.54 Err : ORA: 28458: ora-28458-0009-raStuff09836: Unexpected row count. Expecting 1. Got 0.
      21:55:13.91 Warn: ORA: 28458: ora-28458-0014-refresh10886: Autorefresh was not able to acquire lock on one of the cache groups, may be because a DDL transaction is open on the cache group. Autorefresh will be retried again
      21:55:43.90 Warn: ORA: 28458: ora-28458-0014-refresh10886: Autorefresh was not able to acquire lock on one of the cache groups, may be because a DDL transaction is open on the cache group. Autorefresh will be retried again
      21:56:16.35 Warn: ORA: 28458: ora-28458-0015-refresh10886: Autorefresh was not able to acquire lock on one of the cache groups, may be because a DDL transaction is open on the cache group. Autorefresh will be retried again
      21:56:19.54 Warn: ORA: 28458: ora-28458-0015-refresh10886: Autorefresh was not able to acquire lock on one of the cache groups, may be because a DDL transaction is open on the cache group. Autorefresh will be retried again
      21:56:22.76 Warn: ORA: 28458: ora-28458-0015-refresh10886: Autorefresh was not able to acquire lock on one of the cache groups, may be because a DDL transaction is open on the cache group. Autorefresh will be retried again
      21:57:13.87 Warn: ORA: 28458: ora-28458-0014-refresh10886: Autorefresh was not able to acquire lock on one of the cache groups, may be because a DDL transaction is open on the cache group. Autorefresh will be retried again
        • 1. Re: timesten auto Recovery
          Jspalmer-Oracle
          Because the receiver thread in the replication agent hit an Assertion Failure and the datastore was invalidated ie taken out of memory and then - presumably - recovered and automatically reloaded. While this was going on existing connections would have been disconnected and new ones prevented from being made.

          You need to log an SR so we can try to establish what caused the Assertion Failure, whether it's a known bug that's fixed in a later release, or a new one.