Tuxedo Client 12 crash — oracle-tech

    Forum Stats

  • 3,714,736 Users
  • 2,242,615 Discussions
  • 7,845,036 Comments

Discussions

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Tuxedo Client 12 crash

anand_206
anand_206 Member Posts: 3
edited September 2018 in Tuxedo

Dear All,


We have observed that our Production JVM crashed twice in last week.

We came to conclusion that the reason could be some of the libraries in Tuxedo 12.1.1.0 Client because the crash dump mentioned that the problematic frame was in libwsc.so.71.

Below is the crash dump file.

## A fatal error has been detected by the Java Runtime Environment:##  SIGSEGV (0xb) at pc=0xfffffffce8e5a900, pid=13412, tid=0x0000000000004166## JRE version: Java(TM) SE Runtime Environment (8.0_151-b12) (build 1.8.0_151-b12)# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.151-b12 mixed mode solaris-sparc compressed oops)# Problematic frame:# C  [libwsc.so.71+0x5a900]  _tmfmsg_free+0x138## Core dump written. Default location: /appl/wmEAI/wmSuite/Server6030/IntegrationServer/instances/default/core or core.13412## If you would like to submit a bug report, please visit:#   http://bugreport.java.com/bugreport/crash.jsp# The crash happened outside the Java Virtual Machine in native code.# See problematic frame for where to report the bug.#---------------  T H R E A D  ---------------Current thread (0x000000010b00e800):  JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_in_native, id=16742, stack(0xfffffffb9bc00000,0xfffffffb9c100000)]siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 0x000000000000025cRegisters: G1=0xffffffff7ead1070 G2=0x0000000000001700 G3=0x0000000000000003 G4=0x0000000000000000 G5=0x000000008152ec00 G6=0xfffffffd603fe000 G7=0xfffffffce9699a00 Y=0x0000000000000000 O0=0x0000000000000000 O1=0x0000000000000000 O2=0x0000000000000000 O3=0x0000000000000000 O4=0x0000000000000000 O5=0x0000000000000001 O6=0xfffffffb9c0fabe1 O7=0xfffffffce8e5a7cc L0=0x0000000000000000 L1=0x0000000000000000 L2=0xfffffffce8f8b858 L3=0x0000000000000000 L4=0x0000000000004166 L5=0x0000000000000254 L6=0x0000000000000000 L7=0xfffffffb9c0fb4b0 I0=0x00000001100dcef0 I1=0x0000000000000230 I2=0x0000000107cab530 I3=0x000000010af1c130 I4=0x0000000000000000 I5=0x0000000000000000 I6=0xfffffffb9c0facc1 I7=0xfffffffce8e193ac PC=0xfffffffce8e5a900 nPC=0xfffffffce8e5a904Top of Stack: (sp=0xfffffffb9c0fb3e0)0xfffffffb9c0fb3e0:   0000000000000000 00000000000000000xfffffffb9c0fb3f0:   fffffffce8f8b858 00000000000000000xfffffffb9c0fb400:   0000000000004166 00000000000002540xfffffffb9c0fb410:   0000000000000000 fffffffb9c0fb4b00xfffffffb9c0fb420:   00000001100dcef0 00000000000002300xfffffffb9c0fb430:   0000000107cab530 000000010af1c1300xfffffffb9c0fb440:   0000000000000000 00000000000000000xfffffffb9c0fb450:   fffffffb9c0facc1 fffffffce8e193ac0xfffffffb9c0fb460:   fffffffbea75a9a8 00000000000000000xfffffffb9c0fb470:   00000001100dcef0 fffffffbea5b97700xfffffffb9c0fb480:   fffffffce8724a58 0000000000003ff00xfffffffb9c0fb490:   0000000000000000 fffffffce87232900xfffffffb9c0fb4a0:   fffffffb9c0face1 fffffffce86200020xfffffffb9c0fb4b0:   0000000000000230 000000010c1139700xfffffffb9c0fb4c0:   0000000091039800 000000010c113ab00xfffffffb9c0fb4d0:   000000010c113ad4 0000000000000024 Instructions: (pc=0xfffffffce8e5a900)0xfffffffce8e5a8e0:   ba 0c e0 04 ac 10 20 00 80 a7 60 00 a0 0c e0 010xfffffffce8e5a8f0:   a2 0c e0 02 ae 07 a7 ef 12 40 00 8d aa 06 60 240xfffffffce8e5a900:   da 06 60 2c de 06 60 24 98 0b 60 70 e8 5e 60 000xfffffffce8e5a910:   80 a3 20 10 12 40 00 48 b9 33 e0 10 d6 06 60 18 Register to memory mapping:G1=0xffffffff7ead1070: mutex_unlock+0 in /lib/sparcv9/libc.so.1 at 0xffffffff7ea00000G2=0x0000000000001700 is an unknown valueG3=0x0000000000000003 is an unknown valueG4=0x0000000000000000 is an unknown valueG5=0x000000008152ec00 is an unknown valueG6=0xfffffffd603fe000 is an unknown valueG7=0xfffffffce9699a00 is an unknown valueO0=0x0000000000000000 is an unknown valueO1=0x0000000000000000 is an unknown valueO2=0x0000000000000000 is an unknown valueO3=0x0000000000000000 is an unknown valueO4=0x0000000000000000 is an unknown valueO5=0x0000000000000001 is an unknown valueO6=0xfffffffb9c0fabe1 is pointing into the stack for thread: 0x000000010b00e800O7=0xfffffffce8e5a7cc: _tmfmsg_free+0x4 in /appl/wmEAI/wmExternal/TuxedoClient/tuxedo12.1.1.0/lib/libwsc.so.71 at 0xfffffffce8e00000L0=0x0000000000000000 is an unknown valueL1=0x0000000000000000 is an unknown valueL2=0xfffffffce8f8b858: _GLOBAL_OFFSET_TABLE_+0 in /appl/wmEAI/wmExternal/TuxedoClient/tuxedo12.1.1.0/lib/libwsc.so.71 at 0xfffffffce8e00000L3=0x0000000000000000 is an unknown valueL4=0x0000000000004166 is an unknown valueL5=0x0000000000000254 is an unknown valueL6=0x0000000000000000 is an unknown valueL7=0xfffffffb9c0fb4b0 is pointing into the stack for thread: 0x000000010b00e800I0=0x00000001100dcef0 is an unknown valueI1=0x0000000000000230 is an unknown valueI2=0x0000000107cab530 is an unknown valueI3=0x000000010af1c130 is an unknown valueI4=0x0000000000000000 is an unknown valueI5=0x0000000000000000 is an unknown valueI6=0xfffffffb9c0facc1 is pointing into the stack for thread: 0x000000010b00e800I7=0xfffffffce8e193ac: _tpfree_internal+0xc4 in /appl/wmEAI/wmExternal/TuxedoClient/tuxedo12.1.1.0/lib/libwsc.so.71 at 0xfffffffce8e00000Stack: [0xfffffffb9bc00000,0xfffffffb9c100000],  sp=0xfffffffb9c0fb3e0,  free space=5100kNative frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)C  [libwsc.so.71+0x5a900]  _tmfmsg_free+0x138C  [libwsc.so.71+0x193b4]  _tpfree_internal+0xccC  [libwsc.so.71+0x191d0]  tpfree+0x258C  [libwsc.so.71+0x2e370]  _wsc_drop+0x218C  [libwsc.so.71+0x25b5c]  _tpterm+0x99cC  [libtti_tuxedo_wsc.so+0x3954]  Java_terrapin_tuxedo_ATMI_tpterm+0xcj  terrapin.tuxedo.ATMI.tpterm()V+254725736j  terrapin.tuxedo.ATMI.tpterm()V+0j  com.csgsystems.aruba.connection.PoolableATMI.delete()V+35j  com.csgsystems.aruba.connection.Pool.clear()V+63j  com.csgsystems.aruba.connection.Connection.reset()V+22J 34501 C2 maxis.eai.system.kenan.atomic.core.call(Lcom/wm/data/IData;)V (227 bytes) @ 0xffffffff706598f8 [0xffffffff70656fe0+0x2918]J 31767 C2 sun.reflect.GeneratedMethodAccessor176.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (50 bytes) @ 0xffffffff6b5bb328 [0xffffffff6b5bb260+0xc8]J 36810 C2 com.wm.app.b2b.server.JavaService.baseInvoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (509 bytes) @ 0xffffffff6d0fc23c [0xffffffff6d0fba20+0x81c]J 31195 C2 com.wm.app.b2b.server.invoke.InvokeManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (273 bytes) @ 0xffffffff6db40e1c [0xffffffff6db40940+0x4dc]J 26966 C2 com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (313 bytes) @ 0xffffffff710fbd14 [0xffffffff710fbb80+0x194]J 29610 C2 com.wm.app.b2b.server.invoke.StatisticsProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (209 bytes) @ 0xffffffff716eee60 [0xffffffff716ee940+0x520]J 26984 C2 com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (188 bytes) @ 0xffffffff7103dd58 [0xffffffff7103dc40+0x118]J 40185 C2 com.wm.app.b2b.server.ACLManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (560 bytes) @ 0xffffffff7338f780 [0xffffffff7338f1e0+0x5a0]J 27809 C2 com.wm.app.b2b.server.invoke.DispatchProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (288 bytes) @ 0xffffffff707a3c88 [0xffffffff707a3b20+0x168]J 30756 C2 com.wm.app.b2b.server.AuditLogManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (160 bytes) @ 0xffffffff71d71bfc [0xffffffff71d719c0+0x23c]J 34511 C2 com.wm.app.b2b.server.invoke.InvokeManager.invoke(Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;ZLcom/wm/app/b2b/server/AuditRuntimeInfo;)Lcom/wm/data/IData; (803 bytes) @ 0xffffffff7214628c [0xffffffff72145aa0+0x7ec]J 27089 C2 com.wm.app.b2b.server.BaseService.invoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (7 bytes) @ 0xffffffff6ac28b60 [0xffffffff6ac28900+0x260]J 36384 C2 com.wm.lang.flow.FlowInvoke.invoke(Lcom/wm/lang/flow/FlowState;)V (963 bytes) @ 0xffffffff713d61d0 [0xffffffff713d52e0+0xef0]J 27759 C2 com.wm.lang.flow.FlowState.invokeNode(Lcom/wm/lang/flow/FlowElement;)V (413 bytes) @ 0xffffffff6f04e460 [0xffffffff6f04df00+0x560]J 28922 C2 com.wm.lang.flow.FlowState.step(Lcom/wm/lang/flow/FlowElement;)V (58 bytes) @ 0xffffffff713077c0 [0xffffffff71307660+0x160]J 26691 C2 com.wm.lang.flow.FlowState.invoke()Lcom/wm/lang/flow/FlowElement; (175 bytes) @ 0xffffffff70e67398 [0xffffffff70e670e0+0x2b8]J 28126 C2 com.wm.app.b2b.server.FlowSvcImpl.baseInvoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (279 bytes) @ 0xffffffff71365fa0 [0xffffffff71364a40+0x1560]J 31195 C2 com.wm.app.b2b.server.invoke.InvokeManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (273 bytes) @ 0xffffffff6db40e1c [0xffffffff6db40940+0x4dc]J 26966 C2 com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (313 bytes) @ 0xffffffff710fbd14 [0xffffffff710fbb80+0x194]J 29610 C2 com.wm.app.b2b.server.invoke.StatisticsProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (209 bytes) @ 0xffffffff716eee60 [0xffffffff716ee940+0x520]J 26984 C2 com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (188 bytes) @ 0xffffffff7103dd58 [0xffffffff7103dc40+0x118]J 40185 C2 com.wm.app.b2b.server.ACLManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (560 bytes) @ 0xffffffff7338f780 [0xffffffff7338f1e0+0x5a0]J 27809 C2 com.wm.app.b2b.server.invoke.DispatchProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (288 bytes) @ 0xffffffff707a3c88 [0xffffffff707a3b20+0x168]J 30756 C2 com.wm.app.b2b.server.AuditLogManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (160 bytes) @ 0xffffffff71d71bfc [0xffffffff71d719c0+0x23c]J 34511 C2 com.wm.app.b2b.server.invoke.InvokeManager.invoke(Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;ZLcom/wm/app/b2b/server/AuditRuntimeInfo;)Lcom/wm/data/IData; (803 bytes) @ 0xffffffff7214628c [0xffffffff72145aa0+0x7ec]J 27089 C2 com.wm.app.b2b.server.BaseService.invoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (7 bytes) @ 0xffffffff6ac28b60 [0xffffffff6ac28900+0x260]J 36384 C2 com.wm.lang.flow.FlowInvoke.invoke(Lcom/wm/lang/flow/FlowState;)V (963 bytes) @ 0xffffffff713d61d0 [0xffffffff713d52e0+0xef0]J 27759 C2 com.wm.lang.flow.FlowState.invokeNode(Lcom/wm/lang/flow/FlowElement;)V (413 bytes) @ 0xffffffff6f04e460 [0xffffffff6f04df00+0x560]J 28922 C2 com.wm.lang.flow.FlowState.step(Lcom/wm/lang/flow/FlowElement;)V (58 bytes) @ 0xffffffff713077c0 [0xffffffff71307660+0x160]J 26691 C2 com.wm.lang.flow.FlowState.invoke()Lcom/wm/lang/flow/FlowElement; (175 bytes) @ 0xffffffff70e67398 [0xffffffff70e670e0+0x2b8]J 28126 C2 com.wm.app.b2b.server.FlowSvcImpl.baseInvoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (279 bytes) @ 0xffffffff71365fa0 [0xffffffff71364a40+0x1560]J 31195 C2 com.wm.app.b2b.server.invoke.InvokeManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (273 bytes) @ 0xffffffff6db40e1c [0xffffffff6db40940+0x4dc]J 26966 C2 com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (313 bytes) @ 0xffffffff710fbd14 [0xffffffff710fbb80+0x194]J 29610 C2 com.wm.app.b2b.server.invoke.StatisticsProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (209 bytes) @ 0xffffffff716eee60 [0xffffffff716ee940+0x520]J 26984 C2 com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (188 bytes) @ 0xffffffff7103dd58 [0xffffffff7103dc40+0x118]J 40185 C2 com.wm.app.b2b.server.ACLManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (560 bytes) @ 0xffffffff7338f780 [0xffffffff7338f1e0+0x5a0]J 27809 C2 com.wm.app.b2b.server.invoke.DispatchProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (288 bytes) @ 0xffffffff707a3c88 [0xffffffff707a3b20+0x168]J 30756 C2 com.wm.app.b2b.server.AuditLogManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (160 bytes) @ 0xffffffff71d71bfc [0xffffffff71d719c0+0x23c]J 34511 C2 com.wm.app.b2b.server.invoke.InvokeManager.invoke(Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;ZLcom/wm/app/b2b/server/AuditRuntimeInfo;)Lcom/wm/data/IData; (803 bytes) @ 0xffffffff7214628c [0xffffffff72145aa0+0x7ec]J 27089 C2 com.wm.app.b2b.server.BaseService.invoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (7 bytes) @ 0xffffffff6ac28b60 [0xffffffff6ac28900+0x260]J 36384 C2 com.wm.lang.flow.FlowInvoke.invoke(Lcom/wm/lang/flow/FlowState;)V (963 bytes) @ 0xffffffff713d61d0 [0xffffffff713d52e0+0xef0]J 27759 C2 com.wm.lang.flow.FlowState.invokeNode(Lcom/wm/lang/flow/FlowElement;)V (413 bytes) @ 0xffffffff6f04e460 [0xffffffff6f04df00+0x560]J 28922 C2 com.wm.lang.flow.FlowState.step(Lcom/wm/lang/flow/FlowElement;)V (58 bytes) @ 0xffffffff713077c0 [0xffffffff71307660+0x160]J 26691 C2 com.wm.lang.flow.FlowState.invoke()Lcom/wm/lang/flow/FlowElement; (175 bytes) @ 0xffffffff70e67398 [0xffffffff70e670e0+0x2b8]J 28126 C2 com.wm.app.b2b.server.FlowSvcImpl.baseInvoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (279 bytes) @ 0xffffffff71365fa0 [0xffffffff71364a40+0x1560]J 31195 C2 com.wm.app.b2b.server.invoke.InvokeManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (273 bytes) @ 0xffffffff6db40e1c [0xffffffff6db40940+0x4dc]J 26966 C2 com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (313 bytes) @ 0xffffffff710fbd14 [0xffffffff710fbb80+0x194]J 29610 C2 com.wm.app.b2b.server.invoke.StatisticsProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (209 bytes) @ 0xffffffff716eee60 [0xffffffff716ee940+0x520]J 26984 C2 com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (188 bytes) @ 0xffffffff7103dd58 [0xffffffff7103dc40+0x118]J 40185 C2 com.wm.app.b2b.server.ACLManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (560 bytes) @ 0xffffffff7338f780 [0xffffffff7338f1e0+0x5a0]J 27809 C2 com.wm.app.b2b.server.invoke.DispatchProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (288 bytes) @ 0xffffffff707a3c88 [0xffffffff707a3b20+0x168]J 30756 C2 com.wm.app.b2b.server.AuditLogManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (160 bytes) @ 0xffffffff71d71bfc [0xffffffff71d719c0+0x23c]J 34511 C2 com.wm.app.b2b.server.invoke.InvokeManager.invoke(Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;ZLcom/wm/app/b2b/server/AuditRuntimeInfo;)Lcom/wm/data/IData; (803 bytes) @ 0xffffffff72146e4c [0xffffffff72145aa0+0x13ac]J 34101 C2 com.wm.app.b2b.server.dispatcher.trigger.Trigger.processMessage(Lcom/wm/msg/IMessage;)Z (369 bytes) @ 0xffffffff7146d414 [0xffffffff7146c640+0xdd4]J 34130 C2 com.wm.app.b2b.server.dispatcher.AbstractExecutionTask.processMessage()V (590 bytes) @ 0xffffffff6f3b2a2c [0xffffffff6f3b2840+0x1ec]J 34128 C2 com.wm.app.b2b.server.dispatcher.AbstractExecutionTask.run()V (278 bytes) @ 0xffffffff72166e3c [0xffffffff721668a0+0x59c]J 42462 C2 com.wm.util.pool.PooledThread.run()V (691 bytes) @ 0xffffffff6ed1e854 [0xffffffff6ed1e420+0x434]J 40583 C2 java.lang.Thread.run()V (17 bytes) @ 0xffffffff71d3728c [0xffffffff71d37200+0x8c]v  ~StubRoutines::call_stubV  [libjvm.so+0x743a94]  void JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*)+0x744V  [libjvm.so+0x742244]  void JavaCalls::call_virtual(JavaValue*,KlassHandle,Symbol*,Symbol*,JavaCallArguments*,Thread*)+0x334V  [libjvm.so+0x742508]  void JavaCalls::call_virtual(JavaValue*,Handle,KlassHandle,Symbol*,Symbol*,Thread*)+0x50V  [libjvm.so+0x871ebc]  void thread_entry(JavaThread*,Thread*)+0xdcV  [libjvm.so+0xd3f39c]  void JavaThread::thread_main_inner()+0xf4V  [libjvm.so+0xd3f288]  void JavaThread::run()+0x320V  [libjvm.so+0xb7e148]  java_start+0x390C  [libc.so.1+0xd8560]  _lwp_start+0x8Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)j  terrapin.tuxedo.ATMI.tpterm()V+0j  com.csgsystems.aruba.connection.PoolableATMI.delete()V+35j  com.csgsystems.aruba.connection.Pool.clear()V+63j  com.csgsystems.aruba.connection.Connection.reset()V+22J 34501 C2 maxis.eai.system.kenan.atomic.core.call(Lcom/wm/data/IData;)V (227 bytes) @ 0xffffffff706598f8 [0xffffffff70656fe0+0x2918]J 31767 C2 sun.reflect.GeneratedMethodAccessor176.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (50 bytes) @ 0xffffffff6b5bb328 [0xffffffff6b5bb260+0xc8]J 36810 C2 com.wm.app.b2b.server.JavaService.baseInvoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (509 bytes) @ 0xffffffff6d0fc23c [0xffffffff6d0fba20+0x81c]J 31195 C2 com.wm.app.b2b.server.invoke.InvokeManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (273 bytes) @ 0xffffffff6db40e1c [0xffffffff6db40940+0x4dc]J 26966 C2 com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (313 bytes) @ 0xffffffff710fbd14 [0xffffffff710fbb80+0x194]J 29610 C2 com.wm.app.b2b.server.invoke.StatisticsProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (209 bytes) @ 0xffffffff716eee60 [0xffffffff716ee940+0x520]J 26984 C2 com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (188 bytes) @ 0xffffffff7103dd58 [0xffffffff7103dc40+0x118]J 40185 C2 com.wm.app.b2b.server.ACLManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (560 bytes) @ 0xffffffff7338f780 [0xffffffff7338f1e0+0x5a0]J 27809 C2 com.wm.app.b2b.server.invoke.DispatchProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (288 bytes) @ 0xffffffff707a3c88 [0xffffffff707a3b20+0x168]J 30756 C2 com.wm.app.b2b.server.AuditLogManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (160 bytes) @ 0xffffffff71d71bfc [0xffffffff71d719c0+0x23c]J 34511 C2 com.wm.app.b2b.server.invoke.InvokeManager.invoke(Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;ZLcom/wm/app/b2b/server/AuditRuntimeInfo;)Lcom/wm/data/IData; (803 bytes) @ 0xffffffff7214628c [0xffffffff72145aa0+0x7ec]J 27089 C2 com.wm.app.b2b.server.BaseService.invoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (7 bytes) @ 0xffffffff6ac28b60 [0xffffffff6ac28900+0x260]J 36384 C2 com.wm.lang.flow.FlowInvoke.invoke(Lcom/wm/lang/flow/FlowState;)V (963 bytes) @ 0xffffffff713d61d0 [0xffffffff713d52e0+0xef0]J 27759 C2 com.wm.lang.flow.FlowState.invokeNode(Lcom/wm/lang/flow/FlowElement;)V (413 bytes) @ 0xffffffff6f04e460 [0xffffffff6f04df00+0x560]J 28922 C2 com.wm.lang.flow.FlowState.step(Lcom/wm/lang/flow/FlowElement;)V (58 bytes) @ 0xffffffff713077c0 [0xffffffff71307660+0x160]J 26691 C2 com.wm.lang.flow.FlowState.invoke()Lcom/wm/lang/flow/FlowElement; (175 bytes) @ 0xffffffff70e67398 [0xffffffff70e670e0+0x2b8]J 28126 C2 com.wm.app.b2b.server.FlowSvcImpl.baseInvoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (279 bytes) @ 0xffffffff71365fa0 [0xffffffff71364a40+0x1560]J 31195 C2 com.wm.app.b2b.server.invoke.InvokeManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (273 bytes) @ 0xffffffff6db40e1c [0xffffffff6db40940+0x4dc]J 26966 C2 com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (313 bytes) @ 0xffffffff710fbd14 [0xffffffff710fbb80+0x194]J 29610 C2 com.wm.app.b2b.server.invoke.StatisticsProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (209 bytes) @ 0xffffffff716eee60 [0xffffffff716ee940+0x520]J 26984 C2 com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (188 bytes) @ 0xffffffff7103dd58 [0xffffffff7103dc40+0x118]J 40185 C2 com.wm.app.b2b.server.ACLManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (560 bytes) @ 0xffffffff7338f780 [0xffffffff7338f1e0+0x5a0]J 27809 C2 com.wm.app.b2b.server.invoke.DispatchProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (288 bytes) @ 0xffffffff707a3c88 [0xffffffff707a3b20+0x168]J 30756 C2 com.wm.app.b2b.server.AuditLogManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (160 bytes) @ 0xffffffff71d71bfc [0xffffffff71d719c0+0x23c]J 34511 C2 com.wm.app.b2b.server.invoke.InvokeManager.invoke(Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;ZLcom/wm/app/b2b/server/AuditRuntimeInfo;)Lcom/wm/data/IData; (803 bytes) @ 0xffffffff7214628c [0xffffffff72145aa0+0x7ec]J 27089 C2 com.wm.app.b2b.server.BaseService.invoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (7 bytes) @ 0xffffffff6ac28b60 [0xffffffff6ac28900+0x260]J 36384 C2 com.wm.lang.flow.FlowInvoke.invoke(Lcom/wm/lang/flow/FlowState;)V (963 bytes) @ 0xffffffff713d61d0 [0xffffffff713d52e0+0xef0]J 27759 C2 com.wm.lang.flow.FlowState.invokeNode(Lcom/wm/lang/flow/FlowElement;)V (413 bytes) @ 0xffffffff6f04e460 [0xffffffff6f04df00+0x560]J 28922 C2 com.wm.lang.flow.FlowState.step(Lcom/wm/lang/flow/FlowElement;)V (58 bytes) @ 0xffffffff713077c0 [0xffffffff71307660+0x160]J 26691 C2 com.wm.lang.flow.FlowState.invoke()Lcom/wm/lang/flow/FlowElement; (175 bytes) @ 0xffffffff70e67398 [0xffffffff70e670e0+0x2b8]J 28126 C2 com.wm.app.b2b.server.FlowSvcImpl.baseInvoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (279 bytes) @ 0xffffffff71365fa0 [0xffffffff71364a40+0x1560]J 31195 C2 com.wm.app.b2b.server.invoke.InvokeManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (273 bytes) @ 0xffffffff6db40e1c [0xffffffff6db40940+0x4dc]J 26966 C2 com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (313 bytes) @ 0xffffffff710fbd14 [0xffffffff710fbb80+0x194]J 29610 C2 com.wm.app.b2b.server.invoke.StatisticsProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (209 bytes) @ 0xffffffff716eee60 [0xffffffff716ee940+0x520]J 26984 C2 com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (188 bytes) @ 0xffffffff7103dd58 [0xffffffff7103dc40+0x118]J 40185 C2 com.wm.app.b2b.server.ACLManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (560 bytes) @ 0xffffffff7338f780 [0xffffffff7338f1e0+0x5a0]J 27809 C2 com.wm.app.b2b.server.invoke.DispatchProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (288 bytes) @ 0xffffffff707a3c88 [0xffffffff707a3b20+0x168]J 30756 C2 com.wm.app.b2b.server.AuditLogManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (160 bytes) @ 0xffffffff71d71bfc [0xffffffff71d719c0+0x23c]J 34511 C2 com.wm.app.b2b.server.invoke.InvokeManager.invoke(Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;ZLcom/wm/app/b2b/server/AuditRuntimeInfo;)Lcom/wm/data/IData; (803 bytes) @ 0xffffffff7214628c [0xffffffff72145aa0+0x7ec]J 27089 C2 com.wm.app.b2b.server.BaseService.invoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (7 bytes) @ 0xffffffff6ac28b60 [0xffffffff6ac28900+0x260]J 36384 C2 com.wm.lang.flow.FlowInvoke.invoke(Lcom/wm/lang/flow/FlowState;)V (963 bytes) @ 0xffffffff713d61d0 [0xffffffff713d52e0+0xef0]J 27759 C2 com.wm.lang.flow.FlowState.invokeNode(Lcom/wm/lang/flow/FlowElement;)V (413 bytes) @ 0xffffffff6f04e460 [0xffffffff6f04df00+0x560]J 28922 C2 com.wm.lang.flow.FlowState.step(Lcom/wm/lang/flow/FlowElement;)V (58 bytes) @ 0xffffffff713077c0 [0xffffffff71307660+0x160]J 26691 C2 com.wm.lang.flow.FlowState.invoke()Lcom/wm/lang/flow/FlowElement; (175 bytes) @ 0xffffffff70e67398 [0xffffffff70e670e0+0x2b8]J 28126 C2 com.wm.app.b2b.server.FlowSvcImpl.baseInvoke(Lcom/wm/data/IData;)Lcom/wm/data/IData; (279 bytes) @ 0xffffffff71365fa0 [0xffffffff71364a40+0x1560]J 31195 C2 com.wm.app.b2b.server.invoke.InvokeManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (273 bytes) @ 0xffffffff6db40e1c [0xffffffff6db40940+0x4dc]J 26966 C2 com.wm.app.b2b.server.util.tspace.ReservationProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (313 bytes) @ 0xffffffff710fbd14 [0xffffffff710fbb80+0x194]J 29610 C2 com.wm.app.b2b.server.invoke.StatisticsProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (209 bytes) @ 0xffffffff716eee60 [0xffffffff716ee940+0x520]J 26984 C2 com.wm.app.b2b.server.invoke.ServiceCompletionImpl.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (188 bytes) @ 0xffffffff7103dd58 [0xffffffff7103dc40+0x118]J 40185 C2 com.wm.app.b2b.server.ACLManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (560 bytes) @ 0xffffffff7338f780 [0xffffffff7338f1e0+0x5a0]J 27809 C2 com.wm.app.b2b.server.invoke.DispatchProcessor.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (288 bytes) @ 0xffffffff707a3c88 [0xffffffff707a3b20+0x168]J 30756 C2 com.wm.app.b2b.server.AuditLogManager.process(Ljava/util/Iterator;Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;Lcom/wm/app/b2b/server/invoke/ServiceStatus;)V (160 bytes) @ 0xffffffff71d71bfc [0xffffffff71d719c0+0x23c]J 34511 C2 com.wm.app.b2b.server.invoke.InvokeManager.invoke(Lcom/wm/app/b2b/server/BaseService;Lcom/wm/data/IData;ZLcom/wm/app/b2b/server/AuditRuntimeInfo;)Lcom/wm/data/IData; (803 bytes) @ 0xffffffff72146e4c [0xffffffff72145aa0+0x13ac]J 34101 C2 com.wm.app.b2b.server.dispatcher.trigger.Trigger.processMessage(Lcom/wm/msg/IMessage;)Z (369 bytes) @ 0xffffffff7146d414 [0xffffffff7146c640+0xdd4]J 34130 C2 com.wm.app.b2b.server.dispatcher.AbstractExecutionTask.processMessage()V (590 bytes) @ 0xffffffff6f3b2a2c [0xffffffff6f3b2840+0x1ec]J 34128 C2 com.wm.app.b2b.server.dispatcher.AbstractExecutionTask.run()V (278 bytes) @ 0xffffffff72166e3c [0xffffffff721668a0+0x59c]J 42462 C2 com.wm.util.pool.PooledThread.run()V (691 bytes) @ 0xffffffff6ed1e854 [0xffffffff6ed1e420+0x434]J 40583 C2 java.lang.Thread.run()V (17 bytes) @ 0xffffffff71d3728c [0xffffffff71d37200+0x8c]v  ~StubRoutines::call_stub---------------  P R O C E S S  ---------------Java Threads: ( => current thread )  0x000000010c750800 JavaThread "NervComponentRecoveryThread" daemon [_thread_blocked, id=19827, stack(0xfffffffbc7c00000,0xfffffffbc8100000)]  0x000000010a90d800 JavaThread "Thread-18625" daemon [_thread_blocked, id=19825, stack(0xfffffffc25000000,0xfffffffc25500000)]  0x000000010ad3c800 JavaThread "Event Manager Thread" daemon [_thread_blocked, id=19707, stack(0xfffffffc2a000000,0xfffffffc2a500000)]  0x000000010a1ba800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=18773, stack(0xfffffffbed800000,0xfffffffbedd00000)]  0x000000010ae79800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=18772, stack(0xfffffffbb7400000,0xfffffffbb7900000)]  0x000000010bc48800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=18771, stack(0xfffffffbcec00000,0xfffffffbcf100000)]  0x00000001059f5800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=18770, stack(0xfffffffbd2000000,0xfffffffbd2500000)]  0x000000010aa3a800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=18769, stack(0xfffffffbef000000,0xfffffffbef500000)]  0x00000001083b1800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=18768, stack(0xfffffffbcfc00000,0xfffffffbd0100000)]  0x000000010cf81000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=18767, stack(0xfffffffbcbc00000,0xfffffffbcc100000)]  0x0000000108f13800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=18766, stack(0xfffffffbb1c00000,0xfffffffbb2100000)]  0x000000010bcc1800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=18765, stack(0xfffffffbef800000,0xfffffffbefd00000)]  0x0000000108786000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=18764, stack(0xfffffffbccc00000,0xfffffffbcd100000)]  0x0000000107883800 JavaThread "Event Manager Thread" daemon [_thread_blocked, id=18167, stack(0xfffffffbd7800000,0xfffffffbd7d00000)]  0x00000001091d1000 JavaThread "webM RemoteHTTPEventHandler HTTPSocketMonitor" daemon [_thread_in_native, id=18000, stack(0xfffffffbcc400000,0xfffffffbcc900000)]  0x000000010e163800 JavaThread "HTTP Handler 10.200.65.195" daemon [_thread_in_native, id=17843, stack(0xfffffffbb6400000,0xfffffffbb6900000)]  0x000000010c379000 JavaThread "HTTP Handler 10.200.50.176" daemon [_thread_in_native, id=17842, stack(0xfffffffbb6c00000,0xfffffffbb7100000)]  0x000000010b949000 JavaThread "HTTP Handler 10.200.173.86" daemon [_thread_in_native, id=17840, stack(0xfffffffbb7c00000,0xfffffffbb8100000)]  0x0000000108f1f800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17838, stack(0xfffffffbb8400000,0xfffffffbb8900000)]  0x000000010bfb5800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17837, stack(0xfffffffbb9400000,0xfffffffbb9900000)]  0x000000010d1fe800 JavaThread "HTTP Handler 10.200.50.176" daemon [_thread_in_native, id=17836, stack(0xfffffffbba400000,0xfffffffbba900000)]  0x000000010824e800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.ebiztertio.atomic.sub:trigTertioRequestHandler" daemon [_thread_blocked, id=17835, stack(0xfffffffbbac00000,0xfffffffbbb100000)]  0x0000000103cde000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17834, stack(0xfffffffbbb400000,0xfffffffbbb900000)]  0x000000010ac9f800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17833, stack(0xfffffffbbbc00000,0xfffffffbbc100000)]  0x0000000105241800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17832, stack(0xfffffffbbc400000,0xfffffffbbc900000)]  0x00000001079e7000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17831, stack(0xfffffffbbd400000,0xfffffffbbd900000)]  0x000000010d318800 JavaThread "HTTP Handler 10.200.65.195" daemon [_thread_in_native, id=17830, stack(0xfffffffbbdc00000,0xfffffffbbe100000)]  0x00000001064bc000 JavaThread "HTTP Handler 10.231.24.127" daemon [_thread_blocked, id=17829, stack(0xfffffffbbe400000,0xfffffffbbe900000)]  0x0000000109c2c800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17828, stack(0xfffffffbbec00000,0xfffffffbbf100000)]  0x000000010dd5d800 JavaThread "HTTP Handler 10.200.65.195" daemon [_thread_in_native, id=17827, stack(0xfffffffbbf400000,0xfffffffbbf900000)]  0x000000010cd6d000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17826, stack(0xfffffffbbfc00000,0xfffffffbc0100000)]  0x0000000109b98800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17825, stack(0xfffffffbc0400000,0xfffffffbc0900000)]  0x000000010a44e000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17824, stack(0xfffffffbda000000,0xfffffffbda500000)]  0x000000010bb29000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17823, stack(0xfffffffbee800000,0xfffffffbeed00000)]  0x00000001072dd800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17822, stack(0xfffffffc1d800000,0xfffffffc1dd00000)]  0x000000010a338000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17768, stack(0xfffffffc1f400000,0xfffffffc1f900000)]  0x000000010ddb9000 JavaThread "HTTP Handler 10.200.35.162" daemon [_thread_in_native, id=17767, stack(0xfffffffb81c00000,0xfffffffb82100000)]  0x000000010d38b000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17766, stack(0xfffffffc28c00000,0xfffffffc29100000)]  0x00000001096e8000 JavaThread "HTTP Handler 10.200.35.52" daemon [_thread_in_native, id=17765, stack(0xfffffffcb2000000,0xfffffffcb2500000)]  0x000000010c40f000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17764, stack(0xfffffffbe8400000,0xfffffffbe8900000)]  0x00000001083b2800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17763, stack(0xfffffffbd9800000,0xfffffffbd9d00000)]  0x000000010cae0000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17762, stack(0xfffffffc81000000,0xfffffffc81500000)]  0x0000000109c74800 JavaThread "HTTP Handler 172.21.3.65" daemon [_thread_in_native, id=17761, stack(0xfffffffbec800000,0xfffffffbecd00000)]  0x00000001030ee800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17760, stack(0xfffffffbd4800000,0xfffffffbd4d00000)]  0x000000010a9d1800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17759, stack(0xfffffffbcd400000,0xfffffffbcd900000)]  0x0000000104575000 JavaThread "Event Manager Thread" daemon [_thread_blocked, id=17731, stack(0xfffffffbc2400000,0xfffffffbc2900000)]  0x00000001069d6000 JavaThread "Event Manager Thread" daemon [_thread_blocked, id=17502, stack(0xfffffffbd8800000,0xfffffffbd8d00000)]  0x000000010c59c000 JavaThread "Event Manager Thread" daemon [_thread_blocked, id=17422, stack(0xfffffffbc0c00000,0xfffffffbc1100000)]  0x00000001083ec800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17380, stack(0xfffffffbc1400000,0xfffffffbc1900000)]  0x000000010859a800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17379, stack(0xfffffffbc1c00000,0xfffffffbc2100000)]  0x0000000108af6800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17378, stack(0xfffffffbc2c00000,0xfffffffbc3100000)]  0x000000010d5ea000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17377, stack(0xfffffffbc3400000,0xfffffffbc3900000)]  0x00000001098d3800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17376, stack(0xfffffffbc3c00000,0xfffffffbc4100000)]  0x000000010859d800 JavaThread "HTTP Handler 10.200.35.162" daemon [_thread_in_native, id=17375, stack(0xfffffffbc4400000,0xfffffffbc4900000)]  0x000000010a653800 JavaThread "HTTP Handler 10.200.35.53" daemon [_thread_blocked, id=17374, stack(0xfffffffbcf400000,0xfffffffbcf900000)]  0x000000010e3d4800 JavaThread "HTTP Handler 10.200.50.176" daemon [_thread_in_native, id=17373, stack(0xfffffffbd7000000,0xfffffffbd7500000)]  0x0000000109caf800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17372, stack(0xfffffffbe5c00000,0xfffffffbe6100000)]  0x000000010d49d000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17371, stack(0xfffffffbe9c00000,0xfffffffbea100000)]  0x000000010cb80000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17370, stack(0xfffffffc1d000000,0xfffffffc1d500000)]  0x000000010a528800 JavaThread "HTTP Handler 10.200.35.53" daemon [_thread_blocked, id=17369, stack(0xfffffffb8ec00000,0xfffffffb8f100000)]  0x000000010cded800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17367, stack(0xfffffffbee000000,0xfffffffbee500000)]  0x000000010c0aa800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17366, stack(0xfffffffc24800000,0xfffffffc24d00000)]  0x000000010be18800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=17365, stack(0xfffffffbe8c00000,0xfffffffbe9100000)]  0x0000000105da3000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17364, stack(0xfffffffc26000000,0xfffffffc26500000)]  0x000000010af1f000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17363, stack(0xfffffffbda800000,0xfffffffbdad00000)]  0x0000000108ff3000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=17362, stack(0xfffffffbe7400000,0xfffffffbe7900000)]  0x000000010b1dd800 JavaThread "HTTP Handler 10.200.35.162" daemon [_thread_in_native, id=17361, stack(0xfffffffbe6c00000,0xfffffffbe7100000)]  0x000000010d505800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16750, stack(0xfffffffbc5400000,0xfffffffbc5900000)]  0x000000010c801000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=16749, stack(0xfffffffbc5c00000,0xfffffffbc6100000)]  0x0000000105d98000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=16748, stack(0xfffffffbc6400000,0xfffffffbc6900000)]  0x000000010bcc8800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16747, stack(0xfffffffbc7400000,0xfffffffbc7900000)]  0x00000001060b0000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16745, stack(0xfffffffbc8400000,0xfffffffbc8900000)]  0x000000010ef98000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=16744, stack(0xfffffffbc8c00000,0xfffffffbc9100000)]  0x000000010c25f800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16743, stack(0xfffffffbc9400000,0xfffffffbc9900000)]=>0x000000010b00e800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_in_native, id=16742, stack(0xfffffffb9bc00000,0xfffffffb9c100000)]  0x000000010bf30800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=16741, stack(0xfffffffbc9c00000,0xfffffffbca100000)]  0x000000010ea70000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=16658, stack(0xfffffffbd3000000,0xfffffffbd3500000)]  0x00000001060ec000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.ebiztertio.atomic.sub:trigTertioRequestHandler" daemon [_thread_blocked, id=16657, stack(0xfffffffbe7c00000,0xfffffffbe8100000)]  0x000000010834e800 JavaThread "HTTP Handler 10.200.50.176" daemon [_thread_in_native, id=16656, stack(0xfffffffbd8000000,0xfffffffbd8500000)]  0x000000010b4d9800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16654, stack(0xfffffffbd0400000,0xfffffffbd0900000)]  0x0000000109894000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16653, stack(0xfffffffbcdc00000,0xfffffffbce100000)]  0x000000010b954000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16652, stack(0xfffffffce9000000,0xfffffffce9500000)]  0x00000001094f2000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16651, stack(0xfffffffbd6000000,0xfffffffbd6500000)]  0x0000000108884800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.ebiztertio.atomic.sub:trigTertioRequestHandler" daemon [_thread_blocked, id=16650, stack(0xfffffffbeb800000,0xfffffffbebd00000)]  0x000000011094e800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=16349, stack(0xfffffffc25800000,0xfffffffc25d00000)]  0x000000010cdbc000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16346, stack(0xfffffffc4dc00000,0xfffffffc4e100000)]  0x000000010d099000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=16345, stack(0xfffffffbb9c00000,0xfffffffbba100000)]  0x000000010dc40800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16343, stack(0xfffffffc29800000,0xfffffffc29d00000)]  0x0000000103cfa800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=16341, stack(0xfffffffbd3800000,0xfffffffbd3d00000)]  0x000000010dc72800 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=16029, stack(0xfffffffbe9400000,0xfffffffbe9900000)]  0x0000000109caf000 JavaThread "HTTP Handler 10.200.65.195" daemon [_thread_in_native, id=16022, stack(0xfffffffb84400000,0xfffffffb84900000)]  0x0000000108d2b800 JavaThread "Keep-Alive-Timer" daemon [_thread_blocked, id=15783, stack(0xfffffffbca400000,0xfffffffbca900000)]  0x00000001095c6800 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=15647, stack(0xfffffffbd5800000,0xfffffffbd5d00000)]  0x0000000106637000 JavaThread "Service Thread Pool" daemon [_thread_blocked, id=15644, stack(0xfffffffbd9000000,0xfffffffbd9500000)]  0x000000010afa8000 JavaThread "Service Thread Pool - Trigger ExecutionTask - maxis.eai.process.vas.atomic:trigActivateDisconnectPreComp" daemon [_thread_blocked, id=13103, stack(0xfffffffbd2800000,0xfffffffbd2d00000)]  0x0000000105d9e000 JavaThread "Thread-9487" daemon [_thread_blocked, id=10308, stack(0xfffffffb80400000,0xfffffffb80900000)]  0x000000010da05800 JavaThread "Thread-8761" daemon [_thread_blocked, id=9569, stack(0xfffffffb9fc00000,0xfffffffba0100000)]  0x000000010c2ac800 JavaThread "Cron Daemon Pool12" daemon [_thread_blocked, id=9369, stack(0xfffffffbbcc00000,0xfffffffbbd100000)]  0x0000000103ebe000 JavaThread "Cron Daemon Pool11" daemon [_thread_blocked, id=9368, stack(0xfffffffb74000000,0xfffffffb74500000)]  0x000000010d362000 JavaThread "Cron Daemon Pool10" daemon [_thread_blocked, id=9367, stack(0xfffffffbc6c00000,0xfffffffbc7100000)]  0x0000000103ec1000 JavaThread "Cron Daemon Pool9" daemon [_thread_blocked, id=9366, stack(0xfffffffbae400000,0xfffffffbae900000)]  0x0000000108782800 JavaThread "Thread-8203" daemon [_thread_blocked, id=8999, stack(0xfffffffb93c00000,0xfffffffb94100000)]  0x0000000109ee3000 JavaThread "Thread-7557" daemon [_thread_blocked, id=8344, stack(0xfffffffb99c00000,0xfffffffb9a100000)]  0x0000000109bdd000 JavaThread "Thread-6749" daemon [_thread_blocked, id=7526, stack(0xfffffffb90400000,0xfffffffb90900000)]  0x000000010b021800 JavaThread "Thread-6616" daemon [_thread_blocked, id=7391, stack(0xfffffffb8e400000,0xfffffffb8e900000)]  0x0000000108bbd000 JavaThread "ToolkitNotifier-39" daemon [_thread_blocked, id=6517, stack(0xfffffffbce400000,0xfffffffbce900000)]  0x000000010ca15000 JavaThread "Thread-2100" daemon [_thread_blocked, id=2780, stack(0xfffffffb79c00000,0xfffffffb7a100000)]  0x000000010d113000 JavaThread "Thread-2099" daemon [_thread_blocked, id=2779, stack(0xfffffffc7cc00000,0xfffffffc7d100000)]  0x000000010a2d4800 JavaThread "Thread-1965" daemon [_thread_blocked, id=2643, stack(0xfffffffb7bc00000,0xfffffffb7c100000)]  0x000000010d5f1800 JavaThread "Thread-1341" daemon [_thread_blocked, id=2011, stack(0xfffffffb7b400000,0xfffffffb7b900000)]  0x000000010a1fc000 JavaThread "Job_Executor5" daemon [_thread_blocked, id=1945, stack(0xfffffffb7a400000,0xfffffffb7a900000)]  0x0000000108d64800 JavaThread "Job_Executor4" daemon [_thread_blocked, id=1944, stack(0xfffffffc4e400000,0xfffffffc4e900000)]  0x000000010ddbc800 JavaThread "Job_Executor5" daemon [_thread_blocked, id=1943, stack(0xfffffffb7ac00000,0xfffffffb7b100000)]  0x000000010d9f9800 JavaThread "Batch dispatch thread" daemon [_thread_blocked, id=1940, stack(0xfffffffb7dc00000,0xfffffffb7e100000)]  0x0000000108cfc800 JavaThread "Job_Executor4" daemon [_thread_blocked, id=1939, stack(0xfffffffb7d400000,0xfffffffb7d900000)]  0x000000010989a800 JavaThread "Batch dispatch thread" daemon [_thread_blocked, id=1938, stack(0xfffffffb7cc00000,0xfffffffb7d100000)]  0x000000010b383800 JavaThread "Batch dispatch thread" daemon [_thread_blocked, id=1937, stack(0xfffffffb7c400000,0xfffffffb7c900000)]  0x000000010ad5c000 JavaThread "Client-Push:4:1" daemon [_thread_blocked, id=1629, stack(0xfffffffb7fc00000,0xfffffffb80100000)]  0x000000010eef6800 JavaThread "Client-Push:10:1" daemon [_thread_blocked, id=1625, stack(0xfffffffb7f400000,0xfffffffb7f900000)]  0x000000010837e800 JavaThread "Client-Push:13:1" daemon [_thread_blocked, id=1611, stack(0xfffffffb89c00000,0xfffffffb8a100000)]  0x000000010a4dc000 JavaThread "Client-Push:5:1" daemon [_thread_blocked, id=1446, stack(0xfffffffb89400000,0xfffffffb89900000)]  0x000000010b219000 JavaThread "Scheduler Worker Pool:8" daemon [_thread_blocked, id=1237, stack(0xfffffffbdc000000,0xfffffffbdc500000)]  0x000000010b46e000 JavaThread "Client-Push:20:1" daemon [_thread_blocked, id=1202, stack(0xfffffffbd1800000,0xfffffffbd1d00000)]  0x000000010c5ab000 JavaThread "Thread-641" daemon [_thread_blocked, id=1104, stack(0xfffffffbe1400000,0xfffffffbe1900000)]  0x0000000108ae2000 JavaThread "Thread-582" daemon [_thread_blocked, id=1044, stack(0xfffffffbdb800000,0xfffffffbdbd00000)]  0x000000010a613000 JavaThread "Thread-580" daemon [_thread_blocked, id=1042, stack(0xfffffffbdc800000,0xfffffffbdcd00000)]  0x000000010fef4000 JavaThread "Thread-579" daemon [_thread_blocked, id=1041, stack(0xfffffffbdd400000,0xfffffffbdd900000)]  0x000000010aea1000 JavaThread "Client-Push:9:1" daemon [_thread_blocked, id=1034, stack(0xfffffffbddc00000,0xfffffffbde100000)]  0x00000001100f6000 JavaThread "Client-Push:7:1" daemon [_thread_blocked, id=1033, stack(0xfffffffbde400000,0xfffffffbde900000)]  0x000000010afa9000 JavaThread "Client-Push:6:1" daemon [_thread_blocked, id=1032, stack(0xfffffffbdec00000,0xfffffffbdf100000)]  0x000000010c0c8000 JavaThread "Client-Push:15:1" daemon [_thread_blocked, id=1031, stack(0xfffffffbdf400000,0xfffffffbdf900000)]  0x0000000109146800 JavaThread "Client-Push:3:1" daemon [_thread_blocked, id=1030, stack(0xfffffffbdfc00000,0xfffffffbe0100000)]  0x000000010a9c0800 JavaThread "Client-Push:17:1" daemon [_thread_blocked, id=1029, stack(0xfffffffbe1c00000,0xfffffffbe2100000)]  0x000000010c3bc800 JavaThread "Thread-548" daemon [_thread_blocked, id=1009, stack(0xfffffffbf3400000,0xfffffffbf3900000)]  0x0000000109995800 JavaThread "Thread-547" daemon [_thread_blocked, id=1008, stack(0xfffffffbe2c00000,0xfffffffbe3100000)]  0x000000010c77b000 JavaThread "Thread-531" daemon [_thread_blocked, id=991, stack(0xfffffffbe2400000,0xfffffffbe2900000)]  0x000000010ad02000 JavaThread "Thread-530" daemon [_thread_blocked, id=990, stack(0xfffffffc1ec00000,0xfffffffc1f100000)]  0x000000010ab1f000 JavaThread "Thread-526" daemon [_thread_blocked, id=986, stack(0xfffffffbe3400000,0xfffffffbe3900000)]  0x000000010b614000 JavaThread "Thread-525" daemon [_thread_blocked, id=985, stack(0xfffffffbe3c00000,0xfffffffbe4100000)]  0x000000010a131800 JavaThread "Thread-524" daemon [_thread_blocked, id=984, stack(0xfffffffbe4400000,0xfffffffbe4900000)]  0x000000010ae96800 JavaThread "Thread-523" daemon [_thread_blocked, id=983, stack(0xfffffffbe4c00000,0xfffffffbe5100000)]  0x000000010b93c000 JavaThread "Thread-522" daemon [_thread_blocked, id=982, stack(0xfffffffbe5400000,0xfffffffbe5900000)]  0x0000000104a3a000 JavaThread "Client-Push:16:1" daemon [_thread_blocked, id=960, stack(0xfffffffbf0000000,0xfffffffbf0500000)]  0x000000010bc99000 JavaThread "Thread-519" daemon [_thread_blocked, id=959, stack(0xfffffffbf0800000,0xfffffffbf0d00000)]  0x000000010a462800 JavaThread "Log4j2-TF-1-AsyncLogger[[email protected]]-1" daemon [_thread_blocked, id=958, stack(0xfffffffc1fc00000,0xfffffffc20100000)]  0x0000000109f5a800 JavaThread "OracleTimeoutPollingThread" daemon [_thread_blocked, id=955, stack(0xfffffffc4f400000,0xfffffffc4f900000)]  0x0000000103ee0000 JavaThread "Thread-515" daemon [_thread_blocked, id=953, stack(0xfffffffbf1400000,0xfffffffbf1900000)]  0x000000010bcd7800 JavaThread "Thread-514" daemon [_thread_blocked, id=952, stack(0xfffffffcf1400000,0xfffffffcf1900000)]  0x000000010913c000 JavaThread "Scheduler Worker Pool:7" daemon [_thread_blocked, id=939, stack(0xfffffffbf1c00000,0xfffffffbf2100000)]  0x0000000109c7a000 JavaThread "Scheduler Worker Pool:6" daemon [_thread_blocked, id=938, stack(0xfffffffbf2400000,0xfffffffbf2900000)]  0x0000000104d8e000 JavaThread "Scheduler Worker Pool:5" daemon [_thread_blocked, id=937, stack(0xfffffffbf2c00000,0xfffffffbf3100000)]  0x000000010b5d9000 JavaThread "Scheduler Worker Pool:4" daemon [_thread_blocked, id=936, stack(0xfffffffc26800000,0xfffffffc26d00000)]  0x000000010b69d000 JavaThread "Thread-489" daemon [_thread_blocked, id=927, stack(0xfffffffc17800000,0xfffffffc17d00000)]  0x000000010c23f800 JavaThread "cluster-events-processor-1" daemon [_thread_blocked, id=921, stack(0xfffffffcf6000000,0xfffffffcf6500000)]  0x000000010b40c800 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=914, stack(0xfffffffbf3c00000,0xfffffffbf4100000)]  0x000000010b409000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=913, stack(0xfffffffbf4400000,0xfffffffbf4900000)]  0x000000010b407800 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=912, stack(0xfffffffbf4c00000,0xfffffffbf5100000)]  0x0000000104ed2000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=911, stack(0xfffffffbf5400000,0xfffffffbf5900000)]  0x0000000104ed0000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=910, stack(0xfffffffbf5c00000,0xfffffffbf6100000)]  0x0000000104ecb800 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=909, stack(0xfffffffbf6400000,0xfffffffbf6900000)]  0x0000000109b07000 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=908, stack(0xfffffffbf6c00000,0xfffffffbf7100000)]  0x0000000109b05800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=907, stack(0xfffffffbf7400000,0xfffffffbf7900000)]  0x0000000109b03800 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=906, stack(0xfffffffbf7c00000,0xfffffffbf8100000)]  0x0000000109b02000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=905, stack(0xfffffffbf8400000,0xfffffffbf8900000)]  0x000000010960d800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=904, stack(0xfffffffbf8c00000,0xfffffffbf9100000)]  0x000000010b7cb000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=903, stack(0xfffffffbf9400000,0xfffffffbf9900000)]  0x000000010b7c4000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=902, stack(0xfffffffbf9c00000,0xfffffffbfa100000)]  0x000000010a20e000 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=901, stack(0xfffffffbfa400000,0xfffffffbfa900000)]  0x0000000109032000 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=900, stack(0xfffffffbfac00000,0xfffffffbfb100000)]  0x000000010b093000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=899, stack(0xfffffffbfb400000,0xfffffffbfb900000)]  0x000000010b098000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=898, stack(0xfffffffbfbc00000,0xfffffffbfc100000)]  0x000000010902e000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=897, stack(0xfffffffbfc400000,0xfffffffbfc900000)]  0x000000010902b800 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=896, stack(0xfffffffbfcc00000,0xfffffffbfd100000)]  0x000000010a210800 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=895, stack(0xfffffffbfd400000,0xfffffffbfd900000)]  0x000000010b099800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=894, stack(0xfffffffbfdc00000,0xfffffffbfe100000)]  0x0000000106bac000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=893, stack(0xfffffffbfe400000,0xfffffffbfe900000)]  0x00000001095cc800 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=892, stack(0xfffffffbfec00000,0xfffffffbff100000)]  0x000000010a20c000 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=891, stack(0xfffffffbff400000,0xfffffffbff900000)]  0x000000010afff800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=890, stack(0xfffffffbffc00000,0xfffffffc00100000)]  0x0000000107449800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=889, stack(0xfffffffc00400000,0xfffffffc00900000)]  0x0000000107442800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=888, stack(0xfffffffc00c00000,0xfffffffc01100000)]  0x000000010b096800 JavaThread "NirvanaReadThread 10.200.170.51:6859" [_thread_in_native, id=887, stack(0xfffffffc01400000,0xfffffffc01900000)]  0x0000000106bab800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=886, stack(0xfffffffc01c00000,0xfffffffc02100000)]  0x00000001092e2800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=885, stack(0xfffffffc02400000,0xfffffffc02900000)]  0x00000001092e1000 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=884, stack(0xfffffffc02c00000,0xfffffffc03100000)]  0x00000001092df000 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=883, stack(0xfffffffc03400000,0xfffffffc03900000)]  0x00000001092dd800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=882, stack(0xfffffffc03c00000,0xfffffffc04100000)]  0x000000010ab3e800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=881, stack(0xfffffffc04400000,0xfffffffc04900000)]  0x0000000107c4c800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=880, stack(0xfffffffc04c00000,0xfffffffc05100000)]  0x00000001092dd000 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=879, stack(0xfffffffc05400000,0xfffffffc05900000)]  0x0000000107c4b800 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=878, stack(0xfffffffc05c00000,0xfffffffc06100000)]  0x0000000107c4a000 JavaThread "fProcessThreadedQueue" daemon [_thread_blocked, id=877, stack(0xfffffffc0f400000,0xfffffffc0f900000)]  0x00000001092e9000 JavaThread "Client-Push:19:0" daemon [_thread_blocked, id=876, stack(0xfffffffc06400000,0xfffffffc06900000)]  0x00000001092e7000 JavaThread "Client-Push:18:0" daemon [_thread_blocked, id=875, stack(0xfffffffc06c00000,0xfffffffc07100000)]  0x000000010b415000 JavaThread "Client-Push:15:0" daemon [_thread_blocked, id=874, stack(0xfffffffc07400000,0xfffffffc07900000)]  0x0000000109994000 JavaThread "Client-Push:14:0" daemon [_thread_blocked, id=873, stack(0xfffffffc07c00000,0xfffffffc08100000)]  0x0000000109992000 JavaThread "Client-Push:12:0" daemon [_thread_blocked, id=872, stack(0xfffffffc08400000,0xfffffffc08900000)]  0x000000010961a000 JavaThread "Client-Push:11:0" daemon [_thread_blocked, id=871, stack(0xfffffffc08c00000,0xfffffffc09100000)]  0x000000010961c000 JavaThread "Client-Push:10:0" daemon [_thread_blocked, id=870, stack(0xfffffffc09400000,0xfffffffc09900000)]  0x000000010b8b1800 JavaThread "Client-Push:6:0" daemon [_thread_blocked, id=869, stack(0xfffffffc09c00000,0xfffffffc0a100000)]  0x00000001074cc800 JavaThread "Client-Push:5:0" daemon [_thread_blocked, id=868, stack(0xfffffffc0a400000,0xfffffffc0a900000)]  0x0000000108fa8000 JavaThread "Client-Push:8:0" daemon [_thread_blocked, id=867, stack(0xfffffffc0ac00000,0xfffffffc0b100000)]  0x00000001068c1800 JavaThread "Client-Push:4:0" daemon [_thread_blocked, id=866, stack(0xfffffffc0b400000,0xfffffffc0b900000)]  0x000000010a09a800 JavaThread "Client-Push:3:0" daemon [_thread_blocked, id=865, stack(0xfffffffc0bc00000,0xfffffffc0c100000)]  0x000000010a09a000 JavaThread "Client-Push:9:0" daemon [_thread_blocked, id=864, stack(0xfffffffc0c400000,0xfffffffc0c900000)]  0x0000000108faa000 JavaThread "Client-Push:7:0" daemon [_thread_blocked, id=863, stack(0xfffffffc0cc00000,0xfffffffc0d100000)]  0x0000000103d23000 JavaThread "Client-Push:13:0" daemon [_thread_blocked, id=862, stack(0xfffffffc0d400000,0xfffffffc0d900000)]  0x00000001092da000 JavaThread "Client-Push:17:0" daemon [_thread_blocked, id=861, stack(0xfffffffc0dc00000,0xfffffffc0e100000)]  0x0000000109cfa000 JavaThread "Client-Push:16:0" daemon [_thread_blocked, id=860, stack(0xfffffffc2ec00000,0xfffffffc2f100000)]  0x000000010480a000 JavaThread "Client-Push:20:0" daemon [_thread_blocked, id=859, stack(0xfffffffc0e400000,0xfffffffc0e900000)]  0x000000010b5fd000 JavaThread "Client-Push:3:0" daemon [_thread_blocked, id=858, stack(0xfffffffc0ec00000,0xfffffffc0f100000)]  0x00000001041d2800 JavaThread "webM Client TX Remote Job Manager" daemon [_thread_blocked, id=855, stack(0xfffffffc0fc00000,0xfffffffc10100000)]  0x000000010843b800 JavaThread "webM Client TX Thread Pool" daemon [_thread_blocked, id=854, stack(0xfffffffc10400000,0xfffffffc10900000)]  0x0000000108439800 JavaThread "webM Client TX Thread Pool" daemon [_thread_blocked, id=853, stack(0xfffffffc10c00000,0xfffffffc11100000)]  0x0000000108438000 JavaThread "webM Client TX Thread Pool" daemon [_thread_blocked, id=852, stack(0xfffffffc11400000,0xfffffffc11900000)]  0x00000001092ea000 JavaThread "webM Client TX Thread Pool" daemon [_thread_blocked, id=851, stack(0xfffffffc11c00000,0xfffffffc12100000)]  0x000000010b8b6000 JavaThread "webM Client TX Thread Pool" daemon [_thread_blocked, id=850, stack(0xfffffffc12400000,0xfffffffc12900000)]  0x00000001092eb800 JavaThread "BrokerPoller" daemon [_thread_blocked, id=849, stack(0xfffffffc13000000,0xfffffffc13500000)]  0x0000000105ace800 JavaThread "msg:ISResubmitEndPoint:ISResubmitProducer:DefaultMsgStore" daemon [_thread_blocked, id=848, stack(0xfffffffc13800000,0xfffffffc13d00000)]  0x00000001092af800 JavaThread "webM IS RequestReplySweeper" daemon [_th

Answers

  • user9130018
    user9130018 Member Posts: 74 Blue Ribbon
    edited September 2018

    Hello

    Your application can crash inside libwsc when you've messed up with pointers or memory

    Is this java -> jni -> native_tuxedo_libs client?

  • Bartek Gasparski
    Bartek Gasparski Member Posts: 9
    edited September 2018

    Is this "client" run in TMJAVASVR (as CLass loaded from Java Server configuration CLass ) ? If yes, so it is running as a Java Server and  called from Tuxedo by JNI

    If not, maybe you have some other protocol to call Tuxedo from Java (JCA,  Jolt, ...) ?

    Could You see from this stack what was the last operation from Your program ?

  • anand_206
    anand_206 Member Posts: 3
    edited September 2018

    Hi Bartek,

    Thanks for the reply.

    We are using JNI libraries (Terrapin) to access Tuxedo client from our JVM.

    I could see below operations in the thread that caused the crash:

    com.csgsystems.aruba.connection.Connection.reset()

         com.csgsystems.aruba.connection.Pool.clear()

              com.csgsystems.aruba.connection.PoolableATMI.delete()

                   terrapin.tuxedo.ATMI.tpterm()

  • anand_206
    anand_206 Member Posts: 3
    edited September 2018

    The terrapin java libraries use tti_tuxedo & tti_tuxedo_wsc library files.

This discussion has been closed.