This discussion is archived
7 Replies Latest reply: Sep 3, 2013 4:21 PM by Hussein Sawwan-Oracle RSS

Workflow Java Deferred Agent Listener -  java.sql.SQLRecoverableException: No more data to read from socket

Cherrish Explorer
Currently Being Moderated

Team,

 

EBS: R12.1.2 on Oracle Linux 5

DB: 11.2.0.3 on HP UX Itanium

 

Workflow Java Deferred Agent Listener is getting to "System Deactivated" status after sometime. It started happening suddenly in Production from last 3 days. Details from the page is below:

 

Name Workflow Java Deferred Agent Listener

Inbound AgentWorkflow Java Deferred In Queue

InformationThis Automatic Service Component has been restarted the maximum of 10 times after stopping with error. Thus, it has been system deactivated -> oracle.apps.fnd.cp.gsc.ProcessorException: Error occurred while dequeueing -> oracle.apps.fnd.wf.bes.QueueHandlerException: Could not execute() the CallableStatement or retrieve OUT parameter -> java.sql.SQLRecoverableException: No more data to read from socket

 

I tried following steps - How to Manually Process the Events from Workflow Queues When The Deferred Agent Listener Won't Start (Doc ID 953103.1)


Thanks

Cherrish Vaidiyan

  • 1. Re: Workflow Java Deferred Agent Listener -  java.sql.SQLRecoverableException: No more data to read from socket
    Hussein Sawwan-Oracle Employee ACE
    Currently Being Moderated

    What changes have been done recently?

     

    Can you find any errors in the database log file?

     

    Are there any invalid objects in the database?

     

    Regards,

    Hussein

  • 2. Re: Workflow Java Deferred Agent Listener -  java.sql.SQLRecoverableException: No more data to read from socket
    Cherrish Explorer
    Currently Being Moderated

    What changes have been done recently?

    Applied the patch: 14648996

     

    Can you find any errors in the database log file?

    In the RDBMS alert log I see the following error :


    Alert Log:

    Tue Sep 03 16:53:50 2013

    Errors in file /u01/oracle/PROD/diag/rdbms/prod/PROD/trace/PROD_ora_20964.trc  (incident=1541409):

    ORA-00600: internal error code, arguments: [ktuabt-1], [4202115], [], [], [], [], [], [], [], [], [], []

    Incident details in: /u01/oracle/PROD/diag/rdbms/prod/PRODincident/incdir_1541409/PROD_ora_20964_i1541409.trc

    Tue Sep 03 16:53:55 2013

    Dumping diagnostic data in directory=[cdmp_20130903165355], requested by (instance=1, osid=20964), summary=[incident=1541409].

    Tue Sep 03 16:54:01 2013

    Use ADRCI or Support Workbench to package the incident.

    See Note 411.1 at My Oracle Support for error and packaging details.

    Error 600 trapped in 2PC on transaction 714.29.41365. Cleaning up.

    Error stack returned to user:

    ORA-00600: internal error code, arguments: [ktuabt-1], [4202115], [], [], [], [], [], [], [], [], [], []

    Errors in file /u01/oracle/PROD/diag/rdbms/prod/PRODtrace/PROD_ora_20964.trc  (incident=1541410):

    ORA-00603: ORACLE server session terminated by fatal error

    ORA-00600: internal error code, arguments: [ktuabt-1], [4202115], [], [], [], [], [], [], [], [], [], []

    Incident details in: /u01/oracle/PROD/diag/rdbms/prod/PRODincident/incdir_1541410/PROD_ora_20964_i1541410.trc

    Tue Sep 03 16:54:01 2013

     

    PROD_ora_20964_i1541409.trc:

     

    *** 2013-09-03 16:53:50.459

    dbkedDefDump(): Starting incident default dumps (flags=0x2, level=3, mask=0x0)

    ----- Current SQL Statement for this session (sql_id=87rnsy1364ymd) -----

    COMMIT WORK

    ----- PL/SQL Stack -----

    ----- PL/SQL Call Stack -----

      object      line  object

      handle    number  name

    c000001e7bb2a310       929  package body APPS.QA_CHAR_UPDATE_PKG

    c000001e7bb2a310        87  package body APPS.QA_CHAR_UPDATE_PKG

    c000001d9f1e85d0         1  anonymous block

    ----- Call Stack Trace -----

    calling              call     entry                argument values in hex

    location             type     point                (? means dubious value)

    -------------------- -------- -------------------- ----------------------------

    skdstdst()+64        call     kgdsdst()            9FFFFFFFFFFE20B0 ?

                                                       000000002 ?

    ksedst()+432         call     skdstdst()           9FFFFFFFFFFE20B0 ?

                                                       000000000 ? 000000001 ?

                                                       C000000000000899 ?

                                                       4000000004E85BF0 ?

                                                       000000000 ? 000000000 ?

                                                       000000000 ?

    dbkedDefDump()+1440  call     ksedst()             000000000 ?

                                                       600000000014B550 ?

                                                       C000000000000C20 ?

                                                       40000000051C8010 ?

                                                       9FFFFFFFFFFE2120 ?

                                                       600000000015A434 ?

                                                       000000001 ?

                                                       600000000015A458 ?

    ksedmp()+64          call     dbkedDefDump()       000000003 ?

                                                       FFFFFFFFBEBEA703 ?

     

     

    Are there any invalid objects in the database?

    The # of invalids in the DB is as normal. No new invalids.

     

    Note: I have changed the file path from the alert log extract as I dont want to disclose the information to public. Another ML Note that I referred is : Ora 600 [Ktuabt-1] reported In 11gR2 (Doc ID 1372715.1). I have not set the event mentioned in the note. I want to learn what caused it and what does the event do.

     

    Thanks

    Cherrish Vaidiyan

  • 3. Re: Workflow Java Deferred Agent Listener -  java.sql.SQLRecoverableException: No more data to read from socket
    Hussein Sawwan-Oracle Employee ACE
    Currently Being Moderated

    Cherrish,

     

    The patch you applied should not cause any issues with WF or with the database.

     

    Have you reviewed (Bug 12591155 - ORA-600 [ktuabt-1] in a distributed transaction (Doc ID 12591155.8))?

     

    Since ORA-600 is happening in production I would suggest you log a SR and provide the alert log and trace files to Oracle support.

     

    Thanks,

    Hussein

  • 4. Re: Workflow Java Deferred Agent Listener -  java.sql.SQLRecoverableException: No more data to read from socket
    Cherrish Explorer
    Currently Being Moderated

    Hi Hussein,

     

    I already have an SR going on and the analyst mentioned the same note as I saw - Ora 600 [Ktuabt-1] reported In 11gR2 (Doc ID 1372715.1)

    SR 3-7722168611 : Production : ORA-00600 Errors Impacting Production

    and

    SR 3-7722720301 : Production: WF Java Deferred Agent Listener not getting started


    I haven't seen the note 12591155.8 you had mentioned until now. But is it possible that both are interlinked the ORA-600 and the Workflow Java Deferred Agent Listener ?

     

    Thanks

    Cherrish Vaidiyan

  • 5. Re: Workflow Java Deferred Agent Listener -  java.sql.SQLRecoverableException: No more data to read from socket
    Hussein Sawwan-Oracle Employee ACE
    Currently Being Moderated

    I'm not sure if it's possible or not as it's a workaround. I haven't checked any of the log/trace files yet to confirm this.

     

    Thanks,

    Hussein

  • 6. Re: Workflow Java Deferred Agent Listener -  java.sql.SQLRecoverableException: No more data to read from socket
    Cherrish Explorer
    Currently Being Moderated

    I admit that I am a beginner with workflow. Can you please tell me the significance of "Workflow Java Deferred Agent Listener".

    What is its day to day roles and what type of users will be affected when it is down ?

     

    Thanks

    Cherrish Vaidiyan

  • 7. Re: Workflow Java Deferred Agent Listener -  java.sql.SQLRecoverableException: No more data to read from socket
    Hussein Sawwan-Oracle Employee ACE
    Currently Being Moderated

    Please see the following docs/links.

     

    Oracle Workflow Administrator's Guide


    Oracle Workflow FAQ (Doc ID 465887.1)

    Troubleshooting Missing Responsibilities For A User (Doc ID 429852.1)

     

    Thanks,

    Hussein

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points