10 Replies Latest reply on Jul 7, 2016 6:22 AM by Samrat Sinha

    Workflow mailer failed to send mails

    Beauty_and_dBest

      Hi ALL,

       

      EBS 12.1.3

       

      Our workflow mailer is down and can not be restarted. Is there a way to start it aside of bouncing the instance?

      Capture.GIF

      restart_mailer.JPG

       

      Please help how to force restart it

       

       

      Kind regards,

      jc

        • 1. Re: Workflow mailer failed to send mails
          Pravin Takpire

          Can you check the logifile for same let us know the error messages in it

          regards

          Pravin

          1 person found this helpful
          • 2. Re: Workflow mailer failed to send mails
            VishnuVinnakota

            Hi,

             

                Go to OAM --> Workflow --> Service Components --> Workflow Notification Mailer --> Edit

             

                 Ensure all parameter are correct. Click on apply/ok. It throws any errors there itself.

             

                 Bounce CM once.

             

                  Then try to start and stop it.

             

                 I hope the OS mailx has been working fine.

            1 person found this helpful
            • 3. Re: Workflow mailer failed to send mails
              Beauty_and_dBest

              Hi ALL,

               

              Bellow are the errors:

               

              FNDCPGSC525753.txt:[Jun 27, 2016 6:02:44 PM PHT]:1467021764863:-1:-1:ebiz03.hoi.com.ph:172.26.1.240:-1:-1:1:20420:SYSADMIN(0):-1:Thread[outboundThreadGroup1,5,outboundThreadGroup]:172.26.1.240:40097:1465802766659:11:ERROR:[SVC-GSM-WFMLRSVC-525753-10006 : oracle.apps.fnd.wf.mailer.SMTPMessageHandler.sendMessages(String)]:Not all emails were sent. Check that all recipients have not had their notification preference disabled because of an invalid email address

              FNDCPGSC525753.txt:[Jun 27, 2016 6:12:42 PM PHT]:1467022362562:-1:-1:ebiz03.hoi.com.ph:172.26.1.240:-1:-1:1:20420:SYSADMIN(0):-1:Thread[outboundThreadGroup1,5,outboundThreadGroup]:172.26.1.240:40097:1465802766659:11:ERROR:[SVC-GSM-WFMLRSVC-525753-10006 : oracle.apps.fnd.wf.mailer.SMTPMessageHandler.sendMessages(String)]:Not all emails were sent. Check that all recipients have not had their notification preference disabled because of an invalid email address

              FNDCPGSC525753.txt:[Jun 27, 2016 6:16:43 PM PHT]:1467022603323:-1:-1:ebiz03.hoi.com.ph:172.26.1.240:-1:-1:1:20420:SYSADMIN(0):-1:Thread[outboundThreadGroup1,5,outboundThreadGroup]:172.26.1.240:40097:1465802766659:11:ERROR:[SVC-GSM-WFMLRSVC-525753-10006 : oracle.apps.fnd.wf.mailer.SMTPMessageHandler.sendMessages(String)]:Not all emails were sent. Check that all recipients have not had their notification preference disabled because of an invalid email address

              FNDCPGSC525753.txt:[Jun 28, 2016 8:19:11 AM PHT]:1467073151739:-1:-1:ebiz03.hoi.com.ph:172.26.1.240:-1:-1:1:20420:SYSADMIN(0):-1:Thread[outboundThreadGroup1,5,outboundThreadGroup]:172.26.1.240:40097:1465802766659:11:ERROR:[SVC-GSM-WFMLRSVC-525753-10006 : oracle.apps.fnd.wf.mailer.SMTPMessageHandler.sendMessages(String)]:Not all emails were sent. Check that all recipients have not had their notification preference disabled because of an invalid email address

              FNDCPGSC525753.txt:[Jun 28, 2016 9:48:00 AM PHT]:1467078480484:-1:-1:ebiz03.hoi.com.ph:172.26.1.240:-1:-1:1:20420:SYSADMIN(0):-1:Thread[outboundThreadGroup1,5,outboundThreadGroup]:172.26.1.240:40097:1465802766659:11:ERROR:[SVC-GSM-WFMLRSVC-525753-10006 : oracle.apps.fnd.cp.gsc.Processor.performError(ProcessorException)]:Maximum number of errors have occurred for this processing thread.

               

               

              FNDCPGSC525753.txt:[Jun 16, 2016 1:44:25 PM PHT]:1466055865780:-1:-1:abc.com.ph:172.26.1.240:-1:-1:1:20420:SYSADMIN(0):-1:Thread[outboundThreadGroup1,5,outboundThreadGroup]:172.26.1.240:40097:1465802766659:11:ERROR:[SVC-GSM-WFMLRSVC-525753-10006 : oracle.apps.fnd.wf.mailer.SMTPMessageHandler.sendMessages(String)]:AddressException -> javax.mail.internet.AddressException: Missing '<' in string ``"\"Ba, Fe N\" <FeBa@abc.com>" <"Ba, Fe N" <FeBa@abc.com>>'' at position 102 ADDRESSES {"\"Ba, Fe N\" <FeBa@manitowoc.com>" <"Ba, Fe N" <FeBa@abc.com>>} -> ROLES {{WF_PON_ADD_USER_547351}}

              FNDCPGSC525753.txt:[Jun 23, 2016 12:23:04 PM

               

               

              FNDCPGSC525753.txt:[Jun 28, 2016 9:48:00 AM PHT]:1467078480483:-1:-1:ebiz03.hoi.com.ph:172.26.1.240:-1:-1:1:20420:SYSADMIN(0):-1:Thread[outboundThreadGroup1,5,outboundThreadGroup]:172.26.1.240:40097:1465802766659:11:UNEXPECTED:[SVC-GSM-WFMLRSVC-525753-10006 : oracle.apps.fnd.cp.gsc.Processor.run()]:java.lang.OutOfMemoryError: unable to create new native thread

              FNDCPGSC525753.txt:[Jun 28, 2016 9:48:00 AM PHT]:1467078480483:-1:-1:ebiz03.hoi.com.ph:172.26.1.240:-1:-1:1:20420:SYSADMIN(0):-1:Thread[outboundThreadGroup1,5,outboundThreadGroup]:172.26.1.240:40097:1465802766659:11:UNEXPECTED:[SVC-GSM-WFMLRSVC-525753-10006 : oracle.apps.fnd.cp.gsc.Processor.run()]:An unexpected RuntimeException or Throwable occurred -> java.lang.OutOfMemoryError: unable to create new native thread

              • 4. Re: Workflow mailer failed to send mails
                Beauty_and_dBest

                Hi Vish,

                 

                Which CM do I need to bounce?

                 

                Kind regards,

                • 5. Re: Workflow mailer failed to send mails
                  VishnuVinnakota

                  Simply bounce using adcmctl.sh stop apps/apps or you can bounce the Workflow specific 2 managers. I recommend bouncing all using adcmctl.sh.

                   

                  Follow the below for outofmemory issue:

                   

                  Workflow Service Fails With: java.lang.OutOfMemoryError: unable to create new native thread (Doc ID 842968.1)

                  Unable to Start Workflow Mailer Service (Doc ID 856229.1)


                  As per the 2nd note, keep 512m for xmx and try once.

                   

                  Thanks,

                  Vishnu

                  1 person found this helpful
                  • 6. Re: Workflow mailer failed to send mails
                    953361

                    Hi Jenna,

                     

                    Please navigate to Concurrent --> Manager --> Administer Page. Search for Workflow% under your concurrent manager name and you will see 3 different managers running for workflow try restarting each of them.

                    Again go to OAM and try starting workflow.

                     

                    Let me know if this help you.

                     

                    Thanks, Nish

                    1 person found this helpful
                    • 7. Re: Workflow mailer failed to send mails
                      Beauty_and_dBest

                      Thanks ALL,

                       

                      The services were available after we bounced the workflow mailer. However, we received advise from users that even if the services are up, there are some notifications not being received.


                      How do we track these unsent email notifications and resend them?



                      Kind regards,

                      • 8. Re: Workflow mailer failed to send mails
                        953361

                        Hi Jenna,

                         

                        You can query those notifications in WF_NOTIFICATIONS table where it will display all the notifications eighter they are sent or not.

                        You can select MAIL_STATUS,RECEIPENT_ROLE, etc... columns as per your requirement and it will show you eighter user has received emails or not.

                         

                        I hope this answers your question.

                         

                        Thanks, Nish

                        1 person found this helpful
                        • 9. Re: Workflow mailer failed to send mails
                          Beauty_and_dBest

                          Hi nish and ALL,

                           

                          After querying WF_NOTIFICATIONS, and we found out that it was not not sent. How do I resume it or resend it?

                           

                           

                          Kind regards,

                          • 10. Re: Workflow mailer failed to send mails
                            Samrat Sinha

                            Hi

                             

                            You can refer the below notes:

                            ----

                            If the message is processed successfully message will be enqueued to WF_NOTIFICATION_OUT queue, if it errored out it will be enqueued to WF_ERROR queue

                             

                            select wf.user_data.event_name Event_Name, wf.user_data.event_key Event_Key,

                            wf.user_data.error_stack Error_Stack, wf.user_data.error_message Error_Msg

                            from wf_error wf where wf.user_data.event_key = ‘

                            To check what all mails have went and which all failed ?

                             

                            Select from_user,to_user,notification_id, status, mail_status, begin_date

                            from WF_NOTIFICATIONS where status = ‘OPEN’;

                             

                            Select from_user, to_user, notification_id, status, mail_status,begin_date,USER_KEY,ITEM_KEY,MESSAGE_TYPE,MESSAGE_NAME begin_date

                            from WF_NOTIFICATIONS where status = ‘OPEN’;

                            Use the following query to check to see if the messages are stuck

                             

                            SQL> select message_type, count(1) from wf_notifications

                            where status=’OPEN’ and mail_status=’MAIL’ group by message_type;

                            E.g o/p of query –

                             

                            MESSAGE_Type COUNT(1)

                            ——– ———-

                            POAPPRV 11 — 11 mails of Po Approval not sent —

                            INVTROAP 12

                            REQAPPRV 9

                            WFERROR 45 — 45 mails have error

                             

                            If Mail not received by User

                             

                            select Name,DISPLAY_NAME,EMAIL_ADDRESS,NOTIFICATION_PREFERENCE,STATUS

                            from wf_users where DISPLAY_NAME=’xxx,yyy’ ;

                             

                            Status – Active

                            Notification_preference-> Mailtext

                            Email Address should not be null

                             

                            Notification not sent waiting to be mailed ?

                             

                            SQL> select notification_id, status, mail_status, begin_date from WF_NOTIFICATIONS

                            where status = ‘OPEN’ and mail_status = ‘MAIL’;

                             

                            To debug the notification id ?

                            $FND_TOP/sql

                            run wfmlrdbg.sql

                            ******************************

                            Note: 1054215.1 – How to Check if the Workflow Mailer is Running

                            Note: 415516.1 – How to Check Whether Notification Mailer is Working or Not

                             

                             

                            Note: 831982.1 – 11i/R12 – A guide for troubleshoting Workflow Notification Emails – Inbound and Outbound

                            Note: 1012344.7 – Notifications Not Being Sent In Workflow

                            Note: 560472.1 – Workflow Mailers Not Sending Notifications

                             

                            Hope this will help.

                             

                            Thanks

                            1 person found this helpful