4 Replies Latest reply on May 7, 2015 10:06 PM by GravyKing

    adoafmctl.sh: exiting with status 204

    GravyKing

      R12.1.3 on RH Linux 5.10.

      Just cloned this environment and thought everything went well but don't recall ever having this issue before.

      Starting OPMN managed OAFM OC4J instance  ...

       

      adoafmctl.sh: exiting with status 204

       

      ---------------------------------+--------------------+---------+---------

      ias-component                    | process-type       |     pid | status

      ---------------------------------+--------------------+---------+---------

      OC4JGroup:default_group          | OC4J:oafm          |     N/A | Down

      OC4JGroup:default_group          | OC4J:forms         |   30195 | Alive

      OC4JGroup:default_group          | OC4J:oacore        |   30042 | Alive

      HTTP_Server                      | HTTP_Server        |   29982 | Alive

       

      I can login and if I wasn't paying attention I'm not sure I would have notice this failing at startup.

      I've shutdown, removed the files in $INST_TOP/ora/10.1.3/j2ee/forms/persistence/* (along with 1 other directories) and run autoconfig without error.

       

      - check adoafmctl log

      vi $LOG_HOME/appl/admin/log/adoafmctl.txt

      05/07/15-11:53:17 :: adoafmctl.sh: Starting OPMN managed OAFM OC4J instance

      opmnctl: starting opmn managed processes...

      --------------------------------------------------------------------------------

      ias-component/process-type/process-set:

          default_group/oafm/default_group/

      Error

      --> Process (index=1,uid=1803696026,pid=0)

          no port available from the port range

          failed to start a managed process after the maximum retry limit

          no port available from the port range

          no port available from the port range

          Log:

          none

      05/07/15-11:53:17 :: adoafmctl.sh: exiting with status 204

      ================================================================================

       

      vi $LOG_HOME/ora/10.1.3/opmn/opmn.log

      15/05/07 11:53:17 [pm-process] Starting Process: default_group~oafm~default_group~1 (1803696026:0)

      15/05/07 11:53:17 [libopmnoc4j] Attempt to obtain port of type: rmi failed for an OC4J process

      15/05/07 11:53:17 [libopmnoc4j] Attempt to get ports for proc: 1803696026 failed

       

      So now I just need a little help in how to troubleshoot this.

        • 1. Re: adoafmctl.sh: exiting with status 204
          Bashar.

          Hi,

           

          Have you checked the following document:

          After Concurrent Manager Started, oc4j Startup Script Failed for no available port of oc4j process (Doc ID 1913738.1)

           

          Also check the ports used by oc4j to see if any other process is using them.

          netstat -a | grep <port_num>

           

          Regards,

          Bashar

          • 2. Re: adoafmctl.sh: exiting with status 204
            GravyKing

            Hey Bashar,

             

            Yah I looked at that ID along with 813813.1 but that suggests the files would be empty which is not the case.

            If I am using port pool 3 and the portpool.lst files show this, what ports am I checking?

            Database Port  :  1524  (EXT_PORT)

            RPC Port  :  1629

            Web SSL Port  :  4446

            ONS Local Port  :  6103

            ONS Remote Port  :  6203

            ONS Request Port  :  6503

            Web Listener Port  :  8003

            Active Web Port  :  8003  (DUP_PORT)

            Forms Port  :  9003

            Metrics Server Data Port  :  9103

            Metrics Server Request Port  :  9203

            JTF Fulfillment Server Port  :  9303

            MSCA Server Port  :  10218-10223

            MCSA Telnet Server Port  :  10218,10220,10222  (DUP_PORT)

            MSCA Dispatcher Port  :  10809

            Java Object Cache Port  :  12348

            OC4J JMS Port Range for Oacore  :  23015-23019

            OC4J JMS Port Range for Forms  :  23515-23519

            OC4J JMS Port Range for Home  :  24015-24019

            OC4J JMS Port Range for Oafm  :  24515-24519

            OC4J JMS Port Range for Forms-c4ws  :  26515-26519

            OC4J AJP Port Range for Oacore  :  21515-21519

            OC4J AJP Port Range for Forms  :  22015-22019

            OC4J AJP Port Range for Home  :  22515-22519

            OC4J AJP Port Range for Oafm  :  25015-25019

            OC4J AJP Port Range for Forms-c4ws  :  26015-26019

            OC4J RMI Port Range for Oacore  :  20015-20019

            OC4J RMI Port Range for Forms  :  20515-20519

            OC4J RMI Port Range for Home  :  21015-21019

            OC4J RMI Port Range for Oafm  :  25515-25519

            OC4J RMI Port Range for Forms-c4ws  :  27515-27519

             

            Example.  I do have two other instances running using port pools 1 and 2

            [root~]# netstat -a | grep 250

            tcp        0      0 *:25010                     *:*                         LISTEN

            tcp        0      0 iasxxxxxxxx:25010 iasxxxxxxxxxxx:18638 TIME_WAIT

            tcp        0      0 iasxxxxxxxx:25010 iasxxxxxxxxxxx:18650 TIME_WAIT

            tcp        0      0 iasxxxxxxxx:25010 iasxxxxxxxxxxx:18620 TIME_WAIT

            unix  3      [ ]         STREAM     CONNECTED     117502508

            unix  3      [ ]         STREAM     CONNECTED     117502507

            unix  3      [ ]         STREAM     CONNECTED     117502506

            unix  3      [ ]         STREAM     CONNECTED     117502505

            • 3. Re: adoafmctl.sh: exiting with status 204
              GravyKing

              If I check Port Pool 3 for just Oa related entries I get this:

              ->cat ${INST_TOP}/admin/out/portpool.lst | grep Oa

              OC4J JMS Port Range for Oacore  :  23015-23019

              OC4J JMS Port Range for Oafm  :  24515-24519

              OC4J AJP Port Range for Oacore  :  21515-21519

              OC4J AJP Port Range for Oafm  :  25015-25019

              OC4J RMI Port Range for Oacore  :  20015-20019

              OC4J RMI Port Range for Oafm  :  25515-25519

               

              And I I step through those entries I can see where port 25515 is listed here and is owned by another user.

              # lsof -i:25515

              COMMAND   PID     USER   FD   TYPE    DEVICE SIZE/OFF NODE NAME

              java    25425 applxxx  190u  IPv4 115324777      0t0  TCP myappserver:25515->dbserver:ricardo-lm (ESTABLISHED)

               

              So I hope that is my culprit and I just need to work with my client to see if I can shutdown that instance or perhaps just stop via adoafmctl.sh and then see if it gets released?

              • 4. Re: adoafmctl.sh: exiting with status 204
                GravyKing

                I did this and it seemed to work so I think that port 25515 issue was a red hearing as it's still there.

                cd $ORA_CONFIG_HOME/10.1.3/j2ee/oacore

                rm -rf persistence

                mkdir persistence

                 

                I did an "rm -r $INST_TOP/ora/10.1.3/j2ee/oacore/persistence/*" earlier but perhaps there is a hidden file that deleting and recreating the directory fixes?