3 Replies Latest reply on Dec 10, 2019 4:37 AM by Steff2-Oracle

    [Deployer:149150]An IOException occurred while reading the input. : with response code '501' : with response message 'Unsupported method ('POST')'

    Carlos Reyes-Oracle

      Hi community,

       

      I am trying to activate() changes on my weblogic 12.1 ( I am just trying to set some Ciphers configuration) This setup is in 2 machines, and we are getting the below exception, This is what I have already discarted

       

      1. There is not issue with the dates or ntp server
      2. There is not issue with the config.xml listen address.
      3. There is not issue with proxy or any java version.

       

      I have tried to do this in interactive and non interactive mode, and dumpStack is not returning any information on WLS. Please help !

       

      ===========WLST interactive console =============

      wls:/ecradomain/edit/Servers/EcraServer1/SSL/EcraServer1> activate()

      <file-top>: sys originalErr=

      <single-top>: activate

      Activating all your changes, this may take a while ...

      The edit lock associated with this edit session is released

      once the activation is completed.

      <file-top>: evaluatePrompt

      This Exception occurred at Thu Nov 28 19:03:19 PST 2019.

      java.lang.RuntimeException: Timed out waiting for completion:  Activate State: STATE_DISTRIBUTING Target Servers States: EcraServer2 STATE_FAILED EcraServer1 STATE_FAILED AdminServer STATE_FAILED

      Traceback (innermost last):

        File "<console>", line 1, in ?

        File "<iostream>", line 358, in activate

        File "<iostream>", line 552, in raiseWLSTException

      WLSTException: Error occurred while performing activate : Error while Activating changes. : Timed out waiting for completion:  Activate State: STATE_DISTRIBUTING Target Servers States: EcraServer2 STATE_FAILED EcraServer1 STATE_FAILED AdminServer STATE_FAILED

      Use dumpStack() to view the full stacktrace :

      <file-top>: sys originalErr

      <file-top>: restoreDisplay

      wls:/ecradomain/edit/Servers/EcraServer1/SSL/EcraServer1>

       

       

       

       

      ==================== AdminServer.log ===============================

      ####<Nov 28, 2019 2:23:41 PM PST> <Warning> <Management> <den00ucw> <AdminServer> <[STANDBY] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <weblogic> <> <> <1574979821539> <BEA-141300> <The activate changes operation for request "9,375,851,825,312,110" could not be completed because the activate timed out. Detailed state info is:

      Activate State: STATE_FAILED Target Servers States: EcraServer2 STATE_FAILED EcraServer1 STATE_FAILED AdminServer STATE_FAILED

      Begin-time: 1574979521443, End-time: 1574979821444, Activate-timeout: 1574979821443

      User: principals=[weblogic, Administrators], Description: Activate task with id: 9375851825312110

      Activate-Exception: java.lang.RuntimeException: Timed out waiting for completion:  Activate State: STATE_DISTRIBUTING Target Servers States: EcraServer2 STATE_FAILED EcraServer1 STATE_FAILED AdminServer STATE_FAILED

      Failed-server: EcraServer2, Reason: java.rmi.RemoteException: [Deployer:149150]An IOException occurred while reading the input. : with response code '501' : with response message 'Unsupported method ('POST')'

      Failed-server: EcraServer1, Reason: java.rmi.RemoteException: [Deployer:149150]An IOException occurred while reading the input. : with response code '501' : with response message 'Unsupported method ('POST')'

      Edit-owner: principals=[weblogic, Administrators], Exclusive: false, Acquired: 1574905853418, Expire: 0

      Activate-changes: weblogic.management.configuration.SSLMBeanImpl@54a365c5([ecradomain]/Servers[AdminServer]/SSL[AdminServer]) (4 updateSet)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384)(Dynamic=true)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384)(Dynamic=true)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256)(Dynamic=true)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256)(Dynamic=true)

      weblogic.management.configuration.SSLMBeanImpl@83e24c29([ecradomain]/Servers[EcraServer2]/SSL[EcraServer2]) (4 updateSet)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384)(Dynamic=true)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384)(Dynamic=true)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256)(Dynamic=true)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256)(Dynamic=true)

      weblogic.management.configuration.SSLMBeanImpl@c2fc9bab([ecradomain]/Servers[EcraServer1]/SSL[EcraServer1]) (4 updateSet)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384)(Dynamic=true)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384)(Dynamic=true)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256)(Dynamic=true)

        Ciphersuites (ADD TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256)(Dynamic=true)

      Sub-Task: true, Waiting-fail: true, Deploy-succeeded: false, Commit-succeeded: false, Commit-failed: false, Have-config: true

      Thread Dumps on servers [EcraServer1] {

       

       

      ThreadDump for EcraServer1:

      "DynamicJSSEListenThread[DefaultSecure]" Id=61 RUNNABLE (in native)

              at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)

              at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)

              at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)

              -  locked java.lang.Object@13a2af5b

              at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:31)

       

      "[STANDBY] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'" Id=60 WAITING on weblogic.work.ExecuteThread@272e6eee

              at java.lang.Object.wait(Native Method)

              -  waiting on weblogic.work.ExecuteThread@272e6eee

              at java.lang.Object.wait(Object.java:502)

              at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:247)

              at weblogic.work.ExecuteThread.run(ExecuteThread.java:281)

       

       

       

       

      "MTUTimer" Id=58 TIMED_WAITING on java.util.TaskQueue@61fc76b5

              at java.lang.Object.wait(Native Method)

              -  waiting on java.util.TaskQueue@61fc76b5

              at java.util.TimerThread.mainLoop(Timer.java:552)

              at java.util.TimerThread.run(Timer.java:505)

       

       

       

       

      "Timer-12" Id=57 TIMED_WAITING on java.util.TaskQueue@12e4aba1

              at java.lang.Object.wait(Native Method)

              -  waiting on java.util.TaskQueue@12e4aba1

              at java.util.TimerThread.mainLoop(Timer.java:552)

              at java.util.TimerThread.run(Timer.java:505)

       

       

       

       

      "Timer-11" Id=56 TIMED_WAITING on java.util.TaskQueue@14ba16d1

              at java.lang.Object.wait(Native Method)

              -  waiting on java.util.TaskQueue@14ba16d1

              at java.util.TimerThread.mainLoop(Timer.java:552)

              at java.util.TimerThread.run(Timer.java:505)

                                                                                                                                                                                                       4891,2-9      66%

        • 1. Re: [Deployer:149150]An IOException occurred while reading the input. : with response code '501' : with response message 'Unsupported method ('POST')'
          Steff2-Oracle

          Hello,

           

          Please, can you tell us what happens when both EcraServer1 & EcraServer2 managed servers are stopped,

          are you able to make the changes and activate them ?

           

          -

           

          Please, try to shutdown all the WLS processes : AdminServer, managed servers and Node Manager.

          Next, clean up their respective logs, cache and tmp directories,

          then, start just the AdminServer, make sure there is no pending change left in "View changes and restarts",

          then perform your actual changes and activate them.

          Does it work at that point ?

           

          Then, later, start Node Manager then your managed servers.

           

          With Best Regards,

          Stephan

          • 2. Re: [Deployer:149150]An IOException occurred while reading the input. : with response code '501' : with response message 'Unsupported method ('POST')'
            Carlos Reyes-Oracle

            HI Stephan,

             

            Thank you very much for your answer, This is the status of this:

             

            1. After stopping both servers, and using WLST interavtive console, the changes were saved and activated correctly
            2. For some reason, while the servers are up an runnning the chagnes are unable to be applied.
            3. Also, if we try to deploy a war file, it fails with the same error, as the war deploymnet requires the servers to be up and running.

            Something is prevenving to communicate with the http connection. Do you have an idea what could be ?

             

            Thanks !

            • 3. Re: [Deployer:149150]An IOException occurred while reading the input. : with response code '501' : with response message 'Unsupported method ('POST')'
              Steff2-Oracle

              Hello,

              Thank you for trying to activate the changes when the managed servers are down.
              Yet, I can understand the problem you face with the war deployment.

              Question : Have you applied the latest PSU for your version of WLS , as indicated in the Note 1470197.1 ?
                         https://support.oracle.com/epmos/faces/DocumentDisplay?id=1470197.1
              NB: Remember that the Read Me file tells you to also upgrade the JDK.

              Then, if you are running specifically WLS 10.3.6, then apply the patch 15997291 - NEED ABILITY TO BYPASS PROXY SERVER FOR DEPLOYMENT SERVICE HTTP CONNECTIONS .
              It should help in this case.

              If you run your environment with a cluster set on different hosts,
              then it is very possible that the time on the physical host(s) is not in sync.
              In which case, please verify that the time is synchronized between all hosts.
              One example would be to run ntp protocol in the environment.
              Then, make sure that changes can then be activated on each managed server.

              Another known case, is if you run managed servers without Listen Addresses specified.
              The server Listen Address must be specified.
              Then, make sure the "Listen address" field for all servers is set to Fully Qualified domain name.
              After this change, the servers need to be restarted and you should be able to make changes and activate
              both from WebLogic console and from WLST when all servers are up and running.
              To do this change, please follow below steps:
              1. Login to the WebLogic console using Admin user credentials
              2. Go to Environment -> Servers -> AdminServer -> Configuration -> General and set the Listen Address to Full qualified domain name or IP Address.
              3. Save and activate the changes.
              4. Repeat Step 2 for all managed servers and save and activate.
              5. Restart the AdminServer followed by managed servers.

              NB: as you saw already, the workaround if you can't specify a specific listen address is to shutdown all managed servers and just keep the AdminServer running.
              Make changes and Save and Activate. Once the changes are activated, start the managed servers back up.

              With Best Regards,
              Stephane