1 2 Previous Next 21 Replies Latest reply on Nov 24, 2009 2:45 PM by 736834

    OSB 10gR3 - Starting Managed server on remote machine

    lyallp-80952
      I have 2 Windows 2003 Enterprise machines.
      I have OSB 10gR3 installed on both with Node Manager running on default port, on both.
      I create the servicebustutorial domain and start the admin server on the first machine.
      On the second machine, I use the WLST to
      <ul><li>connect('weblogic','password','t3://xxx.xxx.xxx.xxx:7001') # connect to admin server on first machine
      </li>
      <li>nmEnroll('c:/bea/wlserver_10.3/common/nodemanager') # make node manager visible
      </li>
      <li>nmEnroll('c:/bea/user_projects/domains/servicebustutorial') # enroll in the servicebustutorial</li>
      </ul>
      Now, I don't know if this is the correct thing to do.
      Back on the first machine, I create a new machine to represent the second Windows box.
      I can see the node manager on the second machine using the machine monitoring page.
      I then create a new server that is assigned to the new machine.
      I can attempt to start the new server on the second machine.
      The Server directory appears in the servers directory on the second windows box.
      Log files appear on the second box but the config.xml is not there, and thus, the server fails to start.
      I would have thought that the server config would have propogated from the admin server, is this a wrong assumption?
      What am I doing wrong?

      Thanks, in advance.

      ...Lyall
        • 1. Re: OSB 10gR3 - Starting Managed server on remote machine
          lyallp-80952
          Ok, I found the documentation.
          [How do I create and start a managed server on a remote machine?| http://download.oracle.com/docs/cd/E12840_01/common/docs103/pack/tasks.html]

          Of course, I follow this, now I have the boot.properties invalid message, which I have asked about in a separate thread.

          ...Lyall
          • 2. Re: OSB 10gR3 - Starting Managed server on remote machine
            687374
            On the remote machine delete everything under the <domain-home>/servers directory and create a boot.properties file in <domain-home>

            The boot.properties file is cached under <domain-home>\servers\<server-name>\security
            • 3. Re: OSB 10gR3 - Starting Managed server on remote machine
              lyallp-80952
              For that matter, I cannot even start a Managed server on the Local machine, let alone the remote machine.

              This is based upon using the config wizard on a clean install of OSB, creating one machine to represent the main machine and assigning both the admin server and managed server to the machine.

              Admin server starts fine, the managed server does not.

              I have selected a few warnings, notices, alerts and errors that I see in the log files of both the admin server and the managed server, on the main machine. Are any of these significant?

              Thanks, in advance

              ...Lyall


              Admin Server log_

              ####<Mar 5, 2009 3:23:47 AM CST> <Warning> <Server> <osb-core> <AdminServer> <DynamicListenThread[Default]> <<WLS Kernel>> <> <> <1236185627719> <BEA-002611> <Hostname "osb-core", maps to multiple IP addresses: 999.999.999.999, 127.0.0.1> (deliberatly obscured)

              ####<Mar 5, 2009 3:23:51 AM CST> <Warning> <WorkManager> <osb-core> <AdminServer> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1236185631500> <BEA-002919> <Unable to find a WorkManager with name weblogic.wsee.mdb.DispatchPolicy. Dispatch policy weblogic.wsee.mdb.DispatchPolicy will map to the default WorkManager for the application bea_wls9_async_response>

              ####<Mar 5, 2009 3:23:46 AM CST> <Info> <Security> <osb-core> <AdminServer> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<anonymous>> <> <> <1236185626281> <BEA-090516> <The Authenticator provider has preexisting LDAP data.>

              ####<Mar 5, 2009 3:23:46 AM CST> <Alert> <OSB Security> <osb-core> <AdminServer> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<anonymous>> <> <> <1236185626531> <BEA-387068> <There is no PKI credential mapper provider configured in your security realm. Service key provider management will be disabled. Configure a PKI credential mapper provider if you need service provider support. This is typically the case if you have Oracle Service Bus proxy services with web service security enabled or outbound 2-way SSL connections.>

              ####<Mar 5, 2009 7:55:25 PM CST> <Error> <NodeManager> <osb-core> <AdminServer> <[ACTIVE] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1236245125078> <BEA-300048> <Unable to start the server Strategic : Exception while starting server 'Strategic': java.io.IOException: Server failed to start up. See server output log for more details.>

              ####<Mar 5, 2009 7:57:31 PM CST> <Error> <NodeManager> <osb-core> <AdminServer> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1236245251922> <BEA-300048> <Unable to start the server Strategic : Exception while starting server 'Strategic': java.io.IOException: Server failed to start up. See server output log for more details.>



              Server log_


              ####<Mar 5, 2009 7:57:30 PM CST> <Critical> <Security> <osb-core> <Strategic> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1236245250844> <BEA-090402> <Authentication denied: Boot identity not valid; The user name and/or password from the boot identity file (boot.properties) is not valid. The boot identity may have been changed since the boot identity file was created. Please edit and update the boot identity file with the proper values of username and password. The first time the updated boot identity file is used to start the server, these new values are encrypted.>

              ####<Mar 5, 2009 7:57:30 PM CST> <Critical> <WebLogicServer> <osb-core> <Strategic> <Main Thread> <<WLS Kernel>> <> <> <1236245250859> <BEA-000386> <Server subsystem failed. Reason: weblogic.security.SecurityInitializationException: Authentication denied: Boot identity not valid; The user name and/or password from the boot identity file (boot.properties) is not valid. The boot identity may have been changed since the boot identity file was created. Please edit and update the boot identity file with the proper values of username and password. The first time the updated boot identity file is used to start the server, these new values are encrypted.
              weblogic.security.SecurityInitializationException: Authentication denied: Boot identity not valid; The user name and/or password from the boot identity file (boot.properties) is not valid. The boot identity may have been changed since the boot identity file was created. Please edit and update the boot identity file with the proper values of username and password. The first time the updated boot identity file is used to start the server, these new values are encrypted.
                   at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.doBootAuthorization(Unknown Source)
                   at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.initialize(Unknown Source)
                   at weblogic.security.service.SecurityServiceManager.initialize(Unknown Source)
                   at weblogic.security.SecurityService.start(SecurityService.java:141)
                   at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
                   at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
                   at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
              >
              • 4. Re: OSB 10gR3 - Starting Managed server on remote machine
                667017
                The first 4 messages are probably ok (we see them in our environments), but the last 2 (IOException) are curious. Are the permissions throughout ${domain.home} such that the user running the managed server can read and write all files? Also checkout WL_HOME/common/nodemanager and make sure all the files have correct permissions. There should also be a NodeManager log file in there which might contain more information.

                As a last resort, you can enable debug on the server from the Admin console. You'll get loads of output but it may be helpful. Just open the Admin console (http://server:port/console) and go to Environment -> Servers -> SERVERNAME -> Debug tab. You might start with just enabling debug for weblogic.management and weblogic.security.

                There is a way to enable NodeManager debug as well, I think by just changing the LogLevel to DEBUG in WL_HOME/common/nodemanager/nodemanager.properties. Im not 100% sure on this one though.
                • 5. Re: OSB 10gR3 - Starting Managed server on remote machine
                  lyallp-80952
                  Thanks for replying.
                  I login as a local administrator on the machine that WebLogic runs. All operations are performed using that login (starting admin server, starting node manager).
                  I changed permissions on C:\BEA, all the way down, localadmin group has full control, everywhere.
                  I tried changing nodemanager C:\bea\wlserver_10.3\common\nodemanager\nodemanager.properties LogLevel to DEBUG but then NodeManager refuses to start, so I returned it back to INFO.
                  I set debug on the Managed Server I am trying to setup, as you suggested.
                  I even updated the NodeManager and Server boot.properties files to be cleartext and Deleted the LDAP directory within the Managed Server (as I assume it's re-created if it does not exist)

                  Wow, heaps comes out, but the following may be relevant.
                  In particular, this single line, causes concern.

                  bq. ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE \\ ExecuteThread: '0' for queue: 'weblogic.kernel.Default \\ (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; \\ &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;[Security:090295 |http://forums.oracle.com//]caught unexpected exception&gt;
                  It's an unexpected exception but it's not an Error and only reported as a Debug! I could be climbing up the wrong tree, but the following log output is what immediately precedes the login failure.

                  bq.      ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820219&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.LoginModuleWrapper.wrap ClassLoader=java.net.URLClassLoader@1f0e58&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820219&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.LoginModuleWrapper.wrap ControlFlag=LoginModuleControlFlag: required&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820219&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.JAASLoginServiceImpl.login created LoginContext&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820219&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.JAASLoginServiceImpl.login ThreadContext ClassLoader Current=sun.misc.Launcher$AppClassLoader@124dfc&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820234&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.LoginModuleWrapper.initialize LoginModuleClassName=weblogic.security.providers.authentication.LDAPAtnLoginModuleImpl&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820234&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.LoginModuleWrapper.initialize ClassLoader=java.net.URLClassLoader@1f0e58&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820234&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.LoginModuleWrapper.initialize created delegate login module&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820234&gt; &lt;BEA-000000&gt; &lt;LDAP ATN LoginModule initialized&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820234&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.LoginModuleWrapper.initialize delegated&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820234&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.LoginModuleWrapper.login&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820250&gt; &lt;BEA-000000&gt; &lt;LDAP Atn Login&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820250&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.CallbackHandlerWrapper.handle&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820250&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.CallbackHandlerWrapper.handle callbcacks[0] will be delegated&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820250&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.CallbackHandlerWrapper.handle callbcacks[0] will use NameCallback to retrieve name&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820250&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.CallbackHandlerWrapper.handle callbcacks[1] will be delegated&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820250&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.CallbackHandlerWrapper.handle will delegate all callbacks&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820250&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.CallbackHandlerWrapper.handle delegated callbacks&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820250&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.CallbackHandlerWrapper.handle got username from callbacks[0], UserName=weblogic&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820250&gt; &lt;BEA-000000&gt; &lt;LDAP Atn Login username: weblogic&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820281&gt; &lt;BEA-000000&gt; &lt;new LDAP connection to host 134.251.218.157 port 7001 use local connection is true&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820281&gt; &lt;BEA-000000&gt; &lt;created new LDAP connection LDAPConnection { ldapVersion:2 bindDN:""}&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;connection succeeded&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;getConnection return conn:LDAPConnection { ldapVersion:2 bindDN:""}&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;authenticate user:weblogic&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;getDNForUser search("ou=people,ou=myrealm,dc=Tester", "(&(uid=weblogic)(objectclass=person))", base DN & below)&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;[Security:090295|http://forums.oracle.com/forums/]caught unexpected exception&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.LoginModuleWrapper.commit&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;LDAP Atn Abort&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;com.bea.common.security.internal.service.LoginModuleWrapper.commit delegated, returning false&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityAtn&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;weblogic.security.service.internal.WLSJAASLoginServiceImpl$ServiceImpl.authenticate authenticate failed for user weblogic&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityUserLockout&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;weblogic.security.service.internal.UserLockoutServiceImpl$ServiceImpl.isLocked(weblogic)&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityUserLockout&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820297&gt; &lt;BEA-000000&gt; &lt;weblogic.security.service.internal.UserLockoutServiceImpl$ServiceImpl.logFailure(weblogic)&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityUserLockout&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820312&gt; &lt;BEA-000000&gt; &lt;weblogic.security.service.internal.UserLockoutServiceImpl$ServiceImpl.logFailure(weblogic) UserLockout Login failure for user in realm myrealm&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityUserLockout&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820312&gt; &lt;BEA-000000&gt; &lt;weblogic.security.service.internal.UserLockoutServiceImpl$ServiceImpl.getInvaliLoginUsersHighCount()&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityUserLockout&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820312&gt; &lt;BEA-000000&gt; &lt;weblogic.security.service.internal.UserLockoutServiceImpl$ServiceImpl.logFailure(weblogic) User weblogic has 1 failures in realm myrealm&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityUserLockout&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820312&gt; &lt;BEA-000000&gt; &lt;weblogic.security.service.internal.UserLockoutServiceImpl$ServiceImplUserLockout InvalidLogin Record GC not needed&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityUserLockout&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820312&gt; &lt;BEA-000000&gt; &lt;weblogic.security.service.internal.UserLockoutServiceImpl$ServiceImpl.logFailure(weblogic) UserLockout About to multicast login failure for user SecurityMessage realm:myrealm record:SecurityMulticastRecord: origin: Strategic realmName: myrealm seqnum: 1 timestamp: Mar 6, 2009 8:50:20 PM username: weblogic nextSeqNo:1&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Debug&gt; &lt;SecurityUserLockout&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820312&gt; &lt;BEA-000000&gt; &lt;weblogic.security.service.internal.UserLockoutServiceImpl$ServiceImplUserLockout Can't create multicastSession because ClusterServices are unavailable&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Critical&gt; &lt;Security&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;ACTIVE ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820312&gt; &lt;BEA-090402&gt; &lt;Authentication denied: Boot identity not valid; The user name and/or password from the boot identity file (boot.properties) is not valid. The boot identity may have been changed since the boot identity file was created. Please edit and update the boot identity file with the proper values of username and password. The first time the updated boot identity file is used to start the server, these new values are encrypted.&gt; \\     ####&lt;Mar 6, 2009 8:50:20 PM CST&gt; &lt;Critical&gt; &lt;WebLogicServer&gt; &lt;osb-strat&gt; &lt;Strategic&gt; &lt;Main Thread&gt; &lt;&lt;WLS Kernel&gt;&gt; &lt;&gt; &lt;&gt; &lt;1236334820312&gt; &lt;BEA-000386&gt; &lt;Server subsystem failed. Reason: weblogic.security.SecurityInitializationException: Authentication denied: Boot identity not valid; The user name and/or password from the boot identity file (boot.properties) is not valid. The boot identity may have been changed since the boot identity file was created. Please edit and update the boot identity file with the proper values of username and password. The first time the updated boot identity file is used to start the server, these new values are encrypted. \\     weblogic.security.SecurityInitializationException: Authentication denied: Boot identity not valid; The user name and/or password from the boot identity file (boot.properties) is not valid. The boot identity may have been changed since the boot identity file was created. Please edit and update the boot identity file with the proper values of username and password. The first time the updated boot identity file is used to start the server, these new values are encrypted. \\     at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.doBootAuthorization(Unknown Source) \\     at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.initialize(Unknown Source) \\     at weblogic.security.service.SecurityServiceManager.initialize(Unknown Source) \\     at weblogic.security.SecurityService.start(SecurityService.java:141) \\     at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64) \\     at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201) \\     at weblogic.work.ExecuteThread.run(ExecuteThread.java:173) \\     &gt;
                  • 6. Re: OSB 10gR3 - Starting Managed server on remote machine
                    667017
                    Yeah, the debug gives you quite a bit, so I recommend only turning it on at the last second and immediately disabling it. So a few questions:

                    -Is the user weblogic locked out in LDAP (or AD)?
                    -What does the node manager log file show during the failed login?
                    -Can you start the managed server using the start script (in effect, bypassing NM all together):
                    cd ${domain.home}/bin
                    ./startManagedWebLogic.sh <Managed_Server_Name> <Admin_URL>
                    • 7. Re: OSB 10gR3 - Starting Managed server on remote machine
                      lyallp-80952
                      The weblogic install does not include any integration with AD or LDAP systems.
                      Vanilla, straight out of the box, defaults on almost everything, except I installed the demos/samples.

                      node manager logs show nothing (I assume I am looking in the right place, BEA_HOME/logs)

                      I manually started a managed server on the Admin Machine, it did not ask for a user/password and started!

                      I manually started a managed server on a remote Machine, it did ask for a user/password, spent about 5 minutes 'starting' then failed.

                      bq. &lt;WSEE:15&gt;Warning: JMS queue 'weblogic.wsee.DefaultQueue' is not found, as a result, Web Service async responses via jms transport is not supported. If the target service uses JMS transport, the responses will not be able to come back.&lt;JmsQueueListener.connect:287&gt; \\ &lt;Mar 10, 2009 6:01:12 PM CST&gt; &lt;Notice&gt; &lt;Log Management&gt; &lt;BEA-170027&gt; &lt;The Server \\ has established connection with the Domain level Diagnostic Service successfully.&gt; \\ &lt;Mar 10, 2009 6:01:13 PM CST&gt; &lt;Critical&gt; &lt;WebLogicServer&gt; &lt;BEA-000362&gt; &lt;Server failed. Reason: [JTAExceptions:119002]A logging last resource failed during initialization. The server cannot boot unless all configured logging last resources (LLRs) initialize. Failing reason: \\ weblogic.common.ResourceException: 0:Could not create pool connection. The DBMS driver exception was: com/pointbase/session/sessionManager&gt; \\ &lt;Mar 10, 2009 6:01:13 PM CST&gt; &lt;Notice&gt; &lt;WebLogicServer&gt; &lt;BEA-000365&gt; &lt;Server state changed to FAILED&gt; \\ &lt;Mar 10, 2009 6:01:13 PM CST&gt; &lt;Error&gt; &lt;WebLogicServer&gt; &lt;BEA-000383&gt; &lt;A criticalservice failed. The server will shut itself down&gt; \\ &lt;Mar 10, 2009 6:01:13 PM CST&gt; &lt;Notice&gt; &lt;WebLogicServer&gt; &lt;BEA-000365&gt; &lt;Server state changed to FORCE_SHUTTING_DOWN&gt; \\ &lt;Mar 10, 2009 6:01:15 PM CST&gt; &lt;Error&gt; &lt;netuix&gt; &lt;BEA-423443&gt; &lt;Exception while initializing SingleFileServlet: [java.lang.reflect.InvocationTargetException].
                      Ok, so, knowing I can attempt starting the servers manually, I will try a nice fresh re-install and see what happens.
                      I will keep you informed.
                      Thanks for the help.

                      ...Lyall
                      • 8. Re: OSB 10gR3 - Starting Managed server on remote machine
                        667017
                        The NM log file is at WL_HOME/common/nodemanager/nodemanager.log
                        • 9. Re: OSB 10gR3 - Starting Managed server on remote machine
                          lyallp-80952
                          I give up, going to check out open source instead.
                          • 10. Re: OSB 10gR3 - Starting Managed server on remote machine
                            Betino
                            Wait,

                            domain is in production or development mode?

                            Copy your entire domain directory to remote machine, start node manager and start the managed server from Admin console.

                            If you have /opt/bea/user_projects/your_domain_name in machine A then be sure you have /opt/bea/user_projects/your_domain_name in remote machine.

                            Don't give up :)
                            • 11. Re: OSB 10gR3 - Starting Managed server on remote machine
                              lyallp-80952
                              I am running in developer mode.
                              I followed the pack/unpack instructions for packing up and shipping a domain to a different machine. [http://download.oracle.com/docs/cd/E12840_01/common/docs103/pack/tasks.html]
                              Even that didn't work.
                              I can hear that Peter Gabriel/Kate Bush song in the distance...

                              ...Lyall
                              • 12. Re: OSB 10gR3 - Starting Managed server on remote machine
                                Betino
                                Well, I think you doesn't need boot.properties in development mode.

                                Try only copy and paste directory domain, not pack/unpack.

                                Regards.
                                • 13. Re: OSB 10gR3 - Starting Managed server on remote machine
                                  628798
                                  My experience is you have to start the Managed Server independently at the first time, and then you can start the Managed Server remotely.
                                  • 14. Re: OSB 10gR3 - Starting Managed server on remote machine
                                    lyallp-80952
                                    Makes the whole node manager/Admin console pointless, doesn't it?

                                    ...Lyall
                                    1 2 Previous Next