5 Replies Latest reply: Dec 4, 2012 4:25 AM by Nicolas.Gasparotto RSS

    PSWATCHSRV does not auto-restart causing app server domain instability

    974967
      Nicolas,I don't find the PSWATCHSRV section in custome conficuration of APPserver configuration,can you tell me where is it?
        • 1. Re: PSWATCHSRV does not auto-restart causing app server domain instability
          974967
          Hi,

          When I booted up the app server domain, although there seems no error occured, in tuxedo log files (View TUXLOG):
          PSWATCHSRV.12944.2022632224.-2: 12-04-2012: Tuxedo Version 10.3.0.0, 64-bit
          PSWATCHSRV.12944.2022632224.-2: LIBTUX_CAT:537: ERROR: Unable to create reply queue
          PSWATCHSRV.12944.2022632224.-2: LIBTUX_CAT:248: ERROR: System init function failed, Uunixerr = : msgget: No space left on device
          restartsrv.12943.1757031200.-2: server WATCH/1: CMDTUX_CAT:579: ERROR: Cannot restart a server - unknown process creation error: 7
          restartsrv.12943.1757031200.-2: server WATCH/1: CMDTUX_CAT:587: INFO: Cannot restart server, scheduling for cleanup

          BBL.18040.243686496.0: 12-04-2012: Tuxedo Version 10.3.0.0, 64-bit, Patch Level (none)
          BBL.18040.243686496.0: LIBTUX_CAT:577: ERROR: Unable to register because the slot is already owned by another process
          BBL.18040.243686496.0: LIBTUX_CAT:248: ERROR: System init function failed, Uunixerr =

          Here is my configuration:
          Quick-configure menu -- domain: HCMSYS
          ----------------------------------------------
          Features Settings
          ========== ==========
          1) Pub/Sub Servers : No 16) DBNAME :[HCMAPP]
          2) Quick Server : No 17) DBTYPE :[ORACLE]
          3) Query Servers : No 18) UserId :[PS]
          4) Jolt : Yes 19) UserPswd :[PS]
          5) Jolt Relay : No 20) DomainID :[TESTSERV]
          6) WSL : No 21) AddToPATH :[.]
          7) PC Debugger : No 22) ConnectID :[people]
          8) Event Notification: Yes 23) ConnectPswd:[peop1e]
          9) MCF Servers : No 24) ServerName :[<My hostname>]
          10) Perf Collator : No 25) WSL Port :[7000]
          11) Analytic Servers : Yes 26) JSL Port :[9000]
          12) Domains Gateway : No 27) JRAD Port :[9100]

          When run the command:lsof -i:9000,there is nothing .
          Shall I reconfiguratie some parameters,or do something to boot the app server normally?
          From Nicolas's reply,I want to set PSWATCHSRV section , but can't find it
          Thanks a lot~
          • 2. Re: PSWATCHSRV does not auto-restart causing app server domain instability
            974967
            Hi,

            When I booted up the app server domain, although there seems no error occured, in tuxedo log files (View TUXLOG):
            PSWATCHSRV.12944.2022632224.-2: 12-04-2012: Tuxedo Version 10.3.0.0, 64-bit
            PSWATCHSRV.12944.2022632224.-2: LIBTUX_CAT:537: ERROR: Unable to create reply queue
            PSWATCHSRV.12944.2022632224.-2: LIBTUX_CAT:248: ERROR: System init function failed, Uunixerr = : msgget: No space left on device
            restartsrv.12943.1757031200.-2: server WATCH/1: CMDTUX_CAT:579: ERROR: Cannot restart a server - unknown process creation error: 7
            restartsrv.12943.1757031200.-2: server WATCH/1: CMDTUX_CAT:587: INFO: Cannot restart server, scheduling for cleanup

            BBL.18040.243686496.0: 12-04-2012: Tuxedo Version 10.3.0.0, 64-bit, Patch Level (none)
            BBL.18040.243686496.0: LIBTUX_CAT:577: ERROR: Unable to register because the slot is already owned by another process
            BBL.18040.243686496.0: LIBTUX_CAT:248: ERROR: System init function failed, Uunixerr =

            Here is my configuration:
            Quick-configure menu -- domain: HCMSYS
            ----------------------------------------------
            Features Settings
            ========== ==========
            1) Pub/Sub Servers : No 16) DBNAME :[HCMAPP]
            2) Quick Server : No 17) DBTYPE :[ORACLE]
            3) Query Servers : No 18) UserId :[PS]
            4) Jolt : Yes 19) UserPswd :[PS]
            5) Jolt Relay : No 20) DomainID :[TESTSERV]
            6) WSL : No 21) AddToPATH :[.]
            7) PC Debugger : No 22) ConnectID :[people]
            8) Event Notification: Yes 23) ConnectPswd:[peop1e]
            9) MCF Servers : No 24) ServerName :[<My hostname>]
            10) Perf Collator : No 25) WSL Port :[7000]
            11) Analytic Servers : Yes 26) JSL Port :[9000]
            12) Domains Gateway : No 27) JRAD Port :[9100]

            When run the command:lsof -i:9000,there is nothing .
            Shall I reconfiguratie some parameters,or do something to boot the app server normally?
            From Nicolas's reply,I want to set PSWATCHSRV section , but can't find it
            Thanks a lot~
            • 3. Re: PSWATCHSRV does not auto-restart causing app server domain instability
              Nicolas.Gasparotto
              Please, do not hijack 3 years old thread. You may or may not be on the same Peopletools level and not in the same proble neither.
              PSWATCHSRV.12944.2022632224.-2: LIBTUX_CAT:248: ERROR: System init function failed, Uunixerr = : msgget: No space left on device
              PSWATCHSRV is in configuration file of the app domain. Have you checked the disk space available ?
              Did you try to deactivate REN and analytic server ?

              Nicolas.
              • 4. Re: PSWATCHSRV does not auto-restart causing app server domain instability
                974967
                Hi,Nicolas

                I'm sorry that I didn't realize the date of thread.
                I configured the REN Server with these parameters:
                Values for config section - PSRENSRV
                log_severity_level=Warning
                io_buffer_size=8192
                default_http_port=7180
                default_https_port=7143
                default_auth_token=.ps.nby.com.

                And check the disk space:
                # df -h
                Filesystem Size Used Avail Use% Mounted on
                /dev/sda6 48G 4.8G 41G 11% /
                /dev/sda7 140G 7.4G 125G 6% /appfs
                /dev/sda5 48G 321M 45G 1% /var
                /dev/sda2 246G 43G 192G 19% /dbfs
                /dev/sda1 99M 14M 81M 15% /boot
                tmpfs 16G 612M 15G 4% /dev/shm
                none 16G 104K 16G 1% /var/lib/xenstored

                didn't active the analytic server .

                Now I shutdown and deleted the application server and PIA,recreated them.
                TUXLOG appears no errors.PSWATCHSRV seemed normally booted up :
                PSWATCHSRV.19799.3021712160.-2: 12-04-2012: Tuxedo Version 10.3.0.0, 64-bit
                PSWATCHSRV.19799.3021712160.-2: LIBTUX_CAT:262: INFO: Standard main starting

                But when I cheked peoplesoft.log13247,PIA_stdout.log11879 and PIA_weblogic.log77082,the errors are the same:
                <Dec 4, 2012 5:48:00 PM CST> <Error> <Server> <My hostname> <PIA> <DynamicSSLListenThread[DefaultSecure[3]]> <<WLS Kernel>> <> <> <1354614480127> <BEA-002606> <Unable to create a server socket for listening on channel "DefaultSecure[3]". The address fe80:0:0:0:200:ff:fe00:0 might be incorrect or another process is using port 1446: java.net.SocketException: Invalid argument.>

                <Dec 4, 2012 5:48:00 PM CST> <Error> <Server> <My hostname> <PIA> <DynamicListenThread[Default[4]]> <<WLS Kernel>> <> <> <1354614480134> <BEA-002606> <Unable to create a server socket for listening on channel "Default[4]". The address fe80:0:0:0:fcff:ffff:feff:ffff might be incorrect or another process is using port 1032: java.net.SocketException: Invalid argument.>

                Port 1446 and prot 1032 were configured as HTTPS port and HTTP port for PIA.
                But there was no other services occupied the port 1446 and 1032.
                Feel so puzzled ....
                • 5. Re: PSWATCHSRV does not auto-restart causing app server domain instability
                  Nicolas.Gasparotto
                  971964 wrote:
                  Hi,Nicolas

                  I'm sorry that I didn't realize the date of thread.
                  I branched in a new thread to avoid confusion.
                  I'm confused however about your situation
                  Now I shutdown and deleted the application server and PIA,recreated them.
                  So, now your AppServer is starting correctly, right ?
                  <Dec 4, 2012 5:48:00 PM CST> <Error> <Server> <My hostname> <PIA> <DynamicSSLListenThread[DefaultSecure[3]]> <<WLS Kernel>> <> <> <1354614480127> <BEA-002606> <Unable to create a server socket for listening on channel "DefaultSecure[3]". The address fe80:0:0:0:200:ff:fe00:0 might be incorrect or another process is using port 1446: java.net.SocketException: Invalid argument.>

                  <Dec 4, 2012 5:48:00 PM CST> <Error> <Server> <My hostname> <PIA> <DynamicListenThread[Default[4]]> <<WLS Kernel>> <> <> <1354614480134> <BEA-002606> <Unable to create a server socket for listening on channel "Default[4]". The address fe80:0:0:0:fcff:ffff:feff:ffff might be incorrect or another process is using port 1032: java.net.SocketException: Invalid argument.>

                  Port 1446 and prot 1032 were configured as HTTPS port and HTTP port for PIA.
                  As of now, you should provide us your Peopletools version, your OS...
                  And also, about the user you are trying to start PIA with. Bear in mind that processes using port less than 1024 have to be launched by root.

                  Nicolas.