5 Replies Latest reply on Apr 27, 2016 6:31 AM by Eze-Oracle

    Issue: Ldom guest console unable to open and testdom1 guest unable to up

    1059844

      Server Model: SPARC T4-2

      root@ssgf2ldom2:~# ldm list

      NAME STATE      FLAGS   CONS    VCPU MEMORY   UTIL  NORM  UPTIME

      primary active     -n-cv-  UART    8     4G 3.1%  3.1%  438d 21h

      ldom1 active     -n----  5000    36    40G 3.8%  3.8%  6d 18h 38m

      ldom2 active     -n----  5002    36    47G 1.0%  1.0%  138d 21h

      testdom1         active -t----  5001    8     4G 12%   12%  1d 1h 21m

       

      root@ssgf2ldom2:~# netstat -an |grep 5000

      1. 127.0.0.1.5000 *.* 0      0  128000      0 LISTEN

       

      root@ssgf2ldom2:~# netstat -an |grep 5001  (No local port listen status)

       

      root@ssgf2ldom2:~# netstat -an |grep 5002

      1. 127.0.0.1.5002 *.* 0      0  128000      0 LISTEN
      2. 127.0.0.1.5002 127.0.0.1.61237       139264      0  130880 0 CLOSE_WAIT

       

      root@ssgf2ldom2:~# telnet localhost 5000 (ldom1 -5000 console works fine)

      Trying ::1...

      telnet: connect to address ::1: Connection refused

      Trying 127.0.0.1...

      Connected to localhost.

      Escape character is '^]'.

       

      Connecting to console "ldom1" in group "ldom1" ....

      Press ~? for control options ..

       

      Authorized users only. All activity \ may be monitored and reported.

      gspcd2 console login:

      telnet> q

      Connection to localhost closed.

       

      root@ssgf2ldom2:~# telnet localhost 5001 (ldom2 guest console have issue)

      Trying ::1...

      telnet: connect to address ::1: Connection refused

      Trying 127.0.0.1...

      telnet: Unable to connect to remote host: Connection refused

       

      root@ssgf2ldom2:~# telnet localhost 5002 (testdom1 guest console have issue)

      Trying ::1...

      telnet: connect to address ::1: Connection refused

      Trying 127.0.0.1...

      Connected to localhost.

      Escape character is '^]'.

       

      ^]

      telnet> q

      Connection to localhost closed.

       

       

      Commands output

       

       

      root@ssgf2ldom2:~# svcs -l vntsd

      fmri svc:/ldoms/vntsd:default

      name virtual network terminal server

      enabled true

      state online

      next_state none

      state_time April 19, 2016 09:37:52 AM SGT

      logfile /var/svc/log/ldoms-vntsd:default.log

      restarter svc:/system/svc/restarter:default

      contract_id 64192

      manifest /lib/svc/manifest/platform/sun4v/vntsd.xml

      dependency optional_all/error svc:/milestone/network (online)

      dependency optional_all/none svc:/system/system-log (online)

       

       

      root@ssgf2ldom2:~# egrep  -i "console|vntsd" /var/adm/messages*

      /var/adm/messages:Apr 19 08:18:44 ssgf2ldom2 vntsd: [ID 241395 daemon.error] CONSOLE WAS DELETED: thread[1] alloc_cons

      /var/adm/messages:Apr 19 08:18:44 ssgf2ldom2 vntsd: [ID 241395 daemon.error] FAIL TO ADD A CONSOLE: thread[1] get_config

      /var/adm/messages:Apr 19 08:19:14 ssgf2ldom2 vntsd: [ID 241395 daemon.error] BIND SOCKET ERROR: thread[6] Group:ldom2 TCP port 5002 status 0

      /var/adm/messages:Apr 19 08:52:39 ssgf2ldom2 vntsd: [ID 241395 daemon.error] CONSOLE WAS DELETED: thread[1] alloc_cons

      /var/adm/messages:Apr 19 08:52:39 ssgf2ldom2 vntsd: [ID 241395 daemon.error] FAIL TO ADD A CONSOLE: thread[1] get_config

      /var/adm/messages:Apr 19 08:53:09 ssgf2ldom2 vntsd: [ID 241395 daemon.error] BIND SOCKET ERROR: thread[6] Group:ldom2 TCP port 5002 status 0

      /var/adm/messages:Apr 19 08:54:17 ssgf2ldom2 vntsd: [ID 241395 daemon.error] CONSOLE WAS DELETED: thread[1] alloc_cons

      /var/adm/messages:Apr 19 08:54:17 ssgf2ldom2 vntsd: [ID 241395 daemon.error] FAIL TO ADD A CONSOLE: thread[1] get_config

      /var/adm/messages:Apr 19 08:54:47 ssgf2ldom2 vntsd: [ID 241395 daemon.error] BIND SOCKET ERROR: thread[6] Group:ldom2 TCP port 5002 status 0

      /var/adm/messages:Apr 19 08:56:48 ssgf2ldom2 vntsd: [ID 241395 daemon.error] CONSOLE WAS DELETED: thread[1] alloc_cons

      /var/adm/messages:Apr 19 08:56:48 ssgf2ldom2 vntsd: [ID 241395 daemon.error] NO MEMORY: thread[1] do_add_cons():Can not add console=1

      /var/adm/messages:Apr 19 09:07:50 ssgf2ldom2 vntsd: [ID 241395 daemon.error] CONSOLE WAS DELETED: thread[1] alloc_cons

      /var/adm/messages:Apr 19 09:07:50 ssgf2ldom2 vntsd: [ID 241395 daemon.error] NO MEMORY: thread[1] do_add_cons():Can not add console=1

      /var/adm/messages:Apr 19 09:37:52 ssgf2ldom2 vntsd: [ID 241395 daemon.error] CONSOLE WAS DELETED: thread[1] alloc_cons

      /var/adm/messages:Apr 19 09:37:52 ssgf2ldom2 vntsd: [ID 241395 daemon.error] FAIL TO ADD A CONSOLE: thread[1] get_config

      /var/adm/messages:Apr 19 09:38:22 ssgf2ldom2 vntsd: [ID 241395 daemon.error] BIND SOCKET ERROR: thread[6] Group:ldom2 TCP port 5002 status 0

       

      root@ssgf2ldom2:~# ldm list -o console

      NAME

      primary

       

      VCC

      NAME             PORT-RANGE

      primary-vcc0     5000-5100

       

      VCONS

      NAME             SERVICE PORT   LOGGING

      UART

       

      ------------------------------------------------------------------------------

      NAME

      ldom1

       

      VCONS

      NAME             SERVICE PORT   LOGGING

      ldom1            primary-vcc0@primary 5000   on

       

      ------------------------------------------------------------------------------

      NAME

      ldom2

       

      VCONS

      NAME             SERVICE PORT   LOGGING

      ldom2            primary-vcc0@primary 5002   on

       

      ------------------------------------------------------------------------------

      NAME

      testdom1

       

      VCONS

      NAME             SERVICE PORT   LOGGING

      testdom1         primary-vcc0@primary 5001   on

       

       

       

      root@ssgf2ldom2:~# netstat -a | egrep "\.50[0-90-9]"

      ssgf2ldom2.gfoundries.com.ssh 10.80.3.244.50372      48232      0   64240 0 ESTABLISHED

      ssgf2ldom2.gfoundries.com.ssh 10.80.3.244.50373      49480     47   64240 0 ESTABLISHED

      1. localhost.5002 localhost.37518       139264 0  130880      0 CLOSE_WAIT
      2. localhost.5002 *.* 0      0  128000 0 LISTEN
      3. localhost.5000 *.* 0      0  128000 0 LISTEN

        localhost.5002       localhost.61237 139264      0  130880 0 CLOSE_WAIT

       

      I have tried to restarted vntsd service twice, the the problem is still there.

        • 1. Re: Issue: Ldom guest console unable to open and testdom1 guest unable to up
          Eze-Oracle

          Hello

          root@ssgf2ldom2:~# ldm list

          NAME STATE      FLAGS   CONS    VCPU MEMORY   UTIL  NORM  UPTIME

          primary active     -n-cv-  UART    8     4G 3.1%  3.1%  438d 21h   -------->>> very few mem assigned at least 8G

          ldom1 active     -n----  5000    36    40G 3.8%  3.8%  6d 18h 38m

          ldom2 active     -n----  5002    36    47G 1.0%  1.0%  138d 21h

          testdom1         active -t----  5001    8     4G 12%   12%  1d 1h 21m  --->> kind of the same I would suggest 8GB.

           

           

          Add at least 4Gb more to primary then,  stop / unbind / start / bind the guest please.

           

          If after doing this still fails open a new SR  please

           

          Regards

          Eze

          1 person found this helpful
          • 2. Re: Issue: Ldom guest console unable to open and testdom1 guest unable to up
            1492849

            Hi,

             

            Can I remove the vcc and add back without impacting the active domain from functioning?

             

            # ldm remove-vcc [-f] primary-vcc0

            # ldm add-vcc port-range=5000-5100 primary-vcc0 primary

            • 3. Re: Issue: Ldom guest console unable to open and testdom1 guest unable to up
              Eze-Oracle

              Hello

               

              Have you done what I requested in my previous note?

               

              REgards

              Eze

              • 4. Re: Issue: Ldom guest console unable to open and testdom1 guest unable to up
                1059844

                Hi Eze,

                 

                I have increased memory, stopped, unbind, bind and started guest but still same issue and error

                 

                 

                root@ssgf2ldom2:~# ldm add-memory 4g primary

                 

                root@ssgf2ldom2:~# ldm list

                NAME             STATE FLAGS   CONS    VCPU  MEMORY   UTIL NORM  UPTIME

                primary          active -n-cv-  UART    8     8G 13%   13%  445d 22h

                ldom1            active -n----  5000    36    40G 0.2%  0.2%  13d 19h 58m

                ldom2            active -n----  5002    36    47G 1.2%  1.2%  145d 22h

                testdom1         active -t----  5001    8     4G 12%   12%  8d 2h 41m

                 

                root@ssgf2ldom2:~# ldm stop testdom1

                Remote graceful shutdown or reboot capability is not available on testdom1

                 

                LDom testdom1 stopped

                root@ssgf2ldom2:~# ldm unbind testdom1

                root@ssgf2ldom2:~# ldm bind testdom1

                root@ssgf2ldom2:~# ldm start testdom1

                LDom testdom1 started

                 

                 

                 

                root@ssgf2ldom2:~# ldm list

                NAME             STATE FLAGS   CONS    VCPU  MEMORY   UTIL NORM  UPTIME

                primary          active -n-cv-  UART    8     8G 13%   13%  445d 22h

                ldom1            active -n----  5000    36    40G 0.2%  0.2%  13d 20h 1m

                ldom2            active -n----  5002    36    47G 1.3%  1.3%  145d 22h

                testdom1         active -t----  5001    8     4G 12%   12%  2m

                 

                root@ssgf2ldom2:~# telnet localhost 5001

                Trying ::1...

                telnet: connect to address ::1: Connection refused

                Trying 127.0.0.1...

                telnet: Unable to connect to remote host: Connection refused

                root@ssgf2ldom2:~# telnet 0 5001

                Trying 0.0.0.0...

                telnet: Unable to connect to remote host: Connection refused

                 

                Thanks&Regards

                Andreas

                • 5. Re: Issue: Ldom guest console unable to open and testdom1 guest unable to up
                  Eze-Oracle

                  Hello

                   

                  Please open a new SR to look into this.

                   

                  Regards

                  Eze