10 Replies Latest reply on Jan 24, 2018 6:55 PM by 3465693

    SuperCluster Zone can´t mount non-global filesystem why?

    3465693

      Hi,

      I reboot a zone in our Solaris SuperCluster, and after that, we can´t see the filesystems mounted, and our zone took a status incomplete.

      For example, if I execute this command a got:

      root@nxpaiapp2:/zones/nxpaiosbprodtransa/root# zfs mount zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-4

      cannot mount 'zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-4': dataset is exported to a local zone

       

      and on the other hand:

      root@nxpaiapp2:/# zoneadm list -icv

        ID NAME             STATUS      PATH                         BRAND      IP

         0 global           running     /                            solaris    shared

         - nxpaiodiprodbatcha installed   /zones/nxpaiodiprodbatcha    solaris    excl

         - nxpaiosbprodtransa incomplete  /zones/nxpaiosbprodtransa    solaris    excl

         - nxpaiotdprodbca  installed   /zones/nxpaiotdprodbca       solaris    excl

         - nxpaiprodnismaster installed   /zones/nxpaiprodnismaster    solaris    excl

         - nxpaiotdprodadm  installed   /zones/nxpaiotdprodadm       solaris    excl

       

      As you can see my zone with problems is nxpaiosbprodtransa (incomplete)

       

      What should I do? How to proceed?

        • 1. Re: SuperCluster Zone can´t mount non-global filesystem why?
          Andris Perkons-Oracle

          You can't mount the file system in your global zone because the file system has the property "zoned" set to "on".

           

          To see all mounted file systems, use "df" with the "Z" flag.

           

          Regarding the "incomplete" status: There is nothing in your post that indicates what may have happened.

           

          Andris

          • 2. Re: SuperCluster Zone can´t mount non-global filesystem why?
            3465693

            Hi Andris,

            First, thank you very much for your response, please howto check and change the property "zoned" in order to mount the filesystems?

            And why could that have happened, with only one reboot in the area (Weblogic OSB installed)?

            Regards,

            Oscar

            • 3. Re: SuperCluster Zone can´t mount non-global filesystem why?
              3465693

              I have in this moment:

              Nodo A with problems:

              ----------------------------

              root@nxpaiapp2:~# zfs list -o name,zoned,mountpoint -r zonaspool/nxpaiosbprodtransa

              NAME                                                          ZONED  MOUNTPOINT

              zonaspool/nxpaiosbprodtransa                                    off  /zones/nxpaiosbprodtransa

              zonaspool/nxpaiosbprodtransa/rpool                               on  /rpool

              zonaspool/nxpaiosbprodtransa/rpool/ROOT                          on  legacy

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris                  on  /

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-1                on  /

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-1/var            on  /var

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-2                on  /

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-2/var            on  /var

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-3                on  /

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-3/var            on  /var

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-4                on  /

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-4/var            on  /var

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-backup-1         on  /

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-backup-1/var     on  /var

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-backup-2         on  /

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-backup-2/var     on  /var

              zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris/var              on  /var

              zonaspool/nxpaiosbprodtransa/rpool/VARSHARE                      on  /var/share

              zonaspool/nxpaiosbprodtransa/rpool/VARSHARE/pkg                  on  /var/share/pkg

              zonaspool/nxpaiosbprodtransa/rpool/VARSHARE/pkg/repositories     on  /var/share/pkg/repositories

              zonaspool/nxpaiosbprodtransa/rpool/export                        on  /export

              zonaspool/nxpaiosbprodtransa/rpool/export/home                   on  /export/home

              zonaspool/nxpaiosbprodtransa/rpool/export/home/ecff6006          on  /export/home/ecff6006

              zonaspool/nxpaiosbprodtransa/rpool/export/home/eddc7975          on  /export/home/eddc7975

              zonaspool/nxpaiosbprodtransa/rpool/export/home/ehsc6161          on  /export/home/ehsc6161

              zonaspool/nxpaiosbprodtransa/rpool/export/home/emagent           on  /export/home/emagent

              zonaspool/nxpaiosbprodtransa/rpool/export/home/nesm785k          on  /export/home/nesm785k

              zonaspool/nxpaiosbprodtransa/rpool/export/home/nnmm9016          on  /export/home/nnmm9016

              zonaspool/nxpaiosbprodtransa/rpool/export/home/oracle            on  /export/home/oracle

              zonaspool/nxpaiosbprodtransa/rpool/export/home/orarom            on  /export/home/orarom

              zonaspool/nxpaiosbprodtransa/rpool/orabin                        on  /rpool/orabin

              zonaspool/nxpaiosbprodtransa/rpool/orabin/stage                  on  /stage

               

              But MOUNTPOINT isn't OK.

              ###########################

              Nodo B with GOODs MOUNTPOINTs...

              root@nxpaiapp4:~# zfs list -o name,zoned,mountpoint -r zonaspool/nxpaiosbprodtransb

              NAME                                                          ZONED  MOUNTPOINT

              zonaspool/nxpaiosbprodtransb                                    off  /zones/nxpaiosbprodtransb

              zonaspool/nxpaiosbprodtransb/rpool                               on  /zones/nxpaiosbprodtransb/root/rpool

              zonaspool/nxpaiosbprodtransb/rpool/ROOT                          on  legacy

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris                  on  /

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-1                on  /

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-1/var            on  /var

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-2                on  /

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-2/var            on  /var

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-3                on  /

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-3/var            on  /var

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-4                on  /zones/nxpaiosbprodtransb/root

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-4/var            on  /zones/nxpaiosbprodtransb/root/var

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-backup-1         on  /

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-backup-1/var     on  /var

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-backup-2         on  /

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris-backup-2/var     on  /var

              zonaspool/nxpaiosbprodtransb/rpool/ROOT/solaris/var              on  /var

              zonaspool/nxpaiosbprodtransb/rpool/VARSHARE                      on  /zones/nxpaiosbprodtransb/root/var/share

              zonaspool/nxpaiosbprodtransb/rpool/VARSHARE/pkg                  on  /zones/nxpaiosbprodtransb/root/var/share/pkg

              zonaspool/nxpaiosbprodtransb/rpool/VARSHARE/pkg/repositories     on  /zones/nxpaiosbprodtransb/root/var/share/pkg/repositories

              zonaspool/nxpaiosbprodtransb/rpool/export                        on  /zones/nxpaiosbprodtransb/root/export

              zonaspool/nxpaiosbprodtransb/rpool/export/home                   on  /zones/nxpaiosbprodtransb/root/export/home

              zonaspool/nxpaiosbprodtransb/rpool/export/home/ecff6006          on  /zones/nxpaiosbprodtransb/root/export/home/ecff6006

              zonaspool/nxpaiosbprodtransb/rpool/export/home/eddc7975          on  /zones/nxpaiosbprodtransb/root/export/home/eddc7975

              zonaspool/nxpaiosbprodtransb/rpool/export/home/ehsc6161          on  /zones/nxpaiosbprodtransb/root/export/home/ehsc6161

              zonaspool/nxpaiosbprodtransb/rpool/export/home/emagent           on  /zones/nxpaiosbprodtransb/root/export/home/emagent

              zonaspool/nxpaiosbprodtransb/rpool/export/home/nesm785k          on  /zones/nxpaiosbprodtransb/root/export/home/nesm785k

              zonaspool/nxpaiosbprodtransb/rpool/export/home/nnmm9016          on  /zones/nxpaiosbprodtransb/root/export/home/nnmm9016

              zonaspool/nxpaiosbprodtransb/rpool/export/home/oracle            on  /zones/nxpaiosbprodtransb/root/export/home/oracle

              zonaspool/nxpaiosbprodtransb/rpool/export/home/orarom            on  /zones/nxpaiosbprodtransb/root/export/home/orarom

              zonaspool/nxpaiosbprodtransb/rpool/orabin                        on  /rpool/orabin

              zonaspool/nxpaiosbprodtransb/rpool/orabin/stage                  on  /zones/nxpaiosbprodtransb/root/stage

              • 4. Re: SuperCluster Zone can´t mount non-global filesystem why?
                3465693

                what can I do to check why my zone (nxpaiosbprodtransa) is in INCOMPLETE Status, If I only rebooted the zone like others case.

                • 5. Re: SuperCluster Zone can´t mount non-global filesystem why?
                  Andris Perkons-Oracle

                  You get different outputs because the zones are in different states. One is running, whereas the other one is not.

                   

                  Andris

                  • 6. Re: SuperCluster Zone can´t mount non-global filesystem why?
                    Andris Perkons-Oracle
                    please howto check and change the property "zoned" in order to mount the filesystems?

                     

                    Use "zfs get" and "zfs set" commands.

                     

                    "zfs get zoned <file system" lists the value of the "zoned" property

                    "zfs set zoned=off <file system>" enables you to mount the file system in your global zone

                     

                    Andris

                    • 7. Re: SuperCluster Zone can´t mount non-global filesystem why?
                      Andris Perkons-Oracle

                      what can I do to check why my zone (nxpaiosbprodtransa) is in INCOMPLETE Status, If I only rebooted the zone like others case.

                      My sugggestion would be to open an SR with Oracle.

                      • 8. Re: SuperCluster Zone can´t mount non-global filesystem why?
                        3465693

                        Hi,

                        We got now:

                         

                        root@nxpaiapp2:~# zfs list -o name,zoned,mountpoint -r zonaspool/nxpaiosbprodtransa

                        NAME                                                          ZONED  MOUNTPOINT

                        zonaspool/nxpaiosbprodtransa                                    off  /zones/nxpaiosbprodtransa

                        zonaspool/nxpaiosbprodtransa/rpool                               on  /zones/nxpaiosbprodtransa/root/rpool

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT                          on  legacy

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris                  on  /

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-1                on  /

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-1/var            on  /var

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-2                on  /

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-2/var            on  /var

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-3                on  /

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-3/var            on  /var

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-4                on  /zones/nxpaiosbprodtransa/root

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-4/var            on  /zones/nxpaiosbprodtransa/root/var

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-backup-1         on  /

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-backup-1/var     on  /var

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-backup-2         on  /

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris-backup-2/var     on  /var

                        zonaspool/nxpaiosbprodtransa/rpool/ROOT/solaris/var              on  /var

                        zonaspool/nxpaiosbprodtransa/rpool/VARSHARE                      on  /zones/nxpaiosbprodtransa/root/var/share

                        zonaspool/nxpaiosbprodtransa/rpool/VARSHARE/pkg                  on  /zones/nxpaiosbprodtransa/root/var/share/pkg

                        zonaspool/nxpaiosbprodtransa/rpool/VARSHARE/pkg/repositories     on  /zones/nxpaiosbprodtransa/root/var/share/pkg/repositories

                        zonaspool/nxpaiosbprodtransa/rpool/export                        on  /zones/nxpaiosbprodtransa/root/export

                        zonaspool/nxpaiosbprodtransa/rpool/export/home                   on  /zones/nxpaiosbprodtransa/root/export/home

                        zonaspool/nxpaiosbprodtransa/rpool/export/home/ecff6006          on  /zones/nxpaiosbprodtransa/root/export/home/ecff6006

                        zonaspool/nxpaiosbprodtransa/rpool/export/home/eddc7975          on  /zones/nxpaiosbprodtransa/root/export/home/eddc7975

                        zonaspool/nxpaiosbprodtransa/rpool/export/home/ehsc6161          on  /zones/nxpaiosbprodtransa/root/export/home/ehsc6161

                        zonaspool/nxpaiosbprodtransa/rpool/export/home/emagent           on  /zones/nxpaiosbprodtransa/root/export/home/emagent

                        zonaspool/nxpaiosbprodtransa/rpool/export/home/nesm785k          on  /zones/nxpaiosbprodtransa/root/export/home/nesm785k

                        zonaspool/nxpaiosbprodtransa/rpool/export/home/nnmm9016          on  /zones/nxpaiosbprodtransa/root/export/home/nnmm9016

                        zonaspool/nxpaiosbprodtransa/rpool/export/home/oracle            on  /zones/nxpaiosbprodtransa/root/export/home/oracle

                        zonaspool/nxpaiosbprodtransa/rpool/export/home/orarom            on  /zones/nxpaiosbprodtransa/root/export/home/orarom

                        zonaspool/nxpaiosbprodtransa/rpool/orabin                        on  /rpool/orabin

                        zonaspool/nxpaiosbprodtransa/rpool/orabin/stage                  on  /zones/nxpaiosbprodtransa/root/stage

                         

                        I executed for example:

                        zfs set mountpoint=/zones/nxpaiosbprodtransa/root/rpool zonaspool/nxpaiosbprodtransa/rpool

                        one filesystem by one but

                        as you can see as MOUNTPOINT is GOOD, but after zone reboot the filesystems were not mounted, WHY?

                        • 9. Re: SuperCluster Zone can´t mount non-global filesystem why?
                          Andris Perkons-Oracle

                          What you are doing is plain wrong. Please do not mess with the file systems.

                          As I have said before: You see different mount points because your respective zones are in different states. Part of the mount that you see is determined at runtime of the zone (e.g. the zonepath that is prepended to the mount as you see it from inside the zone).

                          Try stopping a running zone and see how the output of the "zfs list" changes.

                           

                          You should undo your changes and open an SR with Oracle to determine why your zone does not boot.

                           

                          Andris

                          • 10. Re: SuperCluster Zone can´t mount non-global filesystem why?
                            3465693

                            Hi Andris,

                            I really appreciate your time. I will open an SR with Oracle.

                            Best regards,

                            Oscar