Forum Stats

  • 3,854,206 Users
  • 2,264,340 Discussions
  • 7,905,609 Comments

Discussions

SAM-QFS 5.4 Readme & Release Notes

Brad Blasing - Oracle-Oracle
Brad Blasing - Oracle-Oracle Member Posts: 63 Employee
edited Jun 23, 2015 9:13PM in Oracle HSM

/*
* Copyright (c) 2013, 2014, Oracle and/or its affiliates. All rights reserved.
*/

            StorageTek QFS and StorageTek Storage Archive Manager
                 README and Release Notes for the 5.4 release
                              August 1, 2014

This file contains both the README.txt and the release notes for this release.

Documentation
=============
The StorageTek Storage Archive Manger and StorageTek QFS Software
documentation can be found at:
    http://www.oracle.com/technetwork/documentation/tape-storage-curr-187744.html#samqfs

Additional information is available from the SAM-QFS wiki:
    http://wikis.oracle.com/display/SAMQFS/Home

Operating System Requirements
=============================
The StorageTek Storage Archive Manger and StorageTek QFS Software require
the following minimum operating system levels:

* Solaris: (Metadata server or client):
    - Oracle Solaris 10 10/08 or later
    - Oracle Solaris 10 10/08 or later for x86 (32-bit) (client only)
    - Oracle Solaris 11
    - Oracle Solaris 11.1

* Linux:
    - Oracle Linux 5.9 for x64 platforms
    - Oracle Linux 5.10 for x64 platforms
    - Oracle Linux 6.3 for x64 platforms without UEK
    - Oracle Linux 6.4 for x64 platforms without UEK
    - Oracle Linux 6.5 for x64 platforms without UEK
    - RedHat Enterprise Linux 5.9 for x64 platforms
    - RedHat Enterprise Linux 5.10 for x64 platforms
    - RedHat Enterprise Linux 6.3 for x64 platforms
    - RedHat Enterprise Linux 6.4 for x64 platforms
    - RedHat Enterprise Linux 6.5 for x64 platforms
    - SuSE Linux Enterprise Server 11 (service pack 1) for x64 platforms

Significant New Features
========================
* Samsetup
    Samsetup is a menu-driven, command-line interface that provides easier
    initial setup and configuration of file systems, disk archiving,
    and tape archiving.  For more information, see the documentation or
    the samsetup(1m) man page.

* Distributed I/O
    The distributed I/O feature makes Storage Archive Manager solutions
    horizontally scalable.  Distributed I/O applies to both archiving
    and staging.  The SAM metadata server still controls scheduling and
    policy, but distributes the actual I/O to a set of specially
    configured clients.  Currently all clients must be Solaris, and
    have access to the tape drives via fibre channel.  This feature
    requires Solaris 11 or greater.

* Ephemeral ID support
    This feature allows Windows environments that use Active Directory (AD)
    to join and mount SAM-QFS file systems via CIFS.  Any authenticated
    AD user can use a QFS share.  Ephemeral IDs are mapped to temporary
    Unix ID's > 2^31 and are mapped by idmapd(1m) to an SID.  No QFS
    configuration is needed for this feature to work.

* Extended Attributes
    Extended attributes are customer defined meta-data that is stored on
    a per file or directory basis.  The data stored in the extended
    attributes are free-form.  These are described in more detail in
    the fsattr(5) man page for Solaris and attr(5) for Linux.  Linux
    extended attributes are limited to 4096 bytes for Linux, and are
    unlimited for Solaris.

* LTFS
    This feature lets SAM-QFS import tapes that are formatted in LTFS
    format.  Support is limited to StorageTek T10000C & T10000D, and
    HP/IBM LTO-5 & LTO-6 drives.  LTFS files are imported into the QFS
    file system via metadata, so staging in the entire LTFS tape is not
    required.  See the documentation and the ltfs(7) and samltfs(1m) man
    pages.  This feature requires Solaris 11.1 or greater.

* IPS
    Customers can now install SAM-QFS on Solaris 11 or greater using the
    new Solaris IPS format. See the SAM-QFS installation guide for more
    details.

* Periodic Media validation (PMV)
    This feature automatically validates media using the DIV feature.
    An administrator sets policies that automatically run the
    tpverify(1m) command to ensure that DIV protected tapes remain
    readable. See the documentation and the verifyd.cmd(4) man page.
    This feature requires Solaris 11 or greater.

* DIV support for IBM LTO-5/6 and HP LTO-6
    DIV now supports LTO-5/6 and HP LTO-6 tape drives using the
    Reed-Solomon checksum algorithm. There is no hardware acceleration,
    so DIV for LTO is somewhat slower than T10000 Intel-CRC DIV.

* Stage Priority
    This features lets the system administrator prioritize certain
    stage requests.  The new "-I" parameter of the stage(1) command
    indicates that a stage request should be done immediately and new
    directives have been added to stager.cmd(4) and archiver.cmd(4).
    This changes lets administrators assign a lower priority to
    re-archiving (either manually done or via recycling) so that it
    does not interfere with regular archiving.

* Samfsdump/samfsrestore
    Samfsdump/samfsrestore (or qfsdump/qfsrestore if only the QFS
    packages are installed) were modified to dump and restore LTFS
    imported files, as well as files with extended attributes.
    This required changing the "dump header version number".  This
    means that dumps made on 5.4 that use these features will not
    be able to be read on a 5.3 or previous system.  Dumps made
    previous to 5.3 are readable on 5.4.

Important Notes
===============
* DIV settings in /etc/kernel/st.conf
    The DIV algorithm for T10000C/D drives is configurable to Reed Solomon
    or Intel CRC.  SAM-QFS uses Intel CRC only for archiving, and
    accepts either for staging.  Tapes accessed outside of SAM-QFS
    (manual read via star(1M) for example) will use the Solaris 11 default.
    We strongly recommend adding the following line to the Solaris 11
    /kernel/drv/st.conf file:
st_dadp_settings=
        "STK     T10000C", "crc32c", "stk-crc32c",
        "STK     T10000D", "crc32c", "stk-crc32c"; <--- add this line

* Device driver change for direct attached libraries
    Samst has been replaced by the standard Solaris sgen(7D) driver.  The
    samst driver is still included but is not installed.  This makes
    SAM-QFS more consistent in how Solaris deals with directly
    attached libraries.

* The file system options mask was modified to include a flag to
    indicate if a file system has LTFS imported files, or files with
    extended attributes.  If either of these features are used,
    the file system will not be mountable on a 5.3 or previous
    system.

* Regarding the following two SAM-QFS Manager GUI bugs, there is a workaround
    needed for Java 6 and above:
    16798129 sam-fs shows 'could not compile stylesheet' when view reports in webconsole
    18896583 SAM-QFS GUI fails some operations in Java 6 and greater
    The workaround for these bugs
    1. Download the Xalan Java jar files (xalan.jar, xml-apis.jar,
        xercesImpl.jar, serializer.jar)
        from http://archive.apache.org/dist/xml/xalan-j/xalan-j_2_7_1-bin.zip
    2. Add the above jar files at /opt/SUNWfsmgr/samqfsui/WEB-INF/lib
    3. Restart the Oracle Java Web Console by running
        "/usr/sbin/smcwebserver restart"

New Devices Qualified
=====================
* ACSLS 8.2 and 8.3
* T10000D (came with 5.3-02 patch)
* T10000D with Fibre Channel over Ethernet (FCoE)
* LTO-6 (came with 5.3-01 patch)
* LTO-6 DIV for IBM/HP
* LTO-5 DIV for IBM
* Quantum i500/i2000/i6000 libraries (came with 5.3-02 patch)

Solaris Cluster
===============
Oracle Solaris Cluster (OSC) 4.2 was tested and qualified with
SAM-QFS 5.4 running on Solaris 11.1.

Significant Bugs Fixed
======================
18889646  SAM archiver can incorrectly write tapes with default block size
18844805  sam-qfs 5.3.14 ELNRNG error when creating file on linux client
18830369  sam-stagrd_copy error recovery broken, file marked damaged
18673521  retry div tape block read failures with position followed by read
18436185  MDS system panic Deadlock: cycle in blocking chain
18340088  stager div crc - handle mismatched reed-solomon / intel CRC in stager
18173485  stager seems not being notified about load error, staging hung
17952728  2 T10kC tapes containing archived SAM-QFS files were
        overwritten with incorrect
17751619  samfsdump doesn't sort inodes in optimal order on i86
17552770  Case-insensitive scan walking off end of directory, causing panics
17433049  File got release before min_residence_age
17379150  SAM-QFS: NFSv4 ACL - 0:[email protected]:read_acl/write_acl:deny not
        working on shared
17228040  samfs5.3 + Sol11 smb service: permission settings not
        regarded on CIFS client
16976529  Stage from disk archive failed with Invalid tar header
16779942  Stage failed with Invalid tar header, affected copy marked damage
16659115  Wrong checksum value is generated by stager in some cases
16634419  When div is on the staging from the T10KB drives drops below
        1Mb/s and the below
16447154  shrink on large LUNs can reference incorrect disk block
16279321  Reading QFS sparse file with multiple IO vectors can result
        in data corruption
15931062  SAM-QFS, improve archiver DIV performance
15923189  Sol 11 / samfs 5.3-- sam-arfind process hangs in a directory.
15823392  SUNBT7205200 SAM-QFS shared file system supports only 16
        additional groups per u
15815137  SUNBT7197462 Stage error can persist after fault is cleared
15793165  SUNBT7170622 MDS panic in sam_putsock_message
15756568  SUNBT7114308 Staging Performance Problem with 5.2

Features Removed
================
* Tivoli/SANergy support was removed from SAM-QFS.
* Support for many old tape drives and libraries were removed from
    SAM-QFS.  See the following wiki page for details:
    https://wikis.oracle.com/display/SAMQFS/SAM-QFS+End+of+Life+Storage+Devices

Limitations
===========
* The following SAM-QFS features require Solaris 11:
    - Periodic media validation (and DIV)
    - Distributed I/O
    - Ephemeral ID support
    - LTFS support (requires Solaris 11.1)
    - CIFS exporting via Solaris kernel