IBM High IOPS Driver and Utilities for SUSE Linux Enterprise Server 10 Current Adapter Support: - IBM Flash Adapter F825 Enterprise Value for System x, Option 00AE861, (FRU) 00AE863 - IBM Flash Adapter F1650 Enterprise Value for System x, Option 00AE864, (FRU) 00AE866 - IBM Flash Adapter F3200 Enterprise Value for System x, Option 00AE867, (FRU) 00AE869 Supported Legacy Adapters: - IBM 160GB High IOPS SS Class SSD PCIe Adapter, Option 46M0877, (FRU) 46M0886 - IBM 320GB High IOPS MS Class SSD PCIe Adapter, Option 46M0898, (FRU) 46M0899 - IBM 320GB High IOPS SD Class SSD PCIe Adapter, Option 46M0878, (FRU) 46M0887 - IBM 160GB High IOPS SS Class SSD PCIe Adapter, Option 46M0877, (FRU) 81Y4523 - IBM 320GB High IOPS SD Class SSD PCIe Adapter, Option 46M0878, (FRU) 81Y4521 - IBM 320GB High IOPS MS Class SSD PCIe Adapter, Option 46M0898, (FRU) 81Y4525 - 320GB High IOPS SLC Adapter for IBM System x, Option 81Y4535, (FRU) 81Y4536 - 640GB High IOPS MLC Adapter for IBM System x, Option 81Y4531, (FRU) 81Y4532 - 640GB High IOPS MLC Duo Adapter for IBM System x, Option 81Y4519, (FRU) 68Y7382 - 640GB High IOPS MLC Duo Adapter for IBM System x, Option 81Y4519, (FRU) 81Y4518 - 640GB High IOPS SLC Duo Adapter for IBM System x, Option 81Y4539, (FRU) 81Y4540 - 1.28TB High IOPS MLC Duo Adapter for IBM System x, Option 81Y4527, (FRU) 81Y4528 - IBM 365GB High IOPS MLC Mono Adapter, Option 46C9078, (FRU) 46C9079 - IBM 785GB High IOPS MLC Mono Adapter, Option 46C9081, (FRU) 46C9082 - IBM 1.2TB High IOPS MLC Mono Adapter, Option 90Y4377, (FRU) 90Y4378 - IBM 2.4TB High IOPS MLC Duo Adapter, Option 90Y4397, (FRU) 90Y4398 Supported 64-bit SLES 10 Kernels: - SLES 10 SP4 Default Kernel: 2.6.16.60-0.85.1-default - SLES 10 SP4 SMP Kernel: 2.6.16.60-0.85.1-smp - SLES 10 SP4 Xen Kernel: 2.6.16.60-0.85.1-xen (C) Copyright International Business Machines Corporation 1999, 2011. All rights reserved. US Government Users Restricted Rights - Use, duplication, or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Note: Before using this information and the product it supports, read the general information in "Notices and trademarks" in this document. CONTENTS ________ 1.0 Overview 2.0 Installation and setup instructions 3.0 Usage information 4.0 Unattended mode 5.0 Web site and support phone number 6.0 Notices and trademarks 7.0 Disclaimer 1.0 Overview _____________ 1.1 This package contains the IBM High IOPS SSD PCIe Adapter driver, and other associated utilities, for SUSE Linux Enterprise Server 10. 1.2 Limitations: - Only 64-bit Linux installations are supported. - Version 3.2.6 and later of the driver software, including ioMemory VSL, are not backward-compatible with any driver version earlier than 3.2.8. When you install version 3.2.6 or later, you cannot revert to any driver version before 3.2.6. 1.3 Problems fixed: - Attention, there is a low risk of exposure to data loss while operating with VSL 3.2.6 and prior versions when enabling file system barriers. Please see the official RETAIN Tip posted to IBM's webpage using MIGR-5096029 for details. It is recommended to upgrade to VSL 3.2.8 to correct this issue. - Please see change history for fixes 1.4 Level of Recommendations and Prerequisites for the update: - The server must have at least the recommended amount of memory for the adapter used. See the IBM HIGH IOPS User Guide for Linux for more details. 1.5 Dependencies: - None 1.6 Update Contents o ibm_mgmt_highiop_ssd-3.2.8_sles10_x86-64.zip - Installation package o ibm_mgmt_highiop_ssd-3.2.8_sles10_x86-64.chg - Change history o ibm_mgmt_highiop_ssd-3.2.8_sles10_x86-64.txt - Readme 2.0 Installation and setup instructions ________________________________________ Important Considerations when Upgrading Software, or Adding a New High IOPS Adapter to an existing server --------------------------------------------------------------------------- Legacy hardware can be upgraded to the latest generation of software and it's very important to understand the impact and long term implications these updates may have on the operating environment. Upgrading Legacy Adapters (REQUIRED) Multiple High IOPS adapters are installed in a single system: --------------------------------------------------------------------------- When multiple High IOPS Adapters are installed in the same server, all devices must operate with the same version of software. High IOPS adapters require matching firmware, drivers and utilities. This is a very important consideration when adding a new Second Generation High IOPS Adapter in a server where Legacy Adapters are deployed. When Upgrading Legacy Adapters operating with a previous generation of software (1.2.x or 2.x), you must back up the data on the adapter before upgrading to prevent data loss. After upgrading the ioMemory VSL (drivers) to version 3.x, the legacy adapters will not logically attach to the system until the firmware is also updated. Detailed instructions for upgrading software is provided in Appendix F (Linux) Upgrading Devices from VSL 2.x to 3.x in the user guide. Upgrading from version 1.2.x or 2.x software to 3.x: --------------------------------------------------------------------------- Upgrading Legacy adapters from 1.2.x software to version 3.2.8 offers a number of significant changes and improvements, however there are some important considerations. When performing an upgrade from 1.2.x to 3.x, you must perform a staged upgrade (upgrade to the 2.x software and firmware before upgrading to 3.x). The device driver name has also changed from fio-driver (version 1.2.x) to iomemory-vsl (2.x and above). The upgrade process from 2.x to 3.x will require the adapter to be formatted. Formatting will remove all existing data from the card and the data must be restored after the update completes. Users must back up their data before proceeding with the upgrade process to version 3.x. The firmware upgrade process updates and modifies important hardware settings that are not compatible with 1.2.x or 2.2.3 versions of software. Once updated, the card cannot be black-leveled to the previous versions of software. Please see the "change history" documentation for a complete list of new features, enhancements, and fixes. Replacing a failed legacy High IOPS card and "mandatory" update requirements: --------------------------------------------------------------------------- As the supply of legacy adapters diminishes from inventory, it becomes more likely that warranty replacement cards will transition to the newer versions of the High IOPS adapters. Replacement High IOPS cards and may require firmware updates to support the new or existing cards in the server. Any situation when mixing the flash NAND technology occurs, the minimum version of software supported by the latest generation of hardware prevails. A mandatory upgrade of software is required to support the latest generation of hardware with backward compatibility to legacy cards in the server. Over-formatting removed in v3.1.1 is now available in v3.2.4 software --------------------------------------------------------------------------- The capability to over-format IBM High IOPS adapters to larger than advertised capacities was removed in version 3.1.1, but was reintroduced in 3.2.4 VSL software. 3.2.4 fully support over-formatting. The larger capacity gains will be offset by lower write performance in this configuration. Similarly, you can increase sustained write performance when low-level formatting the device to smaller capacities. Please see the user guide for more information. Change History's Update Recommendations: --------------------------------------------------------------------------- Change histories files provide an ongoing list of changes to a series of software compatible with a family of hardware. Please review the change histories using the following guidelines as to how IBM recommends or suggests updates to code levels at the website below: http://www.ibm.com/support/entry/portal/docdisplay?brand=5000008&lndocid=HELP-FIX Installation ============ For Upgrade Installations: -------------------------- When upgrading a previous version of High IOPS software to version 3.2.8, the previous version of software must be uninstalled. After the uninstall completes, follow the New Installation procedures above, then upgrade the adapters firmware to match the device driver. See the uninstallation instructions below or consult the Linux User Guide for more information and detailed instructions that may affect your operating environment. For New Installations: ---------------------- The IBM HIGH IOPS driver distribution includes four mandatory packages: iomemory-vsl, fio-util, fio-common, and fio-sysvinit. The remaining items are optional packages. Pick the driver RPM which matches your currently running kernel. You can determine your kernel by typing 'uname -a' in a console. Install the four mandatory RPMs, and any of the optional RPMs as follows: $ rpm -i iomemory-vsl-2.6.16.60-0.85.1-default-3.2.8.1350-1.0.x86_64.rpm \ fio-util-3.2.8.1350-1.0.noarch.rpm \ fio-common-3.2.8.1350-1.0.noarch.rpm \ fio-sysvinit-3.2.8.1350-1.0.noarch.rpm \ libvsl-3.2.8.1350-1.0.noarch.rpm \ iomemory-vsl-3.2.8.1350-1.0.src.rpm \ fio-firmware-highiops-3.2.8.20140508-1.noarch.rpm \ NOTE: This command can be entered on one line, but is broken up here for clarity. Loading the Driver ------------------ After all of the desired RPM sets are installed, the VSL driver can be manually loaded using the following command: $ modprobe iomemory-vsl Driver loading will happen on boot for most distributions. If the driver fails to autoload on the next reboot, or for finer control over driver loading and unloading please see the HIGH IOPS Linux Users Guide for details on how to setup the init script. Upgrading High IOPS adapter Firmware ------------------------------------ Ensure the fio-firmware-highiops-3.2.8.20140508-1.noarch.rpm package is installed. This extracts the highiops_3.2.8-201405081.fff firmware update file to the local hard drive. To review an rpm's package intallation information, including files installed and the path locations, use the following command: rpm -aq -i -l any-rpm-package-name After installing the 3.2.8 device driver and software, you may see status messages on legacy High IOPS adapters similar to those noted below mixed in with other device information from the fio-status CLI command output: The firmware on this device is not compatible with the currently installed verion of the driver !! ---> There are active errors or warnings on this device! Read details below. ACTIVE WARNINGS: The ioMemory is currently running in a minimal state. To upgrade new adapters, run the following command: IMPORTANT NOTE: Upgrading legacy adapters to 3.2.8 will require a low level format of the device to become operational. The format will remove all data on the device. Please backup any data before proceeding. Firmware update command syntax: fio-update-iodrive /usr/share/fio/firmware/highiops_3.2.8-20140508.fff Please see the user guide for additional update instructions. Uninstallation -------------- First, quiesce all activity to the High IOPS adapter, then detach each device from the operating system with the following command: $ fio-detach Unload the VSL driver as follows: $ modprobe -r iomemory-vsl Next remove all RPMs that were installed during installation. The list of installed RPMs can easily be found by issuing the following commands: $ rpm -qa | grep fio $ rpm -qa | grep libfio $ rpm -qa | grep libvsl $ rpm -qa | grep iomemory Use RPM to remove all of the packages reported. For example: $ rpm -e libfio fio-util fio-firmware-highiops fio-snmp-agentx With versions 3.2.8 of the ioMemory VSL, you must specify the kernel version of the package you are uninstalling. Run this command to find the installed driver packages: $ rpm -qa | grep -i iomemory Sample output: iomemory-vsl-2.6.16.60-0.85.1-default Uninstall the ioMemory VSL by running a command similar to this example (specify the kernel version of the driver you wish to uninstall): $ rpm -e iomemory-vsl-2.6.16.60-0.85.1-default SNMP Agent Configuration ------------------------ For detailed instructions on configuring SNMP please see the IBM HIGH IOPS Linux Users Guide, Appendix B. 3.0 Usage information ______________________ For server configurations information for High IOPS adapters to include minimum system firmware requirements, maximum numbers of cards, cabling requirements, slot preferences and restrictions, shipping considerations, thermal and accoustical considerations, see the following URL: http://www.ibm.com/support/entry/portal/docdisplay?lndocid=SERV-IOPS To open the IBM High IOPS Management graphical application, open the installed browser to the following URL: http://localhost:9051/ Detailed usage information can be found in the following guides: - ibm_doc_highiop_3.2.8_linux_user_guide.pdf - ibm_doc_highiop_3.2.8_release_notes.pdf - ibm_doc_highiop_3.2.8_hardware_install_guide.pdf 4.0 Unattended Mode ____________________ The IBM HIGH IOPS driver and supporting packages are all RPM based. Automated installation through any standard method (kickstart, yum repositories, etc) is supported. 5.0 Web Sites and Support Phone Number ______________________________________ o You can find support and downloads for IBM products from the IBM Support Web site: Main Support Site: http://www.ibm.com/support/ IBM High IOPS Downloads: http://www.ibm.com/support/entry/portal/docdisplay?lndocid=MIGR-65723 You can find up to date support information and downloads specific to the High IOPS adapters by searching for "High IOPS" from the main support page. o For the latest compatibility information, see the IBM ServerProven Web site: http://www.ibm.com/servers/eserver/serverproven/compat/us/ o With the original purchase of an IBM hardware product, you have access to extensive support coverage. During the IBM hardware product warranty period, you may call the IBM HelpCenter (1-800-IBM-SERV in the U.S.) for hardware product assistance covered under the terms of the IBM hardware warranty. 6.0 Trademarks and Notices __________________________ This product may contain program code or packages ("code") licensed by third parties, as well as code licensed by IBM. For non-IBM Code, the third parties, not IBM, are the licensors. Your use of the non-IBM code is governed by the terms of the license accompanying that code, as identified in the attached files. You acknowledge that you have read and agree to the license agreements contained in these files. If you do not agree to the terms of these third party license agreements, you may not use the accompanying code. IBM is a registered trademark of International Business Machines Corporation in the United States and other countries. Fusion-io is a registered trademark of Fusion-io, in the United States. Linux is a registered trademark of Linus Torvalds in the United States and other countries. Other company, product, and service names may be trademarks or service marks of others. 7.0 Disclaimer ______________ THIS DOCUMENT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND. IBM DISCLAIMS ALL WARRANTIES, WHETHER EXPRESS OR IMPLIED, INCLUDING WITHOUT LIMITATION, THE IMPLIED WARRANTIES OF FITNESS FOR A PARTICULAR PURPOSE AND MERCHANTABILITY WITH RESPECT TO THE INFORMATION IN THIS DOCUMENT. BY FURNISHING THIS DOCUMENT, IBM GRANTS NO LICENSES TO ANY PATENTS OR COPYRIGHTS. Note to U.S. Government Users -- Documentation related to restricted rights -- Use, duplication or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corporation.