Hitachi NVM Navigator v03-07 User manual

MK-99COM024-12
Hitachi Compute Blade
HVM Navigator User's Guide - Migration
Document organization
Product version
Getting help
Contents
F AST F IND L INKS

ii
HVM Navigator User's Guide - Migration
© 2012-2015Hitachi, Ltd. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or by any
means, electronic or mechanical, including photocopying and recording, or stored
in a database or retrieval system for any purpose without the express written
permission of Hitachi, Ltd.
Hitachi, Ltd., reserves the right to make changes to this document at any time
without notice and assumes no responsibility for its use. This document contains
the most current information available at the time of publication. When new or
revised information becomes available, this entire document will be updated and
distributed to all registered users.
Some of the features described in this document might not be currently available.
Refer to the most recent product announcement for information about feature and
product availability, or contact Hitachi Data Systems Corporation at
https://portal.hds.com.
Notice: Hitachi, Ltd., products and services can be ordered only under the terms
and conditions of the applicable Hitachi Data Systems Corporation agreements.
The use of Hitachi, Ltd., products is governed by the terms of your agreements
with Hitachi Data Systems Corporation.
Hitachi is a registered trademark of Hitachi, Ltd., in the United States and other
countries. Hitachi Data Systems is a registered trademark and service mark of
Hitachi, Ltd., in the United States and other countries.
Archivas, Essential NAS Platform, HiCommand, Hi-Track, ShadowImage,
Tagmaserve, Tagmasoft, Tagmasolve, Tagmastore, TrueCopy, Universal Star
Network, and Universal Storage Platform are registered trademarks of Hitachi Data
Systems Corporation.
AIX, AS/400, DB2, Domino, DS8000, Enterprise Storage Server, ESCON, FICON,
FlashCopy, IBM, Lotus, OS/390, RS6000, S/390, System z9, System z10, Tivoli,
VM/ESA, z/OS, z9, zSeries, z/VM, z/VSE are registered trademarks and DS6000,
MVS, and z10 are trademarks of International Business Machines Corporation.
All other trademarks, service marks, and company names in this document or
website are properties of their respective owners.
Microsoft product screen shots are reprinted with permission from Microsoft
Corporation.

Contents iii
HVM Navigator User's Guide - Migration
Contents
Preface ....................................................................................................ix
Intended audience ................................................................................................ x
Product version ..................................................................................................... x
Release notes ....................................................................................................... x
Document organization......................................................................................... xi
Referenced documents ......................................................................................... xi
Document conventions .........................................................................................xii
Convention for storage capacity values .................................................................xiii
Getting help........................................................................................................xiv
Comments ..........................................................................................................xiv
Overview............................................................................................... 1-1
Usage environments .............................................................................. 2-1
Environment ...................................................................................................... 2-2
Environment for Shutdown mode.................................................................. 2-2
Environment for Concurrent Maintenance mode ............................................ 2-6
Time period for migration ................................................................................. 2-10
Time period for Shutdown mode................................................................. 2-10
Time period for Concurrent Maintenance mode ........................................... 2-10
Application requirements .................................................................................. 2-12
Application requirement for Shutdown mode ............................................... 2-16
Application requirement for Concurrent Maintenance mode .......................... 2-42
Migration procedures ............................................................................. 3-1
Shutdown mode ................................................................................................. 3-2
Procedure for Shutdown mode ..................................................................... 3-3
Recovering LPAR ....................................................................................... 3-13
Concurrent Maintenance mode.......................................................................... 3-19
Prerequisite setting.................................................................................... 3-19

iv Contents
HVM Navigator User's Guide - Migration
Procedure for Concurrent Maintenance mode ..............................................3-28
Confirming if Concurrent Maintenance mode finished normally......................3-43
Recovering LPAR........................................................................................3-45
Rolling back WWNs ....................................................................................3-51
Policy migration................................................................................................3-56
Procedure to create migration policy ...........................................................3-57
Procedure to execute Policy migration .........................................................3-62
Procedure to interrupt Policy migration........................................................3-66
Procedure to edit Policy migration...............................................................3-67
Return migration ..............................................................................................3-74
Exchanging or updating hardware or software....................................................3-74
Saving and backing up HVM configuration..........................................................3-75
Saving HVM configuration...........................................................................3-75
Backing up HVM configuration ....................................................................3-77
Registering/removing migration WWN................................................................3-80
Flow to register/remove migration WWN .....................................................3-81
Prerequisite Setting....................................................................................3-82
Registering migration WWN to host group ...................................................3-96
Removing migration WWN from host group .................................................3-98
Giving migration WWN a nickname ........................................................... 3-100
Exporting CSV file .................................................................................... 3-104
Adding storage device .............................................................................. 3-106
Commands for Storage Navigator Modular 2 CLI executed from HVM Navigator3-113
Other functions and settings................................................................... 4-1
Functions and settings for Shutdown and Concurrent Maintenance modes .............4-2
Confirming applicable conditions before migration execution ..........................4-2
Specifying LAN port (IP address) for management server ...............................4-4
Tracing back Migration History on LPARs .......................................................4-5
Functions and settings for Shutdown mode ..........................................................4-7
Automatic shutdown of source LPAR .............................................................4-7
Automatic shutdown setup ...........................................................................4-8
Changing setting of CPU, memory and service ratio on destination ...............4-10
Functions and settings for Concurrent Maintenance mode ...................................4-11
Executing Rehearsal...................................................................................4-11
Executing Connectivity Test ........................................................................4-14
Extending timeout period for LPAR migration in Concurrent Maintenance mode4-17
Canceling LPAR migration...........................................................................4-19
Monitoring memory transfer .......................................................................4-21
Usage notes .......................................................................................... 5-1
Backing up and restoring HVM configuration ........................................................5-5
Backing up HVM configuration ......................................................................5-5

Contents v
HVM Navigator User's Guide - Migration
Restoring HVM configuration ........................................................................ 5-5
Initialization of HVM configuration (DC command of management module)............ 5-6
Changing HVM system time on destination HVM................................................... 5-7
Operation deterrence.......................................................................................... 5-7
Exchanging NIC or FC HBA switches while server blade is in operation .................. 5-7
Setting network segment assigned to activated LPARs as migration path ............... 5-8
State of NIC or FC HBA ports on destination HVM................................................. 5-8
High CPU and network load ................................................................................ 5-8
Migration to destination with difference on connection to storage device ............... 5-9
Changing VNIC System No. on the system environment where LPAR migration has
been executed........................................................................................... 5-10
Migration of parameters to apply remote shutdown to source LPAR..................... 5-10
Service ratio after migration.............................................................................. 5-11
Migration of server with dedicated PCI device allocation ..................................... 5-11
Migration of MAC addresses .............................................................................. 5-11
Migration of WWPNs......................................................................................... 5-11
Migration of LPAR enabling VC (Virtual COM) console ......................................... 5-12
Migration of LPAR with assigned virtual NICs ..................................................... 5-12
Ports with Inter-LPAR Packet Filterings set to "Enable" are assigned to the LPAR to
migrate ..................................................................................................... 5-12
Migration of USB assignment state .................................................................... 5-13
Scheduling mode of assigned USB is dedicated............................................ 5-13
Scheduling mode of assigned USB is exclusive shared.................................. 5-14
Certain FC HBA port is changed from shared to dedicated .................................. 5-16
Duplication of displayed or retrieved WWN.................................................. 5-16
Failure on remote shutdown of Windows ........................................................... 5-16
Shutting down or rebooting guest OS on the LPAR to migrate............................. 5-17
Migrating LPAR where EFI Shell is running ......................................................... 5-19
Packet-lost during LPAR migration..................................................................... 5-19
Memory high-load on guest OS on the LPAR to migrate ...................................... 5-19
Clock on guest OS on the LPAR to migrate in Concurrent Maintenance mode ....... 5-20
Network setting on Linux OS on the LPAR to migrate.......................................... 5-20
Confirming if the states of FC HBA ports are stable............................................. 5-21
Guide to resolution of slow update .................................................................... 5-23
Values of Processor Node and Memory Node ..................................................... 5-23
Display in Source and Destination group box...................................................... 5-23
Policy migration................................................................................................ 5-24
Executing migrations by operating multiple HVM Navigators ............................... 5-24
Migration timeout in Concurrent Maintenance mode ........................................... 5-24
Setting of scheduling operation for the LPAR to migrate ..................................... 5-24
Backing up HVM configuration by operating SC/BSM........................................... 5-24
SC/BSM alerts for Shutdown mode .................................................................... 5-25
SC/BSM alerts for Concurrent Maintenance mode ............................................... 5-25
SC/BSM Display after Migration with Windows Server 2008 R2............................ 5-26

vi Contents
HVM Navigator User's Guide - Migration
N+M Failover during Migration ..........................................................................5-26
Migrating LPAR form the standby server blade after Cold standby switching.........5-27
Test of Configuring N+M Cold Standby ..............................................................5-28
Cold standby switching after migration...............................................................5-28
Combined use with Uninterruptible Power Supply (UPS)......................................5-28
Suppression of HVM auto shutdown during migration .........................................5-29
Troubleshooting..................................................................................... 6-1
Troubleshooting flow ..........................................................................................6-2
Taking action when LPAR activation has been disabled .........................................6-3
Taking action when Policy migration has failed .....................................................6-3
Troubleshooting FAQs.........................................................................................6-7
Error message “Failed Get Migration List (mms: ls)” popped up ......................6-7
Remote shutdown of server has failed.........................................................6-10
Migration has failed with “The source LPAR is activated” message ................6-13
Migration has failed with “The specified blade is busy” message ...................6-15
Source and destination panes show “Un-registration” chassis .......................6-16
Migration has failed by response timeout.....................................................6-17
Migration has failed with “Error occurred during initialization of VM” message6-18
Cannot access guest OS .............................................................................6-19
Migration has failed with “Transferring device data cannot be completed within
an LPAR suspension period.” message..................................................6-20
Migration has failed with “Connection refused (HVM-HVM)” message ............6-21
Migration has failed with “Wait until another operation is completed, and retry.”
message .............................................................................................6-22
Migration has failed with “HVM access error” message .................................6-23
Migration has failed with “LPAR Migration process was canceled Memory write is
intensive.” message.............................................................................6-24
Migration has failed after Migration process had been completed ..................6-25
Migration has failed with
"EMG000000003004006:000000000000003b:0000000000000030:(0):HVM(S
RC):Internal error." .............................................................................6-26
Migration has failed with
"EMG000000002ab4006:000000000000003e:0000000000000030:(0):HVM(S
RC):Internal error. The HVM detected an FC error." ..............................6-27
Migration has failed with "LPAR Migration was canceled. FC Login timeout
(Migration WWN)." ..............................................................................6-28
Migration has failed with "HVM(SRC):Internal error. The HVM detected an FC
error." ................................................................................................6-29
Migration has failed with
"EMG0000000000003005:0000000000000000:0000000000000222:(1):LPAR
Mover(DST):Unknown error"................................................................6-30
Error information ..............................................................................................6-31
Detailed error information detected by Migration Management Client ............6-32

Contents vii
HVM Navigator User's Guide - Migration
Detailed error information detected by Migration Management Server........... 6-33
Detailed error information detected by Migration Management Server thread
module............................................................................................... 6-39
Detailed error information detected by LPAR Mover module ......................... 6-40
Detailed error information detected by Recovery module ............................. 6-41
Detailed error information detected by the source HVM................................ 6-42
Collecting failure information............................................................................. 6-43
List of icons ........................................................................................... 7-1

viii Contents
HVM Navigator User's Guide - Migration

Preface ix
HVM Navigator User's Guide - Migration
Preface
This document provides site planning information for Compute Blade. Please
read this document carefully, and maintain a copy for reference.
This preface includes the following information:
Intended audience
Product version
Release notes
Document organization
Referenced documents
Document conventions
Convention for storage capacity values
Getting help
Comments
Notice: The use of Compute Blade and all other Hitachi Data Systems
products is governed by the terms of your agreement(s) with Hitachi Data
Systems.

xPreface
HVM Navigator User's Guide - Migration
Intended audience
This document is intended for the personnel who are involved in planning,
managing, and performing the tasks to prepare your site for Compute Blade
installation and to install the same.
This document assumes the following:
The reader has a background in installation and operation of software.
(Firmware, Driver for Hardware, Operating System and Applications)
The reader is familiar with the location where the Compute Blade will be
installed, including knowledge of physical characteristics, power systems
and specifications, and environmental specifications.
Product version
This document revision applies to HVM Navigator V03-07.
Release notes
Read the release notes before installing and using this product. They may
contain requirements or restrictions that are not fully described in this
document or updates or corrections to this document.

Preface xi
HVM Navigator User's Guide - Migration
Document organization
The table below provides an overview of the contents and organization of this
document. Click the chapter title in the left column to go to that chapter. The
first page of each chapter provides links to the sections in that chapter.
Chapter
Description
Chapter 1, Overview
Describes the overview of LPAR migration.
Chapter 2, Usage
environments
Describes the usage environments.
Chapter 3, Migration
procedures
Describes the migration procedures.
Chapter 4, Other functions
and settings
Describes some of the other functions and settings of migration.
Chapter 5, Usage notes
Describes the usage notes.
Chapter 6 Troubleshooting
Describes the troubleshooting.
Chapter 7 List of icons
Describes the icons which are displayed in the windows.
Referenced documents
Compute Blade documents:
Hitachi Compute Blade 2000 USER'S GUIDE
Hitachi Compute Blade 320 USER'S GUIDE
Hitachi Compute Blade 500 Series Logical partitioning manager User's
Guide
Hitachi Compute Blade 2500 Series Logical partitioning manager User
Guide
Hitachi Compute Blade HVM Navigator User’s Guide Getting Started

xii Preface
HVM Navigator User's Guide - Migration
Document conventions
This document uses the following typographic conventions:
Convention
Description
Regular text bold
In text: keyboard key, parameter name, property name, hardware labels,
hardware button, hardware switch.
In a procedure: user interface item
Italic
Variable, emphasis, reference to document title, called-out term
Screen text
Command name and option, drive name, file name, folder name, directory
name, code, file content, system and application output, user input
< > (angled brackets)
Variable (used when italic is not enough to identify variable).
[ ] (square bracket)
Optional values
{ } braces
Required or expected value
| vertical bar
Choice between two or more options or arguments
_(underline)
Default value, for example, [a | b]
This document uses the following icons to draw attention to information:
Icon
Meaning
Description
WARNING
This indicates the presence of a potential risk that might cause death
or severe injury.
CAUTION
This indicates the presence of a potential risk that might cause
relatively mild or moderate injury.
NOTICE
NOTICE
This indicates the presence of a potential risk that might cause severe
damage to the equipment and/or damage to surrounding properties.
Note
This indicates notes not directly related to injury or severe damage to
equipment.
Tip
This indicates advice on how to make the best use of the equipment.

Preface xiii
HVM Navigator User's Guide - Migration
Convention for storage capacity values
Physical storage capacity values (for example, disk drive capacity) are
calculated based on the following values:
Physical capacity unit
Value
1 kilobyte (KB)
1,000 (103) bytes
1 megabyte (MB)
1,000 KB or 1,0002bytes
1 gigabyte (GB)
1,000 MB or 1,0003bytes
1 terabyte (TB)
1,000 GB or 1,0004bytes
1 petabyte (PB)
1,000 TB or 1,0005bytes
1 exabyte (EB)
1,000 PB or 1,0006bytes
Logical storage capacity values (for example, logical device capacity) are
calculated based on the following values:
Logical capacity unit
Value
1 block
512 bytes
1 KB
1,024 (210) bytes
1 MB
1,024 KB or 1,0242bytes
1 GB
1,024 MB or 1,0243bytes
1 TB
1,024 GB or 1,0244bytes
1 PB
1,024 TB or 1,0245bytes
1 EB
1,024 PB or 1,0246bytes

xiv Preface
HVM Navigator User's Guide - Migration
Getting help
The Hitachi Data Systems customer support staff is available 24 hours a day,
seven days a week. If you need technical support, log on to the Hitachi Data
Systems Portal for contact information: https://portal.hds.com
Comments
Please send us your comments on this document: doc.com[email protected]m.
Include the document title and number including the revision level (for
example, -07), and refer to specific sections and paragraphs whenever
possible. All comments become the property of Hitachi Data Systems
Corporation.
Thank you!

1
Overview 1-1
HVM Navigator User's Guide - Migration
Overview
This chapter describes the overview of LPAR migration.

1-2 Overview
HVM Navigator User's Guide - Migration
LPAR migration is the function to transfer an LPAR from a server blade to
another one. You can execute LPAR migration to maintain server blades and
use resources such as CPU, memory, NIC, and FC HBA efficiently. By
executing LPAR migration, you can transfer MAC addresses and WWNs,
accompanying logical NICs and HBAs assigned to the LPAR to migrate, along
with other kinds of configuration data, namely, you can reconfigure the LPAR
briefly on the destination server blade without reconfiguring any settings for
the LPAR.
You can select a mode to migrate an LPAR from two modes: Shutdown mode
and Concurrent Maintenance mode. You can have an LPAR migrate with the
guest OS on the LPAR running in Concurrent Maintenance mode. Therefore,
you can exchange or update some kinds of hardware and software without
suspending services provided on the LPAR, whereas, you can have an LPAR
migrate with the guest OS on the LPAR down in Shutdown mode. Therefore,
you must shut down the guest OS in advance or set the shutdown option for
the guest OS so that the guest OS is shut down automatically prior to
migration when you execute the LPAR migration.
When you execute LPAR migration in Concurrent Maintenance mode, you can
exchange or update the following kinds of hardware and software. For the
procedures, see “Exchanging or updating hardware or software” in “Migration
procedures”.
Figure 1-1 Exchangeable hardware and software with LPAR migration in
Concurrent Maintenance mode
Management module
BMC
HVM
Server Blade
EFI/BIOS
Server
Chassis
NIC
FC HBA *
Migrating all LPARs
: Item does not recommend to be exchanged or updated
with LPAR migration in Concurrent Maintenance mode
: Item recommends to be exchanged or updated
with LPAR migration in Concurrent Maintenance mode
Management module
Server Blade
Server
Chassis
Source
Destination
CPU
Memory
SD Card
*: Item recommends to be exchanged or updated
only when exchange operation while a server blade is in operation is not supported.

Overview 1-3
HVM Navigator User's Guide - Migration
Table 1-1 Exchangeable hardware and software with Concurrent
Maintenance mode
Hardware/software
Operator
HVM firmware
User
SD card
Maintenance crew
CPU indicating issues
Memory indicating issues
NIC/FC HBA switch which doesn’t support exchanging while the server blade is in
operation
EFI/BIOS firmware
BMC firmware
server blade
The application requirements and the kinds of configuration data to migrate,
are different between Shutdown mode and Concurrent Maintenance mode.
Application requirements for Shutdown mode are much less than those for
Concurrent Maintenance mode. When you have an LPAR migrate on a server
blade on a system environment for the first time, we recommend that you
have the LPAR migrate in Shutdown mode.
Figure 1-2 Differences of application requirements between Shutdown
mode and Concurrent Maintenance mode
Application requirements
for Shutdown mode
Application requirements
for Concurrent Maintenance mode

1-4 Overview
HVM Navigator User's Guide - Migration
Also, the kinds of configuration data to migrate or be exchanged are different
between Shutdown mode and Concurrent Maintenance mode. For the kinds of
configuration data to migrate or be exchanged in both Shutdown mode and
Concurrent Maintenance mode, see the following table. Note that you can
confirm if you can set each item manually in the “Setting”column.
Table 1-2 List of configuration data to migrate
Grouping
Item
Setting
Migration to destination
Shutdown
Concurrent
Maintenance
LPAR
Configuration
LPAR number
Yes
No
LPAR name
Yes
Yes
No. of assigned Logical CPUs
1
Yes
Shared
mode
No. of assigned processors
Yes
Yes
Dedicated
mode
No. of assigned processors
Yes
Yes
Processor number
Yes
No
Whereas, when the guest
NUMA function is enabled,
“Yes”.
Service ratio
Yes
Yes
Allocated memory size
Yes
Yes
Idle Detection
Yes
Yes
Auto Activation Order
Yes
Yes
Auto Clear
Yes
Yes
Processor Capping
Yes
Yes
Virtual
Console
Enabled(Y)/Disabled(N)
Yes
Yes
Virtual Console Port#
Yes
No
(It depends on the setting
on destination server
blade.)
Pre-Boot
Yes
Yes
Guest
NUMA
Enabled(Y)/Disabled(N)
Yes
Yes
Memory size for each node
Yes
Yes
Partition Reference Time Enlightenment
Yes
Yes
Logical CPU
CPUID
No
No
Processor Node
No
2
Memory
Allocated memory size
Yes
Yes
SMAP
No
No
Memory Node
Yes
2
Interrupt
PIC
No
No
Yes
I/O APIC
No
No
Yes
Logical PCI
PCI Configuration
No
No
Yes

Overview 1-5
HVM Navigator User's Guide - Migration
Grouping
Item
Setting
Migration to destination
Shutdown
Concurrent
Maintenance
USB auto attachment
Yes
No
Logical FC HBA
Slot number
Shared FC#
No
No
Slot#/Port#
No
No
Relative slot
number
Logical PCI address
No
Yes
Virtual WWN
No
Exchanged between the
source and destination
vfcID
No
No
(The smallest available
number is assigned.)
Whereas, when the HBA
Core Dedicated Mode is
enabled, “Yes”.
NVRAM(setting of FC HBA)
Yes
Yes
MMIO Register
No
No
Yes
Shared NIC
Logical MAC address
(MAC seed)
Yes
Exchanged between the
source and destination
Logical MAC address set manually
3
-
Virtual NIC assignment #
Yes
Yes
VLAN mode
(Tag, Untag or Undef)
Yes
Yes
VLANID
Yes
Yes
MMIO Register
No
No
Yes
VNIC Device Type
Yes
Yes
VF NIC
Logical MAC address
(MAC seed)
No
Exchanged
between the
source and
destination
-
Logical MAC address set manually
3
-
Virtual NIC assignment #
Yes
Yes
-
VLAN mode
(Tag, Untag or Undef)
Yes
Yes
-
VLANID
Yes
Yes
-
VNIC PCP
No
Yes
-
TXRATE
Yes
Yes
-
Virtual LAN
Switch
Promiscuous mode
Yes
Yes
Inter-LPAR Packet Filtering
Yes
No
(It depends on the setting
on destination server
blade.)
Time
OS System
Time
Recorded on memory on OS
No
Yes

1-6 Overview
HVM Navigator User's Guide - Migration
Grouping
Item
Setting
Migration to destination
Shutdown
Concurrent
Maintenance
LPAR Time
Logical RTC information
(CMOS timer)
No
Yes
HVM
System
Time
HVM internal information
(Physical RTC information)
No
No
(The time difference
between the source and
destination server blades is
migrated.)
Physical RTC Time
No
No
SEL Time
Time Mode
Yes
No
Date and Time
Yes
No
Time Zone
Yes
No
Import Config
Yes
No
TimeSync
Yes
No
Local timer
device
HPET
No
No
Yes
PIT
No
No
Yes
PM Timer
No
No
Yes
The other local
devices
USB
Assigned state
(A, #A or *)
Yes
Yes
Used state
(R or #R)
No
-
No
VGA
Assigned state
(A or *)
Yes
Yes
VRAM data
No
No
Yes
VGA Register
No
No
Yes
Super I/O
No
No
Yes
Serial
IO Port Register
No
No
Output data of Serial
Terminal
No
No
Firmware
SMBIOS
No
No
UUID
No
Yes
Logical EFI
(UEFI)
EFI program
No
No
VGA BIOS program
No
No
NVRAM
No
Yes
Logical BMC
Scheduled turning
on/off
No
Yes
ACPI
Table
No
No
Yes
Register
No
No
Yes
AML
No
No
Yes
Security
Certificate
Server certificate
4
No