Qsan XCubeSAN XS5224D User manual

XCubeSAN SANOS 4.0
User’s Manual
Applicable Models:
XS5224D, XS5216D, XS5212D, XS5212S, XS5226D, XS5226S, XS3224D
XS3224S, XS3216D, XS3216S, XS3212D, XS3212S, XS3226D, XS3226S
QSAN Technology, Inc.
www.QSAN.com

Copyright
© Copyright 2017 QSAN Technology, Inc. All rights reserved. No part of this document may be
reproduced or transmitted without written permission from QSAN Technology, Inc.
April 2017
This edition applies to QSAN XCubeSAN SANOS (SAN Operating System) 4.0. QSAN believes the
information in this publication is accurate as of its publication date. The information is subject to
change without notice.
Trademarks
QSAN, the QSAN logo, XCubeSAN, and QSAN.com are trademarks or registered trademarks of QSAN
Technology, Inc.
Microsoft, Windows, Windows Server, and Hyper-V are trademarks or registered trademarks of
Microsoft Corporation in the United States and/or other countries.
Linux is a trademark of Linus Torvalds in the United States and/or other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Mac and OS X are trademarks of Apple Inc., registered in the U.S. and other countries.
Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle
and/or its affiliates.
VMware, ESXi, and vSphere are registered trademarks or trademarks of VMware, Inc. in the United
States and/or other countries.
Citrix and Xen are registered trademarks or trademarks of Citrix Systems, Inc. in the United States
and/or other countries.
Other trademarks and trade names used in this document to refer to either the entities claiming the
marks and names or their products are the property of their respective owners.

Notices i
Notices
This XCubeSAN SANOS 4.0 user’s manual is applicable to the following XCubeSAN models:
XCubeSAN Storage System 4U 19” Rack Mount Models
Model Name
Controller Type
Form Factor, Bay Count, and Rack Unit
XS5224D
Dual Controller
LFF 24-disk 4U Chassis
XS3224D
Dual Controller
LFF 24-disk 4U Chassis
XS3224S
Single Controller
LFF 24-disk 4U Chassis
XCubeSAN Storage System 3U 19”Rack Mount Models
Model Name
Controller Type
Form Factor, Bay Count, and Rack Unit
XS5216D
Dual Controller
LFF 16-disk 3U Chassis
XS3216D
Dual Controller
LFF 16-disk 3U Chassis
XS3216S
Single Controller
LFF 16-disk 3U Chassis
XCubeSAN Storage System 2U 19”Rack Mount Models
Model Name
Controller Type
Form Factor, Bay Count, and Rack Unit
XS5212D
Dual Controller
LFF 12-disk 2U Chassis
XS5212S
Single Controller
LFF 12-disk 2U Chassis
XS3212D
Dual Controller
LFF 12-disk 2U Chassis
XS3212S
Single Controller
LFF 12-disk 2U Chassis
XS5226D
Dual Controller
SFF 26-disk 2U Chassis
XS5226S
Single Controller
SFF 26-disk 2U Chassis
XS3226D
Dual Controller
SFF 26-disk 2U Chassis
XS3226S
Single Controller
SFF 26-disk 2U Chassis
Information contained in this manual has been reviewed for accuracy. But it could include
typographical errors or technical inaccuracies. Changes are made to the document
periodically. These changes will be incorporated in new editions of the publication. QSAN
may make improvements or changes in the products. All features, functionality, and product
specifications are subject to change without prior notice or obligation. All statements,

ii © Copyright 2017 QSAN Technology, Inc. All Right Reserved.
information, and recommendations in this document do not constitute a warranty of any
kind, express or implied.
Any performance data contained herein was determined in a controlled environment.
Therefore, the results obtained in other operating environments may vary significantly.
Some measurements may have been made on development-level systems and there is no
guarantee that these measurements will be the same on generally available systems.
Furthermore, some measurements may have been estimated through extrapolation. Actual
results may vary. Users of this document should verify the applicable data for their specific
environment.
This information contains examples of data and reports used in daily business operations.
To illustrate them as completely as possible, the examples include the names of individuals,
companies, brands, and products.
All of these names are fictitious and any similarity to the names and addresses used by an
actual business enterprise is entirely coincidental.

Contents iii
Table of Contents
Notices ............................................................................................................................ i
Preface ....................................................................................................................... xviii
About This Manual ......................................................................................................................xviii
Related Documents.....................................................................................................................xviii
Technical Support .......................................................................................................................xviii
Information, Tip and Caution........................................................................................................xix
Conventions...................................................................................................................................xix
1. SANOS Overview..................................................................................................... 1
1.1. Introduction to SANOS ....................................................................................................... 1
1.1.1. SANOS System Architecture ............................................................................... 1
1.1.2. SANOS Storage Pool Architecture ...................................................................... 3
1.1.3. SANOS 4.0 Functionality List .............................................................................. 4
1.2. Terminology ........................................................................................................................ 6
2. Prepare for Installation ........................................................................................... 9
2.1. Prepare for Configuration Planning................................................................................... 9
2.1.1. Configuration Planning for Initial Setup ........................................................... 15
2.1.2. Management IP Configuration Planning .......................................................... 16
2.1.3. Notification Configuration Planning ................................................................. 16
2.1.4. iSCSI Configuration Planning ............................................................................ 16
2.1.5. Fibre Channel Configuration Planning.............................................................. 18
2.1.6. Storage Configuration Planning........................................................................ 19
2.1.7. Backup Configuration Planning......................................................................... 20
2.2. System Parameters .......................................................................................................... 21
2.3. Configuration Example ..................................................................................................... 24
3. Getting Started...................................................................................................... 31
3.1. Power on the Storage System.......................................................................................... 31
3.2. Discover the SAN Storage System .................................................................................. 31
3.2.1. QFinder Utility ..................................................................................................... 31
3.3. Initial Setup........................................................................................................................ 33
4. SANOS User Interface........................................................................................... 38
4.1. Accessing the Management Web UI ............................................................................... 38
4.2. SANOS 4.0 Desktop Panel................................................................................................ 39
4.3. Function Menus ................................................................................................................ 40
4.3.1. Dashboard Menu................................................................................................ 41

iv © Copyright 2017 QSAN Technology, Inc. All Right Reserved.
4.3.2. System Settings Menu....................................................................................... 41
4.3.3. Host Configuration Menu .................................................................................. 42
4.3.4. Storage Management Menu.............................................................................. 43
4.3.5. Data Backup Menu............................................................................................. 44
4.3.6. Virtualization Menu ............................................................................................ 44
4.3.7. Monitoring Menu................................................................................................ 45
4.4. Accessing the Management USB LCM ........................................................................... 45
5. Dashboard ............................................................................................................ 50
5.1. Dashboard ......................................................................................................................... 50
5.2. Hardware Monitoring........................................................................................................ 57
6. System Settings.................................................................................................... 60
6.1. General System Settings .................................................................................................. 60
6.2. Management Port Settings .............................................................................................. 62
6.3. Power Settings.................................................................................................................. 65
6.3.1. Boot Management Settings............................................................................... 65
6.3.2. Cache to Flash Status........................................................................................ 67
6.3.3. UPS Settings and Status.................................................................................... 68
6.4. Notification Settings......................................................................................................... 71
6.4.1. Email Settings..................................................................................................... 71
6.4.2. Alert Settings ...................................................................................................... 72
6.4.3. SNMP Settings ................................................................................................... 74
6.5. Maintenance...................................................................................................................... 76
6.5.1. System Information ........................................................................................... 76
6.5.2. Firmware Update................................................................................................ 78
6.5.3. Firmware Synchronization................................................................................. 81
6.5.4. System Identification ......................................................................................... 81
6.5.5. Reset to Factory Defaults .................................................................................. 82
6.5.6. Configuration Backup ........................................................................................ 84
6.5.7. Reboot and Shutdown........................................................................................ 85
7. Host Configuration................................................................................................ 86
7.1. Host Protocol Technology................................................................................................ 86
7.1.1. iSCSI Technology ............................................................................................... 86
7.1.2. Fibre Channel Technology................................................................................. 87
7.2. Host Connectivity Overview ............................................................................................. 88
7.3. Configure iSCSI Connectivity ........................................................................................... 90
7.3.1. Configure iSCSI Ports ........................................................................................ 90
7.3.2. Configure iSCSI Settings.................................................................................... 95
7.3.3. Configure iSCSI Targets .................................................................................... 96
7.3.4. Configure iSCSI CHAP Accounts ....................................................................100

Contents v
7.3.5. Active Sessions ................................................................................................102
7.4. Configure Fibre Channel Connectivity ...........................................................................104
7.4.1. Configure Fibre Channel Link Speed...............................................................104
7.4.2. Configure Fibre Channel Topology .................................................................105
7.4.3. Configure Fibre Channel Targets ....................................................................106
7.4.4. Clear Fibre Channel Counters..........................................................................107
8. Storage Management.......................................................................................... 108
8.1. RAID Technology.............................................................................................................108
8.2. SANOS Storage Architecture .........................................................................................113
8.2.1. Pool Technology...............................................................................................113
8.2.2. Volume Technology .........................................................................................114
8.2.3. LUN Technology...............................................................................................115
8.2.4. Hot Spares........................................................................................................ 117
8.3. Working with Disk Drives................................................................................................118
8.3.1. List Disks ..........................................................................................................119
8.3.2. Operations on Disks.........................................................................................121
8.3.3. S.M.A.R.T. .........................................................................................................124
8.4. Configure Thick Provisioning Pools ..............................................................................126
8.4.1. Create a Thick Provisioning Pool.................................................................... 126
8.4.2. List Thick Provisioning Pools .......................................................................... 131
8.4.3. Operations on Thick Provisioning Pools ........................................................133
8.4.4. Migrate a Thick Provisioning Pool ..................................................................136
8.4.5. Operation Limitations during Migration ......................................................... 139
8.5. Configuring Volumes...................................................................................................... 140
8.5.1. Create a Volume............................................................................................... 140
8.5.2. List Volumes.....................................................................................................144
8.5.3. Operations on Volumes ...................................................................................145
8.5.4. Extend Volume Capacity.................................................................................. 150
8.5.5. Fast RAID Rebuild.............................................................................................151
8.6. Configure LUN Mappings ...............................................................................................153
8.6.1. Map a LUN of iSCSI Connectivity....................................................................153
8.6.2. Map a LUN of Fibre Channel Connectivity......................................................154
8.6.3. List LUN Mappings........................................................................................... 155
8.6.4. Operations on LUN Mappings .........................................................................156
8.7. Connect by Host Initiator................................................................................................ 156
8.8. Disk Roaming ..................................................................................................................157
9. Thin Provisioning................................................................................................ 158
9.1. Overview ..........................................................................................................................158
9.1.1. Thick Provisioning vs. Thin Provisioning........................................................ 159
9.2. Theory of Operation........................................................................................................160

vi © Copyright 2017 QSAN Technology, Inc. All Right Reserved.
9.2.1. Thin Provisioning Architecture........................................................................160
9.2.2. Space Reclamation ..........................................................................................161
9.3. Configure Thin Provisioning Pools ................................................................................ 161
9.3.1. Create a Thin Provisioning Pool......................................................................162
9.3.2. List Thin Provisioning Pools............................................................................167
9.3.3. Operations on Thin Provisioning Pools ..........................................................170
9.3.4. Add a Disk Group in a Thin Provisioning Pool................................................173
9.4. Configure Volumes .........................................................................................................175
9.4.1. Create a Volume in a Thin Provisioning Pool.................................................175
9.4.2. List Volumes and Operations on Volumes.....................................................179
9.5. Configure LUN Mappings and Connect by Host Initiator............................................. 180
10. SSD Cache .......................................................................................................... 181
10.1. Overview ..........................................................................................................................181
10.2. Theory of Operation........................................................................................................183
10.2.1. System Memory and SSD Cache Capacity.....................................................183
10.2.2. SSD Cache Pool Architecture..........................................................................184
10.2.3. RAID Level of SSD Cache Pool........................................................................186
10.2.4. Read/Write Cache Cases.................................................................................188
10.2.5. Populating the Cache.......................................................................................192
10.2.6. SSD Cache Tuning............................................................................................193
10.3. Configure SSD Cache .....................................................................................................194
10.3.1. Enable SSD Cache License..............................................................................194
10.3.2. Create an SSD Cache Pool ..............................................................................195
10.3.3. List SSD Cache Pools.......................................................................................199
10.3.4. Operations on SSD Cache Pools.....................................................................202
10.4. Monitor SSD Cache Statistics........................................................................................204
10.5. SSD Cache Notices......................................................................................................... 207
11. Auto Tiering........................................................................................................ 208
11.1. Overview ..........................................................................................................................208
11.1.1. SSD Cache vs. Auto Tiering............................................................................. 209
11.2. Theory of Operation........................................................................................................210
11.2.1. Auto Tiering Architecture.................................................................................211
11.2.2. Hotness Analysis .............................................................................................212
11.2.3. Relocation.........................................................................................................213
11.2.4. Tiering Policies................................................................................................. 214
11.3. Configure Auto Tiering Pools.........................................................................................216
11.3.1. Enable Auto Tiering License............................................................................216
11.3.2. Create an Auto Tiering Pool ............................................................................216
11.3.3. List Auto Tiering Pools.....................................................................................222
11.3.4. Operations on Auto Tiering Pools...................................................................225

Contents vii
11.3.5. Add a Tier (Disk Group) in an Auto Tiering Pool ............................................227
11.3.6. Hot Spares in an Auto Tiering Pool.................................................................228
11.4. Configure Volumes .........................................................................................................228
11.4.1. Create a Volume in an Auto Tiering Pool .......................................................228
11.4.2. List Volumes and Operations on Volumes.....................................................232
11.5. Configure LUN Mappings and Connect by Host Initiator.............................................233
11.6. Auto Tiering Notices.......................................................................................................233
11.7. Transfer to Auto Tiering Pool......................................................................................... 233
11.7.1. Transfer from Thick Provisioning Pool to Auto Tiering.................................233
11.7.2. Transfer from Thin Provisioning Pool to Auto Tiering...................................235
12. Data Backup........................................................................................................ 239
12.1. Managing Snapshots...................................................................................................... 239
12.1.1. Theory of Operation .........................................................................................239
12.1.2. Configure Snapshot ......................................................................................... 242
12.1.3. Configure Rollback Snapshot.......................................................................... 246
12.1.4. Configure Schedule Snapshots.......................................................................247
12.1.5. Snapshot Notices.............................................................................................248
12.2. Managing Local Clones..................................................................................................250
12.2.1. Theory of Operation .........................................................................................251
12.2.2. Configure Local Clone .....................................................................................253
12.2.3. Configure Schedule Local Clone Tasks.......................................................... 256
12.2.4. Local Cloning Options......................................................................................257
12.2.5. Local Clone Notices......................................................................................... 259
12.3. Managing Remote Replications..................................................................................... 259
12.3.1. Remote Replication Topologies ......................................................................260
12.3.2. Theory of Operation .........................................................................................263
12.3.3. Configure Remote Replication ........................................................................265
12.3.4. Configure Traffic Shaping ............................................................................... 271
12.3.5. Configure Schedule Remote Replication Tasks............................................. 273
12.3.6. Replication Options.......................................................................................... 274
12.3.7. Configure MPIO in Remote Replication Task.................................................275
12.3.8. Configure MC/S in Remote Replication Task Path........................................281
12.3.9. Local Clone Transfers to Remote Replication ...............................................284
13. Monitoring .......................................................................................................... 290
13.1. Log Center .......................................................................................................................290
13.1.1. Operations on Event Logs ............................................................................... 291
13.2. Monitoring Enclosures....................................................................................................292
13.2.1. Hardware Monitoring.......................................................................................292
13.2.2. Configuring SES................................................................................................294
13.3. Performance Monitoring ................................................................................................296

viii © Copyright 2017 QSAN Technology, Inc. All Right Reserved.
13.3.1. Disk Performance Monitoring .........................................................................296
13.3.2. iSCSI Port Performance Monitoring ............................................................... 297
13.3.3. Fibre Channel Port Monitoring ........................................................................298
14. Troubleshooting.................................................................................................. 299
14.1. Fault Isolation Methodology ..........................................................................................299
14.1.1. Basic Steps.......................................................................................................299
14.1.2. Stopping I/O......................................................................................................299
14.1.3. Diagnostic Steps ..............................................................................................300
14.2. Rebuild .............................................................................................................................300
14.3. Volume Restoration ........................................................................................................302
14.3.1. Configure Volume Restoration........................................................................303
15. Support and Other Resources.............................................................................. 304
15.1. Getting Technical Support.............................................................................................. 304
15.2. Online Customer Support ...............................................................................................306
15.3. Accessing Product Updates...........................................................................................310
15.4. Documentation Feedback ..............................................................................................311
Appendix..................................................................................................................... 312
Glossary and Acronym List.........................................................................................................312
End-User License Agreement (EULA) ........................................................................................ 315