Pivot3 X5-6500 User manual

X-Series Hyperconverged Nodes
Powered by Acuity 2.3
Setup & User Guide
Document Version 1.0
January 15, 2018

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
| 2
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
Purpose
This edition applies to Pivot3’s X-Series Hyperconverged Nodes powered by the Acuity software platform (Version
2.3.1 and above) and to any subsequent releases until otherwise indicated in new editions. Specific
documentation on other Pivot3 offerings are available in the Pivot3 documentation repository.
This document contains information proprietary to Pivot3, Inc. and shall not be reproduced or transferred to
other documents or used for any purpose other than that for which it was obtained without the express written
consent of Pivot3, Inc.
How to Contact Pivot3
Pivot3, Inc. General Information: info@pivot3.com
Austin, TX 78701 Tech Support: support@pivot3.com
Tel: +1 512-807-2666 Website: www.pivot3.com
Fax: +1 512-807-2669 Online Support: support.pivot3.com
About This Guide
This document provides procedures for:
•Connecting X-Series Hyperconverged Nodes powered by Acuity to the VMware and ESXi management
networks
•Combining nodes to create an Acuity vPG
This guide is written for Service Engineers and System Administrators configuring a Pivot3 X-Series Solution. The
Pivot3 nodes should be set up as described in the appropriate hardware setup guide, and the procedures in this
document require an understanding of the following:
•The operating systems installed on the application servers connected to the Acuity vPG
•Communication protocols installed on local application servers
•vSphere Client for access to VMware ESXi hosts or vCenter
© Copyright 2018 Pivot3, Inc.
All rights reserved. Specifications are subject to change without notice. Pivot3, Acuity, RAIGE, Pivot3 vSTAC, Pivot3 vSTAC OS, Pivot3 vSTAC Enterprise
HCI, Pivot3 vSTAC P Cubed, Pivot3 vSTAC R2S, Pivot3 vSTAC Edge, Pivot3 vSTAC Manager, Pivot3 vSTAC Watch, Pivot3 Virtual Security Server (VSS),
Pivot3 Enterprise HCI, and High-Definition Storage are trademarks or registered trademarks of Pivot3. All other brands or products are trademarks or
registered trademarks of their respective holders and should be treated as such. Pivot3 reserves the right to make changes or corrections to this
document as needed without notification.

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
3|
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
Table of Contents
SECTION 1INSTALL ACUITY-BASED PIVOT3NODES.......................................................................................................................7
INSTALL PIVOT3NODES...................................................................................................................................................................7
SECTION 2ACUITY NODES:DISKS &NETWORK PORTS .................................................................................................................8
X5-6500 (D1) FLASH ACCELERATOR NODE...................................................................................................................................8
X5-6500 (L1) FLASH ACCELERATOR NODE ...................................................................................................................................8
X5-6000 (D1) FLASH STANDARD NODE.........................................................................................................................................9
X5-6000 (L1) FLASH STANDARD NODE .........................................................................................................................................9
X5-2500 (D1) HYBRID ACCELERATOR NODE.............................................................................................................................. 10
X5-2500 (L1) HYBRID ACCELERATOR NODE .............................................................................................................................. 10
X5-2000 (D1) HYBRID STANDARD NODE.................................................................................................................................... 11
X5-2000 (L1) HYBRID STANDARD NODE .................................................................................................................................... 11
NVME PCIE FLASH LED STATUS DEFINITIONS........................................................................................................................... 12
SECTION 3CONFIGURE ESXI FOR VMWARE ACCESS ................................................................................................................... 13
CONFIGURE THE IP ADDRESSES FOR THE VMWARE MANAGEMENT NETWORK .......................................................................... 13
CONFIGURE SSH........................................................................................................................................................................... 17
SECTION 4INSTALL PLUGIN FOR WINDOWS ................................................................................................................................ 18
DOWNLOAD AND OPEN PLUGIN EXECUTABLE.............................................................................................................................. 18
FOLLOW INSTALLATION WIZARD .................................................................................................................................................. 18
SECTION 5INSTALL PLUGIN FOR LINUX ....................................................................................................................................... 26
BEFORE YOU START ...................................................................................................................................................................... 26
DOWNLOAD AND OPEN PLUGIN PACKAGE ................................................................................................................................... 26
PREPARE ENVIRONMENT............................................................................................................................................................... 26
SECTION 6NETWORK FINE TUNING ............................................................................................................................................. 32
TIME SYNCHRONIZATION .............................................................................................................................................................. 32
SECTION 7NAVIGATING THE PLUGIN............................................................................................................................................ 38
LOG IN TO VSPHERE WEB CLIENT................................................................................................................................................. 38
DASHBOARD OVERVIEW -HOME................................................................................................................................................... 38
DASHBOARD OVERVIEW –VIRTUAL PERFORMANCE GROUP ....................................................................................................... 41
PROVISIONING OVERVIEW:STORAGE PROVISIONING.................................................................................................................. 43
CONFIGURE TAB:OVERVIEW......................................................................................................................................................... 47

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
| 4
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
ACUITY SOFTWARE PLATFORM:NODE ICONS EXPLAINED........................................................................................................... 49
TOOLBOX:OVERVIEW &REPORTING............................................................................................................................................ 50
VCENTER ALARMS &NOTIFICATIONS ........................................................................................................................................... 56
TASKS............................................................................................................................................................................................. 56
WEB PLUGIN ALARMS AND LOGS.................................................................................................................................................. 57
CHANGING VMWARE VCENTER CREDENTIALS.............................................................................................................................. 58
PLUGIN TROUBLESHOOTING ........................................................................................................................................................ 58
SECTION 8CONFIGURE NIC PORTS FOR PIVOT3FEATURES ...................................................................................................... 60
CONFIGURE MANAGEMENT NIC IN PIVOT3VCENTER PLUGIN.................................................................................................... 60
SECTION 9CREATE A PIVOT3VPG ............................................................................................................................................... 61
DISCOVER NODES.......................................................................................................................................................................... 61
CREATE AN ACUITY VPG................................................................................................................................................................ 62
ADD AN N5 STORAGE NODE.......................................................................................................................................................... 63
ASSIGN IP ADDRESSES FOR ISCSI CONNECTIVITY ...................................................................................................................... 64
SECTION 10 HOST ACCESS GROUPS .......................................................................................................................................... 66
HOST ACCESS GROUP BASICS ...................................................................................................................................................... 66
CREATE A HOST ACCESS GROUP .................................................................................................................................................. 67
SECTION 11 CREATE VOLUMES &ASSOCIATED DATASTORES .................................................................................................. 69
CREATING AN ACUITY VOLUME ..................................................................................................................................................... 70
CREATING A VSTAC VOLUME........................................................................................................................................................ 71
CREATE AN N5 STORAGE VOLUME ............................................................................................................................................... 73
PERFORMANCE POLICIES .............................................................................................................................................................. 75
SERVICE LEVELS –BEST PRACTICES &BEHAVIOR....................................................................................................................... 76
ACUITY ESXI HOSTS AND MAINTENANCE MODE.......................................................................................................................... 78
ADDING ESXI HOSTS &DATASTORES .......................................................................................................................................... 78
SECTION 12 SNAPSHOT MANAGEMENT...................................................................................................................................... 81
SNAPSHOTS OVERVIEW................................................................................................................................................................. 81
PROTECTED HOSTS....................................................................................................................................................................... 82
SCHEDULES ON A VOLUME OR AN APPLICATION GROUP ............................................................................................................. 87
PROTECTION POLICIES EXPLAINED .............................................................................................................................................. 88
WORKING WITH PROTECTION POLICIES....................................................................................................................................... 88
RECOVERING A SNAPSHOT............................................................................................................................................................ 92

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
5|
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
3RD PARTY BACKUP APPLICATIONS ............................................................................................................................................... 96
SECTION 13 REPLICATION .......................................................................................................................................................... 97
ASYNCHRONOUS REPLICATION OVERVIEW .................................................................................................................................. 97
TAKING A MANUAL SNAPSHOT WITH REPLICATION ................................................................................................................... 102
SCHEDULING REPLICATION ON A VOLUME ................................................................................................................................. 103
SECTION 14 USING PIVOT3ACUITY SOFTWARE ...................................................................................................................... 105
BEST PRACTICES ......................................................................................................................................................................... 105
SET HYPERVISOR CREDENTIALS ................................................................................................................................................. 105
SSO USER MANAGEMENT........................................................................................................................................................... 106
SSO GROUP MANAGEMENT........................................................................................................................................................ 110
ASSIGNING ADMINISTRATOR ROLES FOR THE AD USER............................................................................................................ 112
PROACTIVE DIAGNOSTICS &PHONE HOME ............................................................................................................................... 114
SECTION 15 UPGRADE ACUITY SOFTWARE ON VPGS.............................................................................................................. 117
DETERMINE UPGRADE REQUIRED............................................................................................................................................... 117
SECTION 16 MANAGEMENT THROUGH SNMP......................................................................................................................... 120
MANAGED DEVICES...................................................................................................................................................................... 120
NETWORK-MANAGEMENT SYSTEM (NMS) ................................................................................................................................ 121
COMMUNITY STRINGS ................................................................................................................................................................. 121
PIVOT3MIB................................................................................................................................................................................. 121
SECTION 17 SHUTDOWN PROCEDURE ..................................................................................................................................... 123
APPLICATION SERVER VM........................................................................................................................................................... 123
PIVOT3VCENTER PLUGIN........................................................................................................................................................... 123
ACUITY ESXI HOST...................................................................................................................................................................... 124
PROCEDURE VERIFICATION AFTER POWER UP.......................................................................................................................... 124
STATUS ICONS &DEFINITIONS ............................................................................................................................ 125
MIGRATING TO SINGLE SIGN-ON......................................................................................................................... 127
ABOUT THIS FEATURE................................................................................................................................................................. 127
CONFIGURING PPD FOR SSO USERS ........................................................................................................................................ 128
CONFIGURING PIVOT3FOR IPV4......................................................................................................................... 129
PIVOT3VCENTER PLUGIN........................................................................................................................................................... 129
RESOLVE HOST IDENTIFIERS &ISCSI ALIASES................................................................................................... 131
IN VSPHERE WEB CLIENT............................................................................................................................................................ 131

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
| 6
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
UNINSTALL OR UPGRADE THE VCENTER PLUGIN................................................................................................ 132
UNREGISTER PLUGIN USING INSTALLER FILE FOR WINDOWS .................................................................................................. 132
UNREGISTER PLUGIN USING INSTALLER FILE FOR LINUX ......................................................................................................... 134
UPGRADING PIVOT3VCENTER PLUGIN ...................................................................................................................................... 135
ACUITY DATA USAGE REPORTING............................................................................................................................................... 135
SNAPSHOTS &REPLICATIONS:REPORTING DISCREPANCIES EXPLAINED ................................................................................ 135
ADD UPGRADE PACKAGE TO VCSA-BASED VCENTER ......................................................................................... 137

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
7|
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
Section 1 Install Acuity-Based Pivot3 Nodes
This section describes how to:
•Connect Pivot3 X-Series Nodes and Ethernet switches to create an iSCSI SAN
•Connect Pivot3 X-Series Nodes to the management network Ethernet switch
Required items for this section:
•Pivot3 X5 Nodes and latest Pivot3 Bare-Metal Installation
•An industry standard 19” data center rack
•Two 10 Gigabit Ethernet switches for the Storage Area Networks
•An Ethernet switch for the management network, or if connecting to an existing management network, an
open switch port on the management network Ethernet switch for each node
NOTE: Pivot3 X-Series Nodes have two Network Interface Card (NIC) ports dedicated for iSCSI SAN connectivity.
Each SAN NIC port must be on a different subnet (no routers).
NOTE: 10GbE is required for SAN switch connections.
NOTE: Pivot3’s system architecture calls for using two physically separate switches for the SAN Networks, each
dedicated to a different subnet. This protects the Acuity vPG from a single switch failure and provides the
performance as stated in any Pivot3 testing results. Not following this guideline may result in less-than-
optimal system operation in regard to performance and system fault tolerance.
Install Pivot3 Nodes
1. Follow the manufacturer’s instructions to install hardware in a standard 19” server rack.
CRITICAL: Use two separate power circuits. Each node has two power supplies, and each power supply for each
node should be connected to a different power circuit.
2. Follow the switch vendor’s instructions to install the Ethernet switches in the rack.
3. Connect the nodes to the Ethernet switches:
a. Connect the NIC ports labeled “SAN Network 0” of all nodes to the Ethernet switch for SAN Network 0.
b. Connect the NIC ports labeled “SAN Network 1” of all nodes to the Ethernet switch for SAN Network 1.
c. Connect the NIC ports labeled “Management Network” of all nodes to the Ethernet switch for the
Management Network. The Management Network is used to manage Acuity OS on all nodes and ESXi if
applicable.
d. Application Network ports are for use with the local application network if applicable. Connect as needed.
e. Connect the interlink NIC ports on each Accelerated node to each other (direct NIC to NIC, not connected
through a switch).
NOTE: For simplicity, this guide refers to “SAN Network 0” and “SAN Network 1” throughout. Local network naming
conventions may vary.

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
| 8
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
Section 2 Acuity Nodes: Disks & Network Ports
This section describes some of the current Pivot3 hardware configurations, and more items are being added
regularly. For specific information on hardware not listed here, contact Pivot3.
X5-6500 (D1) Flash Accelerator Node
X5-6500 (L1) Flash Accelerator Node

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
| 12
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
NVMe PCIe Flash LED Status Definitions
On-board LED are provided to indicate the status of the drive.
LED Description Blink Behavior
LED 1 – Activity (Green) Shows I/O activity for ASIC1 –
Blinking, Controlled by Firmware
Solid GREEN: No read/write activity.
Blinking GREEN: read/write activity.
LED2 – Activity (Green) Shows I/O activity for ASCI2 –
Blinking, controlled by Firmware
Solid GREEN – No read/write activity
Blinking GREEN: read/write activity
LED 3 – Link Behavior Shows link behavior for both
Physical drive controllers
Solid GREEN: Link is established and
GEN3 on all 8 lanes
OFF: Link is established, but Gen 1/2 not
using all 8 lanes.
LED 4 – Fault (Yellow) Fault Solid YELLOW: Critical warning or fault
condition.

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
13 |
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
Section 3 Configure ESXi for VMware Access
VMware ESXi is the hypervisor for the Acuity software platforms. As ESXi patches and updates become available,
functionalities may change; patching or updating ESXi past the level recommended for the currently released
Acuity software platform version is a calculated risk. Pivot3 recommends using only the version of ESXi supported
by the current Acuity software platform version.
This section describes how to:
•Configure the Management Network settings for ESXi on new Pivot3 X-Series Nodes
•Allow X-Series nodes to be accessed by VMware management tools
VMware documentation:
More information on getting started with ESXi is available from VMware.
Required items for this section:
•Pivot3 Nodes that have been installed as detailed in Section 1 and are powered on
•A keyboard and monitor or KVM connection to each node
Configure the IP Addresses for the VMware Management Network
The Management Network must be configured before VMware management tools can manage the nodes.
NOTE: When using DHCP, the IP address is automatically determined and displayed on the console. Make a note of
the IP address assigned and skip to Section 4.
Connect the node to a KVM or connect a keyboard and monitor. The monitor shows the VMware ESXi direct
console.
Press <F2> to login to the ESXi console. The default user name is root and the default password is
vSphereP3. Press <Enter>.

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
| 14
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
ESXi displays the System Customization screen. (Password can be configured whenever it is convenient.
Remember to make a note of Administrator credentials when set. User name and password can be reset, but
credentials will not be recoverable if lost or forgotten.)
Use the up and down arrow keys on the keyboard to highlight Configure Management Network. Press
<Enter>.
NOTE: To configure the host using SSH, enable SSH in this menu from Troubleshooting Options.
On the Configure Management Network screen, use the up and down arrow keys on the keyboard to
highlight IPv4 Configuration. Press <Enter>.
CRITICAL: Ensure that the chosen Network Adapter is the correct one. Default is Adapter 2, but may vary in the local
environment setup.
NOTE: Ensure that, if the management port is a trunk port, the management VLAN has been entered and tagged on
the menu. Trunk ports cannot accept a native VLAN that is identical to the management VLAN.

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
15 |
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
If there is a DHCP server on the VMware Management Network, select the top option in the display dialog, Use
dynamic IP address & network configuration. The values for IP Address, Subnet Mask, and Default
Gateway will be set dynamically by the DHCP server. Make a note of the IP address for this host.
NOTE: If using Use dynamic IP address & network configuration, ensure that the IP address of the ESXi host does
not change on reboot. If the host IP changes on reboot, VMware management tools will not be able to
auto-connect to the ESXi host.
If there is not a DHCP server on the VMware Management Network, the values for IP Address, Subnet Mask,
and Default Gateway must all be manually entered. Select the second option on the display console, Set
static IP address and network configuration, and complete the manual entry of values for IP Address,
Subnet Mask, and Default Gateway. Make a note of this host’s IP address. Once completed, press <Enter> to
return to the Configure Management Network screen.
NOTE: If the VMware Management Network is using DNS, on the Configure Management Network screen, select
DNS Configuration. Press <Enter>.

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
| 16
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
With a choice of Obtain DNS server addresses and a hostname automatically, the selection task will be
completed automatically. Simply press the Enter key to move through this screen. The other available option,
Use the following DNS server addresses and hostname, requires that the information be entered manually
and connected to host name that is unique on the network. Once complete, press <Enter> to return to the
Configure Management Network screen.
NOTE: For vCenter to communicate with the host, the hostname must be resolvable on the network from vCenter,
ESXi host in cluster, client PC, and any 3rd party tool that references the host by hostname.
Press <Esc> to return to the System Customization screen. If any changes were made to the Management
Network settings, a confirmation prompt will appear. Press <Y> to apply the changes and restart the
management network.
Repeat Steps 1-8 for each node.

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
17 |
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
Configure SSH
To Enable or Disable SSH, log in to the main ESXi screen and use the arrow keys to navigate to
Troubleshooting Options. Press Enter to select.
The SSH option provided will differ depending on whether SSH has already been enabled on this machine.
Press Enterto activate the desired state and press Esc to exit the dialog.

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
| 18
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
Section 4 Install Plugin for Windows
Before the installation procedure begins, ensure the following items are easily accessible:
•vCenter Server IP address
•Plugin installation package from Pivot3
•Administrator credentials for each host
•Email addresses of all known administrators
NOTE: The Pivot3 vCenter Plugin is only compatible with the vSphere Web Client. It is not compatible with the
installable VMware vSphere software client.
CRITICAL: For full functionality, ensure all Pivot3 nodes managed by the Plugin are included in the vCenter inventory.
Download and Open Plugin Executable
Download the file Pivot3_vCenter_Plugin_10.3.x.xxx.exe received from Pivot3 Support to the Management
Station. Double-click the .exe file to open the file and begin the process.
NOTE: To request a Pivot3 vCenter Plugin installation file, send a request through the Support Portal.
Follow Installation Wizard
The Installation Wizard for the vCenter plugin is designed to be intuitive and user-friendly. This section will
explain the steps, though most of the installation process will seem familiar.
When the splash screen appears, click Next. (Pivot3 Acuity version may differ.)

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
19 |
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
Read and accept the End User License Agreement. Click Next.
Read the information about Pivot3 Proactive Diagnostics and the Pivot3 Plugin Deployment Service, then
press Next.
Select the components to be installed. Configure Plugin, if checked, will take steps to register the plugin
without further intervention. It is recommended to install all components as shown.

X-Series Hyperconverged Nodes Powered by Acuity
Setup & User Guide, v1.0
| 20
DOC-246-GDE-Pivot3 Acuity 2.3 Setup & User Guide-v1.0.docx
Select the directory to install the web server. If the default location is not preferred, use the Browsefunction
to navigate to a desired location.
Choose the desired authentication type between vCenter Single Sign-On or Pivot3 Authentication.
NOTE: vCenter Single Sign-On will allow the user to access the Pivot3 vCenter Plugin with vCenter credentials only;
Pivot3 Authentication requires Pivot3 credentials to also be entered for each login. For more information on
the vCenter Single Sign-On feature, consult the Pivot3 Support Portal.
This manual suits for next models
3
Table of contents