Pluribus Networks UNUM User manual

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 1 of 40
Pluribus UNUM™Management Platform
High Capacity Appliance
Getting Started Guide
Version 6.0.0
August 2020

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 2 of 40
Table of Contents
Legal Notice ................................................................................................................................. 3
Introduction ................................................................................................................................. 4
Specifications ............................................................................................................................... 5
Physical Installation ....................................................................................................................... 6
Hardware Overview ....................................................................................................................... 7
System Interface ......................................................................................................................... 11
Network Connections ................................................................................................................... 13
HA Considerations - Cluster ......................................................................................................... 19
Replace a Failed Cluster Server ................................................................................................. 20
Submitting a Service Request ....................................................................................................... 28
Appendix A ................................................................................................................................ 29
Appendix B ................................................................................................................................ 33
About Pluribus Networks ............................................................................................................. 40

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 3 of 40
Legal Notice
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO
CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS
MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY
PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET
FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED
HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED
WARRANTY, CONTACT YOUR PLURIBUS NETWORKS REPRESENTATIVE FOR A COPY.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE ARE
PROVIDED AS ISWITH ALL FAULTS. PLURIBUS NETWORKS DISCLAIMS ALL WARRANTIES, EXPRESS OR
IMPLIED, INCLUDING WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR
PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE
PRACTICE.
IN NO EVENT SHALL PLURIBUS NETWORKS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR
INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA,
ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF PLURIBUS NETWORKS HAS BEEN
ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Any Internet Protocol (IP) addresses used in this document are not intended to be actual addresses. Any
examples, command display output, and figures included in the document are shown for illustrative
purposes only. Any use of actual IP addresses in illustrative content is unintentional and coincidental.
©2020 Pluribus Networks, Inc. All rights reserved. Pluribus Networks, the Pluribus Networks logo, nvOS,
Netvisor®, vManage. vRender, PluribusCare, FreedomCare, Pluribus Cloud, and iTOR are registered
trademarks or trademarks of Pluribus Networks, Inc., in the United States and other countries. All other
trademarks, service marks, registered marks, registered service marks are the property of their respective
owners. Pluribus Networks assumes no responsibility for any inaccuracies in this document. Pluribus
Networks reserves the right to change, modify, transfer, or otherwise revise this publication without notice.

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 4 of 40
Introduction
Pluribus Networks' UNUM™Unifi ed Management, Automation, and Analytics Platform Software is an
application portal developed by Pluribus Networks.
UNUM enables the network administrator to extract analytical value from the telemetry data reported by
the network switches powered by the Pluribus Networks Netvisor®ONE network operating system.
Once data is collected, UNUM relies upon a modern search engine database infrastructure to store,
aggregate, filter, correlate, and visualize vast amounts of data in real-time as well as with a powerful time
machine functionality.
The UNUM portal provides a collection of feature-rich applications that manages and orchestrates the
gathering and presentation of network analytics using various types of collectors and reporting software.
The UNUM applications rely primarily on features of the Netvisor ONE, such as VFLOWs, mirrors, and
connections statistics, but can also provide analytics in a non-Pluribus environment.
At a high-level, UNUM supports the following deployment scenarios:
·Netvisor ONE as a mirror switch; an out-of-band Pluribus switch is configured as a
mirror in either an existing Pluribus-switched network or a non-Pluribus-switched
network.
·Netvisor ONE as an in-band switch; connection stats are pulled, and VFLOWs
configured on the switch.
Collectors gather network analytics and feed data into the UNUM analytics store(s):
·This collector is enhanced to use the vREST API to gather the analytics data from
Netvisor.
Pluribus UNUM High-Capacity Appliance (UNUM Cluster)
The Pluribus UNUM High-Capacity Appliance is a pre-integrated 2 rack-unit quad server. It provides the
following benefits:
·Turn-key appliance to deploy UNUM Platform and Insight Analytics in the high
capacity configuration
·Easy to startup and configure
·
conditions
·Store up to 1 Billion records (refer to the Insight Analytics datasheet for supported
scalability in software)
·Capable to collect up to 10,000 connection records/seconds
The Pluribus UNUM High-Capacity Appliance with Insight Analytics is suitable for medium to large
deployments.

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 5 of 40
Specifi cations
UNUM Appliance Features
High Capacity Hardware
·Quad Server chassis, 2 Rack Units
·Dual power supply
·Each server
§16 CPU cores (32 vCPU), 256 GB Ram, dual 960GB SSD
§Dual 10 G Base-T NIC
§IPMI 2.0 + KVM with Dedicated LAN
Insight Analytics:
·Ingest up to 10,000 connections/second
·Retains up to 1 Billion connections
·Refer to Insight Analytics data sheet for release specifi c
information
UNUM High Capacity Appliance Specifi cations

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 6 of 40
Physical Installation
Please refer to Server Installationsection in the Users Manual (MNL-1662). Follow the Manualslink at
the following location:
https://www.supermicro.com/products/system/2U/2028/SYS-2028TP-HTTR.cfm
Please review and follow all Warnings! outlined in the above documentation.

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 7 of 40
Hardware Overview
The 2RU Pluribus UNUM High Capacity Appliance is a unique server system. With four system boards
incorporated into a single chassis acting as four separate server nodes.
Server Nodes
Each of the four server boards act as a separate server node in the system.
As independent server nodes, each may be powered off and on without affecting the others.
In addition, each server node is a hot-swappable unit that may be removed from the rear of the chassis.
The server nodes are connected to the server back-plane by means of an adapter card.
Note: A guide pin is located between the upper and lower server nodes on the inner chassis wall. This
guide pin also acts as a stopwhen a server node is fully installed. If too much force is used when
inserting a server node this pin may break off. Take care to slowly slide a server node in until you hear the
clickof the locking tab seating itself.
Each Server node consists of:
Processors
Dual Intel® Xeon® E5-26x series processors.
Memory
Sixteen DIMM slots supporting 256 GB of ECC RDIMM (Registered DIMM) memory.
Serial ATA
A Serial ATA controller is integrated to provide dual 1.2 TB SSD Drives.
Warning: The SATA drives are physically hot-swappable units, however doing so during regular operation
results in loss of data in the Pluribus UNUM High Capacity Appliance.
Recommended Procedure: Under normal operation, power down the server node and data redistribute
across the nodes, and then the SATA drives can be safely removed without data loss.

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 8 of 40
Hardware Overview (cont'd)
Onboard Controllers/Ports
An Intel Gigabit (100/1000/10000 Mb/s) Ethernet dual-channel controller is included. Using an AOC Card
not a supported configuration.
I/O ports include a VGA (monitor) port, two USB 3.0 ports, an IPMI dedicated LAN port and two Ethernet
ports, Eth0 and Eth1. Eth0 is used for Management, Eth1 is used for internal server node to server node
communications.
Eth1 must be isolated from the public network.
Other Features
Other onboard features that promote system health include onboard voltage monitors, auto-switching
voltage regulators, chassis and CPU overheat sensors, server node manager software and BIOS rescue.
Server Nodes

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 9 of 40
Hardware Overview (cont'd)
Server Chassis Features
The following is a general outline of the main features of the appliance chassis.
System Power
Each chassis model includes redundant, hot-plug high-efficiency 80-plus Platinum certified power supplies,
rated at 2000 Watts. In the unlikely event your power supply fails, replacement is simple and can be
accomplished without tools. An amber light will be illuminated on the power supply when the power is off.
An illuminated green light indicates that the power supply is operating.
Cooling System
The chassis contains four system fans, which are powered from the back-plane.

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 10 of 40
Hardware Overview (cont'd)
Mounting Rails
The Pluribus UNUM High Capacity Appliance includes a set of quick-release rails, and can be placed in a rack
for secure storage and use. To setup your rack, follow the step-by-step instructions included in the SMCI
manual.
Server Chassis Features

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 11 of 40
System Interface
There are several LEDs on the control panel and on the drive carriers to keep you constantly informed of
the overall status of the system.
This chapter explains the meanings of all LED indicators and the appropriate response you may need to
take.
LED Indicators
Control Panel Button
Power
The main power button on each of the four control panels is used to apply or remove power from the power
supply to each of the four server nodes in the chassis.
The power button has a built-in LED which will turn green when the power is on.
Each of the four server nodes are powered on and off individually.
Powering off one server node does not affect the power of the other server nodes.
Turning power off with this button does not remove power from the chassis, hence caution must be used
when servicing.
UID
The UID button is used to turn on or off the blue light function of the LED.
Once the blue light is activated, the unit can be easily located in very large racks and server banks.

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 12 of 40
System Interface (cont'd)
Control Panel LEDs
The four control panels are located on the front handle of the chassis.
Each control panel has two additional LEDs.
These LEDs provide you with critical information related to different parts of the system.
This section explains what each LED indicates when illuminated and any corrective action you may need to
take.
Alert
This LED is illuminated when an alert condition occurs:
·A solid red light indicates an overheat condition in the system
·A flashing red light which fl ashes in one second intervals indicates a fan failure
·A flashing red light which flashes in four second intervals indicates a power failure
When notified of an alert, check the routing of the cables and make sure all fans are present and operating
normally.
You should also check to make sure that the chassis covers, and air shrouds are installed.
This LED will remain flashing or on as long as the temperature is too high, or a fan does not function
properly.
NIC
Indicates network activity on either LAN1 or LAN2 when fl ashing.
Drive Carrier LEDs
SATA Drives
Each drive carrier has two LEDs.
·Blue: When illuminated, this blue LED (on the front of the drive carrier) indicates
drive activity. A connection to the back-plane enables this LED to blink on and off
when that drive is being accessed
·Red: The red LED to indicate a hard drive failure.

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 13 of 40
Network Connections
After installation of the Pluribus UNUM High Capacity Appliance, network activity must be setup as follows
(please refer to the figure below for proper connections):
1. For proper operation the Pluribus UNUM High Capacity Appliance requires a separate 1G or 10G switch
for connectivity between eth1 on all Server nodes.
2. Connect your Management Network to Eth0 (1G or 10G) on Server node A. By default, Server node A
(Host) is confi gured for DHCP. To set a static IP, see Appendix A.
3. It is required to connect Eth1 into an isolated 1G or 10G switch. Server nodes will communicate via Eth1,
with the following IP Addresses:
a. 172.16.250.150 - 172.16.250.162
4. Plug in redundant power connections with the provided cables ONLY and power up.
Network Connections

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 14 of 40
Network Connections (cont'd)
NOTE: Eth1 connections are not configured on a VLAN, please contact Pluribus Technical support if one
of the following must occur:
·More than one Pluribus UNUM High Capacity Appliance plugged into the same switch (by default, all
appliances come with the same pre-configured Eth1 IP addresses), and each Appliance isolated in a
separate and dedicated VLAN.
·You want to change the default Eth1 IP Addresses of: 172.16.250.150 - 172.16.250.162.
5. Connect VGA console and IPMI as desired. IPMI default confi guration is DHCP.
6. USB connections are not advised.
7. The Pluribus UNUM High Capacity Appliance, comes with the Pluribus UNUM software pre-installed.
8. Upon boot up, by default Pluribus UNUM will use DHCP to obtain a Management / eth0 IP address. If a
Static IP is desired, see Appendix B.
9. It is highly recommended that the default root password of your Server nodes be changed from test123.
NOTE: It is required that all Server nodes have the same root password.
To change the root password of your Server nodes, you can do the following:

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 15 of 40
Network Connections (cont'd)
Log onto each Server node as root using the ESXi web client (or vSphere client if you have access):
VMware Welcome Screen

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 16 of 40
Network Connections (cont'd)
Select Change Password
VMware Change Password Dashboard
Enter New Password:
VMware Change Password

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 17 of 40
Network Connections (cont'd)
IMPORTANT: Repeat for each Server node, root passwords must be the same on each.
10. The Primary Server Node A, runs the Pluribus UNUM Web Interface.
You can find the IP of your Pluribus UNUM Primary VM via the ESXi web client (or vSphere client if you
have access), log in with the your newly set root password:
Pluribus UNUM Primary VM
In the above example, you will see the IP from your DHCP server, in this case it is 10.x.x.x, but the actual
IP will depend on your DHCP configurations.
11. Once you obtain the IP of your Pluribus UNUM, use a Chrome browser to connect for the best
experience.

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 18 of 40
Network Connections (cont'd)
12. Please refer to the Pluribus UNUM Installation &
Notes for configuration and operating instructions:
a. These documents can be found at: http://www.pluribusnetworks.com/get-started/unum
Pluribus Networks Cloud Login Screen
NOTE: All content of the Installation &
VM as well as the Pluribus UNUM High Capacity Appliance unless otherwise noted. There is no need to
download the OVA software as it comes pre-installed on the High-Capacity Appliance.
The software upgrade procedure is the same for both the Standalone VM/Appliance and the High Capacity
Appliance.
If supported between two compatible versions, upgrade software can also be obtained from:
http://www.pluribusnetworks.com/get-started/unum

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 19 of 40
HA Considerations - Cluster
Cluster / Data Node Health:
Green Cluster is fully operational with replicated data.
Yellow Cluster is fully operational data is being replicated.
Red Cluster is operational data has been lost.
Failure of any one Server Node B, C, or D:
Upon failure or removal of any one Server node B, C, or D, the Pluribus UNUM High Capacity Appliance will
redistribute data such that no data will be lost.
The Cluster will temporarily go to Yellow, then will recover to Green after data is fully redistributed.
Redistribution of data times will vary depending on system / traffi c load.
Normal operation can continue; however, the system is operating in a non-redundant configuration.
The failed or removed Server node, must be replaced as soon as possible.
Failure of more than one Server Node B, C, or D:
Upon failure or removal of more than one Server node B, C, or D will likely result in permanent data loss.
Two of the three Server nodes B, C, and D must be operational for the system to collect, manage and store
data properly.
Upon data loss the Cluster status will likely go Red and require replacement of failed or removed Server
nodes until at a minimum, two of the three are replaced.
Failure of Server Node A:
Upon failure or removal of the Primary Server node A, data will not be lost, however data collection and
connectivity to Pluribus UNUM will stop.
The Primary Server node A must be replaced as soon as possible for normal operation to resume.

UNUM High Capacity Appliance - Getting Started Guide - Copyright © 2020 by Pluribus Networks. All Rights Reserved. Page 20 of 40
Replace a Failed Cluster Server
Data Server Node Replacement
One symptom of a failed Data Server Node is the appearance of offline nodes in the UNUM System Health
dashboard as shown in the example below.
In the example, UNUM displays single ESXi instance with 4 data nodes, all offl ine.
UNUM System Health Dashboard - Cluster
In the event of a Cluster Server failure and you have received a replacement Server from Pluribus
Networks please use the following instructions to rebuild the Cluster.
Note: The replacement Server you receive has VMware ESXi installed. You need to add the Server to the
Cluster using the cluster_menu.sh configuration script.
Note: All Server Nodes must be connected via the Eth0 Ethernet interface.
1. Login into the Remote Console of a Primary VM instance with your login credential. If you have not
changed the default credentials the username and password is “vcf”and the password is “changeme”.
The UNUM Cluster setup script is named “unum_provision.sh”and is located in the default folder
“/home/vcf/srv/vcf/bin/tools/cluster”.
Table of contents