Veryx PktBlaster User manual

SDN Controller Test
Performance Benchmarking
Version 1.4
User Guide
Part Number: T/UG–PKTBLASTER-SDN-CTR-PERF-1.4–1015/1.1

Copyright ©Veryx Technologies Pvt. Ltd. All rights reserved.
Veryx™ and PktBlaster™ are trademarks of Veryx Technologies Pvt. Ltd. All other
trademarks of respective owners are acknowledged.
This document may not be copied either in whole or in part by any means or media
without the permission of Veryx Technologies Pvt. Ltd.
THE PROGRAMS FURNISHED ARE PROVIDED ON AN "AS IS" BASIS, WITHOUT ANY
WARRANTIES OR REPRESENTATIONS EXPRESS, IMPLIED, OR STATUTORY; INCLUDING,
WITHOUT LIMITATION, WARRANTIES OF QUALITY, PERFORMANCE,
NONINFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE.
NOR ARE THERE ANY WARRANTIES CREATED BY A COURSE OF DEALING, COURSE OF
PERFORMANCE, OR TRADE USAGE. LICENSOR DOES NOT WARRANT THAT THE
PRODUCTS WILL MEET LICENSEE'S NEEDS OR BE FREE FROM ERRORS, OR THAT THE
OPERATION OF THE PRODUCTS WILL BE UNINTERRUPTED.

Table of Contents
1About Pkt Blaster SDN Controller Test.....................................................1
Key Features.......................................................................................................................... 2
Working with PktBlaster SDN Controller Test........................................................................ 2
User Interface ................................................................................................................. 2
Troubleshooting.............................................................................................................. 2
Reporting ........................................................................................................................ 3
SDN Controller Test Process Flow......................................................................................... 4
Intended Audience for this Guide........................................................................................... 5
2Getting Started............................................................................................7
Log in to PktBlaster SDN Controller Test............................................................................... 7
About the Home Screen......................................................................................................... 8
Log out of PktBlaster SDN Controller Test............................................................................. 9
3Configuring an SDN Controller................................................................11
Add SDN Controllers............................................................................................................ 12
View Available SDN Controllers........................................................................................... 14
Key features to Customize Controller View.................................................................. 15
Edit SDN Controller Details.................................................................................................. 17
Delete SDN Controller.......................................................................................................... 19
4Configuring a Traffic Profile ....................................................................21
Add a New Traffic Profile...................................................................................................... 22
Type–IPV4.................................................................................................................... 28
Type-Custom ................................................................................................................ 30
View Traffic Profiles.............................................................................................................. 31
Modify a Traffic Profile.......................................................................................................... 32
Delete a Traffic Profile.......................................................................................................... 33
5Performance Tests....................................................................................35
Types of Tests...................................................................................................................... 35
Performance Throughput ..................................................................................................... 35
Performance Latency........................................................................................................... 35
Performance Robustness..................................................................................................... 35
Testing Modes...................................................................................................................... 36
Throughput Test in Normal Mode......................................................................................... 37
Throughput Test in Incremental Switch Mode...................................................................... 37
Latency Test in Normal Mode .............................................................................................. 37
Latency Test in Incremental Switch Mode ........................................................................... 38
Configure Test Parameters.................................................................................................. 38
Step 1: Select Controller............................................................................................... 39
Step 2: Network Configuration...................................................................................... 40
Show Advanced Configuration ..................................................................................... 41
Step 3: Test Configuration............................................................................................ 43
6Test Execution Details..............................................................................47
View a Test in Progress ....................................................................................................... 47
View Test Results................................................................................................................. 48
Re-execute a Test................................................................................................................ 50
Test Fails to Complete ......................................................................................................... 51
7Executing Throughput Tests ...................................................................53
Throughput Test in Normal Mode......................................................................................... 53
View Test Result........................................................................................................... 56

Throughput Test in Incremental Switch Mode......................................................................59
View Test Result...........................................................................................................61
8Executing Latency Tests .........................................................................65
Latency Test in Normal Mode...............................................................................................65
View Test Result...........................................................................................................68
Latency Test in Incremental Switch Mode............................................................................69
View Test Result...........................................................................................................72
9Executing Robustness Tests...................................................................75
View Test Result...........................................................................................................78
10 Viewing and Generating Reports............................................................81
View the Dashboard .............................................................................................................81
View Bookmarks...................................................................................................................82
View Throughput Report.......................................................................................................83
View Latency Report ............................................................................................................85
View Robustness Report......................................................................................................87
View Individual Test Execution Report .........................................................................88
Search for a Report ..............................................................................................................91
Download Report in PDF Format .........................................................................................93
Glossary .........................................................................................................95
Index ...............................................................................................................97
Table of Figures
Figure 1: PktBlaster SDN Controller Test-Performance Benchmarking Deployment ..................3
Figure 2: PktBlaster SDN Controller Test Login Screen ..............................................................7
Figure 3: Home Screen ................................................................................................................ 7
Figure 4: PktBlaster SDN Controller Test Logout Screen............................................................9
Figure 5: Logout Confirmation Dialog Box ...................................................................................9
Figure 6: Controller Screen ........................................................................................................11
Figure 7: Add a new Controller...................................................................................................12
Figure 8: New Controller Added.................................................................................................14
Figure 9: Available Controllers ...................................................................................................15
Figure 10: Controller Configuration Screen................................................................................16
Figure 11: Controller Configuration-Customize Display.............................................................17
Figure 12: Controller Details.......................................................................................................18
Figure 13: Modify Controller Details...........................................................................................18
Figure 14: Delete Confirmation Dialog Box................................................................................19
Figure 15: Traffic Profile Screen.................................................................................................21
Figure 16: Add a New Traffic Profile...........................................................................................22
Figure 17: Traffic Profile-Type IPV4...........................................................................................28
Figure 18: Traffic Profile-TCP/UDP............................................................................................29
Figure 19: Traffic Profile-L3 Custom...........................................................................................30
Figure 20: Traffic Profile-Ether Type Custom.............................................................................31
Figure 21: View Traffic Profile ....................................................................................................32
Figure 22: Edit a Traffic Profile...................................................................................................33
Figure 23: Traffic Profile Details .................................................................................................34
Figure 24: Delete Confirmation Dialog Box................................................................................34
Figure 25: Performance Screen .................................................................................................39
Figure 26: Select Controller Pane ..............................................................................................39

Figure 27: Network Configuration Pane..................................................................................... 40
Figure 28: Advanced Configuration............................................................................................ 42
Figure 29: Switch Capabilities OF Version 1.0 and 1.3 ............................................................. 42
Figure 30: Test Configuration Pane ........................................................................................... 43
Figure 31: Test Execution in Progress (Upper).......................................................................... 47
Figure 32: Test Execution in Progress (Lower).......................................................................... 48
Figure 33: Test Results-Configuration Details ........................................................................... 49
Figure 34: Test Results-Graph................................................................................................... 49
Figure 35: Test Results-Table.................................................................................................... 50
Figure 36: Re-execute Test........................................................................................................ 51
Figure 37: Test Configuration-Throughput Test Mode............................................................... 54
Figure 38: Throughput Normal Mode (Upper)............................................................................ 55
Figure 39: Throughput Normal Mode (Lower)............................................................................ 56
Figure 40: Throughput Normal Result-Graph............................................................................. 57
Figure 41: Throughput Normal Result-Table.............................................................................. 58
Figure 42: Test Configuration- Throughput Incremental Switch Mode ...................................... 59
Figure 43: Throughput Incremental Switch Mode (Upper)......................................................... 60
Figure 44: Throughput Incremental Switch Mode (Lower)......................................................... 61
Figure 45: Throughput Incremental Switch Result-Graph.......................................................... 62
Figure 46: Throughput Incremental Switch Result-Table........................................................... 63
Figure 47: Test Configuration-Latency Normal Mode................................................................ 66
Figure 48: Latency Normal Mode (Upper).................................................................................. 67
Figure 49: Latency Normal Mode (Lower).................................................................................. 67
Figure 50: Latency Normal Result.............................................................................................. 68
Figure 51: Latency Normal Table Report................................................................................... 69
Figure 52: Test Configuration-Latency Incremental Switch Mode............................................. 70
Figure 53: Latency Incremental Switch Mode (Upper)............................................................... 71
Figure 54: Latency Incremental Switch Mode (Lower)............................................................... 72
Figure 55: Latency Incremental Switch Result........................................................................... 72
Figure 56: Latency Incremental Switch Table Result................................................................. 73
Figure 57: Robustness Flow Mod Test Configuration................................................................ 76
Figure 58: Robustness Flow Mod Result Report (Upper).......................................................... 77
Figure 59: Robustness Flow Mod Result Report (Lower).......................................................... 78
Figure 60: Robustness Flow Mod Graph Result........................................................................ 78
Figure 61: Result Table Report.................................................................................................. 79
Figure 62: Dashboard................................................................................................................. 81
Figure 63: Bookmarks Pane....................................................................................................... 82
Figure 64: Execution History Pane............................................................................................. 83
Figure 65: Throughput Summary Report (Upper)...................................................................... 84
Figure 66: Throughput Summary Report (Lower)...................................................................... 84
Figure 67: Execution History Pane............................................................................................. 85
Figure 68: Latency Summary Report (Upper)............................................................................ 86
Figure 69: Latency Summary Report (Lower)............................................................................ 86
Figure 70: Execution History Pane............................................................................................. 87
Figure 71: Robustness Summary Report (Upper) ..................................................................... 88
Figure 72: Robustness Summary Report (Lower) ..................................................................... 88
Figure 73: Execution History-Individual Test Results ................................................................ 89
Figure 74: Test Execution Results (Upper)................................................................................ 90
Figure 75: Test Execution Results (Lower)................................................................................ 90
Figure 76: Reports Screen......................................................................................................... 91
Figure 77: Search Options ......................................................................................................... 92
Figure 78: Report-Specific Period.............................................................................................. 92
Figure 79: Download Report ...................................................................................................... 93
Figure 80: PDF Report ............................................................................................................... 94

P a g e | 11
Copyright © Veryx Technologies Pvt. Ltd.
1
1ABOUT PKT BLASTER SDN
CONTROLLER TEST
PktBlaster SDN Controller Test is the industry’s first integrated test solution for
benchmarking the performance of an SDN controller as well as emulating SDN
networks in a single box. It supports a number of real-world application traffic for
performance testing and emulation. It runs either on a Veryx hardware platform or
on suitable commodity servers.
PktBlaster SDN Controller Test solution consists of two product components that
are licensed separately:
Network Emulator and
Performance Benchmarking
PktBlaster SDN Controller Test-Performance Benchmarking simulates up-to one
thousand switches and millions of nodes and thereby significantly reduces
dependency on large-scale physical network infrastructure for testing and
benchmarking SDN controllers.
Some of the performance benchmarking capabilities include:
Throughput and Robustness measurement –per second
Latency measurement –in milliseconds
Detailed Tx/Rx statistics of switch group network per iteration
Comprehensive reporting and analysis
PktBlaster SDN Controller Test –Network Emulator is available separately and it
supports real-time emulation of large-scale SDN networks. Some of the emulation
capabilities supported include:
Emulation of upto 100 SDN devices and upto 100 endpoints with millions of
flows
Generation of multiple traffic flows from a single simulated port.
Supports network flow path tracing and network failure simulation.
Detailed traffic and flow statistics.

2
PktBlaster SDN Controller Test-Performance Benchmarking User Guide
Copyright © Veryx Technologies Pvt. Ltd.
For more details, please refer to the PktBlaster SDN Controller Test Network
Emulator User Guide.
Key Features
The following are some of the key features of PktBlaster SDN Controller Test for
performance benchmarking:
Measurement of Performance Throughput, Latency and Robustness:
For OpenFlow versions 1.0, 1.3 or both
Uses TCP connection mode
Programmatic Support (REST API)
Comprehensive Reporting and Analysis
Working with PktBlaster SDN Controller Test
PktBlaster SDN Controller Test runs either on Veryx Hardware or on standard
commodity servers. The platform allows easy configuration of controllers and
supports easy web-based access.
User Interface
PktBlaster SDN Controller Test supports user friendly GUI for configuration and
testing. Also, PktBlaster SDN Controller GUI supports creation of various real-world
application data for testing the performance and functionality.
Troubleshooting
PktBlaster SDN Controller Test provides extensive debugging options at multiple
levels. It provides detailed statistics of the requests and responses for a test run for
quick identification of problem root cause.

3
Copyright © Veryx Technologies Pvt. Ltd.
About Pkt Blaster SDN Controller Test
Reporting
PktBlaster SDN Controller Test report provides comprehensive insight on controller
metrics such as flow set-up rate and flow set-up time in the form of graphs.
The individual test report provides OF connection time and detailed statistics of
switch group network.
Figure 1: PktBlaster SDN Controller Test-Performance Benchmarking Deployment