Endace DAG 6.1S User manual







    
        
    



   
      
   








EDM 01-11v8 DAG 6.1S Card User Guide
©2005 Version 8: May 2006
Copyright © 2005.
Published by:
Endace Measurement Systems
®
Ltd
Building 7
17 Lambie Drive
PO Box 76802
Manukau City 1702
New Zealand
Phone: [phone]
Fax: [phone]
[email protected]
www.endace.com
International Locations
New Zealand Americas Europe, Middle East & Africa
Endace Technology
®
Ltd
Level 9
85 Alexandra Street
PO Box 19246
Hamilton 2001
New Zealand
Phone: [phone]
Fax: [phone]
[email protected]
www.endace.com
Endace USA
®
Ltd
Suite 220
11495 Sunset Hill Road
Reston
Virginia 20190
United States of America
Phone: ++1 703 382 0155
Fax: ++1 703 382 0155
[email protected]
www.endace.com
Endace Europe
®
Ltd
Sheraton House
Castle Park
Cambridge CB3 0AX
United Kingdom
Phone: ++44 1223 370 176
Fax: ++44 1223 370 040
[email protected]
www.endace.com
All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in
any form or by any means electronic, mechanical, photocopying, recording, or otherwise, without the prior
written permission of the publisher. Prepared in Hamilton, New Zealand.

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 Version 8: May 2006
Typographical Conventions Used in this Document
•Command-line examples suitable for entering at command prompts are displayed in
mono-space courier font. The font is also used to describe config file data
used as examples within a sentence. An example can be in more than one sentence.
Results generated by example command-lines are also displayed in mono-space
courier font.
•The software version references such as 2.3.x, 2.4.x, 2.5.x are specific to Endace
Measurement Systems and relate to Company software products only.
Protection Against Harmful Interference
When present on product this manual pertains to and indicated by product labelling, the statement "This device complies
with part 15 of the FCC rules" specifies the equipment has been tested and found to comply with the limits for a Class A
digital device, pursuant to Part 15 of the Federal Communications Commission [FCC] Rules.
These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a
commercial environment.
This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the
instruction manual, may cause harmful interference to radio communications.
Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be
required to correct the interference at his own expense.
Extra Components and Materials
The product that this manual pertains to may include extra components and materials that are not essential to its basic
operation, but are necessary to ensure compliance to the product standards required by the United States Federal
Communications Commission, and the European EMC Directive. Modification or removal of these components and/or
materials, is liable to cause non compliance to these standards, and in doing so invalidate the user’s right to operate this
equipment in a Class A industrial environment.

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 i Version 8: May 2006
Table of Contents
1.0 PREFACE........................................................................................................................... 1
1.1 User Manual Purpose ......................................................................................................1
1.2 DAG 6.1S Card Product Description..............................................................................2
1.3 DAG 6.1S Card Architecture ..........................................................................................3
1.4 DAG 6.1S Card Extended Functions ..............................................................................3
1.5 DAG 6.1S Card System Requirements ...........................................................................3
2.0 INSTALLING DAG 6.1S CARD......................................................................................5
2.1 Installation of Operating System and Endace Software..................................................5
2.2 Insert DAG 6.1S Card into PC........................................................................................5
2.3 Connect Card Ports .........................................................................................................6
3.0 SETTING DAG 6.1S CARD OPTICAL POWER.......................................................... 7
3.1 DAG 6.1S Card Optical Power Input..............................................................................7
3.2 Splitter Losses .................................................................................................................8
4.0 CONFIDENCE TESTING DAG 6.1S CARD .................................................................9
4.1 Interpreting DAG 6.1S Card LED Status........................................................................9
4.2 DAG 6.1S Card LED Display Functions ......................................................................10
4.3 Configuration in WYSYCC Style.................................................................................11
4.4 dagsix Utility............................................................................................................14
4.5 DAG 6.1S Card Capture Session ..................................................................................14
4.6 Inspect PoS Interface Statistics .....................................................................................15
4.7 Inspect 10G Ethernet Interface Statistics ......................................................................18
4.8 Reporting Problems.......................................................................................................23
5.0 RUNNING DATA CAPTURE SOFTWARE................................................................ 24
5.1 Starting Data Capture Session.......................................................................................24
5.2 High Load Performance ................................................................................................26
6.0 SYNCHRONIZING CLOCK TIME.............................................................................. 28
6.1 Configuration Tool Usage.............................................................................................29
6.2 Time Synchronization Configurations ..........................................................................30
6.2.1 Single Card no Reference Time Synchronization...................................................30
6.2.2 Two Cards no Reference Time Synchronization....................................................31
6.2.3 Card with Reference Time Synchronization...........................................................32
6.3 Synchronization Connector Pin-outs.............................................................................34
7.0 DATA FORMATS OVERVIEW.................................................................................... 36
7.1 Data Formats .................................................................................................................36
7.2 Timestamps ...................................................................................................................38

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 ii Version 8: May 2006

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 1 Version 8: May 2006
1.0 PREFACE
Introduction
The installation of the Endace DAG 6.1S card on a PC begins with
installing the operating system and the Endace software. This is followed
by fitting the card and connecting the ports.
Viewing this
document
This document, the DAG 6.1S Card User Manual is available on the
installation CD.
In this chapter
This chapter covers the following sections of information.
•User Manual Purpose
•DAG 6.1S Card Product Description
•DAG 6.1S Card Architecture
•DAG 6.1S Card Extended Functions
•DAG 6.1S Card System Requirements
1.1 User Manual Purpose
Description
The purpose of this DAG 6.1S Card User Manual is to describe:
•Installing DAG 6.1S Card
•Setting DAG 6.1S Card Optical Power
•Confidence Testing DAG 6.1S Card
•Running Data Capture Software
•Synchronizing Clock Time
•Data Formats Overview

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 2 Version 8: May 2006
1.2 DAG 6.1S Card Product Description
Description
The DAG 6.1S card is of a series specifically designed for network
surveillance applications. It is optimized to enable header-only or full
packet capture from PoS OC-192c or STM-64c links, and 10 Gigabit
Ethernet 10GBase-LR and 10GBase-LW links.
Figure
Figure 1-1 shows the DAG 6.1S PCI-X card.
Figure 1-1. DAG 6.1S PCI-X Card.
Installed in a PCI-X 1.0 slot the DAG 6.1S card only operates at 66, 100,
and 133 MHz PCI-X for full packet capture at line rate and allows
recording of all header information and/or payload with a high precision
timestamp.
The packet header and payload information can be stored for later in-depth
analysis, or used in real-time for a variety of network monitoring
applications, such as billing and intrusion detection systems.
IP header traces can also be used operationally to determine link
performance and application mixes, find “top talkers” or generate
source/destination AS matrices for specific network links.

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 3 Version 8: May 2006
1.3 DAG 6.1S Card Architecture
Description
Serial optical data is received by the optical interface, and fed into a
physical layer ASIC. The packet data is then fed immediately into the Rx
FPGA. This FPGA contains the DUCK timestamp engine, and packet
record processor.
Because of component close association, packets or cells are time-stamped
accurately. Time stamped packet records are then stored in an external
FIFO and passed into the PCI-X FPGA for transmission to the host.
Figure
Figure 1-2 shows the DAG 6.1S card major components and data flow.
Figure 1-2. DAG 6.1S Card Major Components and Data Flow.
1.4 DAG 6.1S Card Extended Functions
Description
The shipped version of the DAG 6.1S does not contain a transmit path, it
is intended to be used with fibre optic splitters.
Contact the Endace customer support team at [email protected] to
enable effective use of extended functions.
1.5 DAG 6.1S Card System Requirements
Description
The DAG 6.1S card and associated data capture system minimum
operating requirements are:
•PC, at least Intel Xeon 1.8GHz or faster
•Intel E7500, ServerWorks Grand Champion LE/HE or newer chip
set
•256 MB RAM
•At least one free PCI-X 1.0 slot supporting 66MHz operation
•Software distribution free space of 30MB
Continued on next page

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 4 Version 8: May 2006
1.5 DAG 6.1S Card System Requirements , continued
Operating
system
For convenience, a Debian 3.1 [Sarge] Linux system is included on the
Endace Software Install CD. Endace currently supports Windows XP,
Windows Server 2000, Windows Server 2003, FreeBSD, RHEL 3.0, and
Debian Linux operating systems.
Different
system
For advice on using a system substantially different from that specified
above, contact Endace support at [email protected]

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 5 Version 8: May 2006
2.0 INSTALLING DAG 6.1S CARD
Introduction
Given the DAG 6.1S card can be installed in any free PCI-X 1.0 slot, it
operates at 66, 100, and 133 MHz. The DAG 6.1S will not operate in 32
or 64-bit PCI slots.
Higher speed slots are recommended for best performance.
The DAG 6.1S should be the only device on the PCI-X bus if possible, as
the cards make very heavy use of PCI-X bus data transfer resources.
Although the driver supports up to four DAG cards by default in one
system, due to band width limitations there should not be more than one
card on a single PCI-X bus.
In this chapter
This chapter covers the following sections of information.
•Installation of Operating System and Endace Software
•Insert DAG 6.1S Card into PC
•Installation of Operating System and Endace Software
2.1 Installation of Operating System and Endace Software
Description
If the DAG device driver is not installed, before proceeding with the next
chapter, install the software by following the instructions in EDM04-01
Endace Software Installation Manual.
Go to the next chapter of information when the DAG device driver is
installed.
2.2 Insert DAG 6.1S Card into PC
Description
Inserting the DAG 6.1S card into a PC involves accessing the bus slot,
fitting the card, and replacing the bus slot screw.
Procedure
Follow these steps to insert the DAG 6.1S card.
Step 1. Access bus Slot
Power computer down.
Remove PCI-X bus slot cover.
Continued on next page

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 6 Version 8: May 2006
2.2 Insert DAG 6.1S Card into PC , continued
Procedure,continued
Step 2. Fit Card
Insert into PCI-X bus slot.
Ensure free end fits securely into a card-end bracket that supports the card
weight.
Step 3. Replace bus Slot Screw
Secure card with screw.
Step 4. Power up computer
2.3 Connect Card Ports
Description
There is one square plastic SC-type optical connector on the 6.1S DAG
card for the received optical signal. There is no TX port on the card.
The card has an 8-pin RJ45 socket for time synchronization input. This
socket must never be connected to an Ethernet network or telephone line.

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 7 Version 8: May 2006
3.0 SETTING DAG 6.1S CARD OPTICAL POWER
Description
The optical power range depends on the particular device fitted on the
DAG 6.1S card.
The DAG 6.1S card is shipped fitted with the GTRAN GT10-RXU
1310nm single mode receive module by default.
Optical power
measure
Optical power is measured in dBm – decibels relative to 1 mW where 10
dB is equivalent to a factor of 10 in power.
The numbers are all negative, showing powers below 1 mW. The most
sensitive devices can work down to about –30 dBm, or 1 uW.
Configuration
The following table describes the DAG 6.1S card optics power module
configuration.
Part No. Fibre Data Rate Max Power
[dBm]
Min Power
[dBm]
Nominal Pwr
[dBm]
GT10-RXU SMF 10Gbps 0 -17 -9
In this chapter
This chapter covers the following sections of information.
•Interpreting DAG 6.1S Card LED Status
•DAG 6.1S Card LED Display Functions
3.1 DAG 6.1S Card Optical Power Input
Description
The optical power input into the DAG 6.1S card must be within a
receiver’s dynamic range.
When optical power is slightly out of range an increased bit error rate is
experienced. If power is well out of range the system cannot lock onto the
SONET frames. In extreme cases of being out range excess power will
damage a receiver.
When power is above the upper limit the optical receiver saturates and
fails to function. When power is below the lower limit the bit error rate
increases until the device is unable to obtain lock and fails.
Continued on next page

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 8 Version 8: May 2006
3.1 DAG 6.1S Card Optical Power Input , continued
Input power
The DAG 6.1S card is set up to measure the optical power at the receiver,
and to make sure that it is well within the specified power range of -9
dBm.
Input power is adjusted by:
•Changing splitter ratio if power is too high or too low, or
•Inserting an optical attenuator if power is too high.
3.2 Splitter Losses
Description
Splitters have the insertion losses marked on packaging or in
accompanying documentation.
•A 50:50 splitter will have an insertion loss of between 3 dB and 4
dB on each output
•90:10 splitter will have losses of about 10 dB in the high loss output,
and <2 dB in the low loss output
The GT10-RXU uses 1310nm optics. Splitters used must be designed for
1310nm as the insertion loss will vary for different wavelengths.
Single mode
fibre loss
A single mode fibre connected to a multi-mode input has minimal extra
loss.
Multi-mode
fibre loss
A multi-mode fibre connected to a single mode input creates large and
unpredictable loss.

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 9 Version 8: May 2006
4.0 CONFIDENCE TESTING DAG 6.1S CARD
Introduction
The confidence testing is a process to determine the DAG 6.1S card is
functioning correctly.
The process also involves a card capture session, and demonstrates
configuration in the style of 'What You See You Can Change', WYSYCC.
Interface statistics are also inspected during this process. There is also
information in this section regarding reporting of problems.
In this chapter
This chapter covers the following sections of information.
•Interpreting DAG 6.1S Card LED Status
•DAG 6.1S Card LED Display Functions
•Configuration in WYSYCC Style
•dagsix Utility
•DAG 6.1S Card Capture Session
•Inspect PoS Interface Statistics
•Inspect 10G Ethernet Interface Statistics
•Reporting Problems
4.1 Interpreting DAG 6.1S Card LED Status
Description
The DAG 6.1S has a 8 status LEDs, three blue, one green, one orange, one
yellow, and two red.
Figure
Figure 4-1 shows the DAG 6.1S status LEDs.
Figure 4-1. DAG 6.1S Card Status LEDs.
Continued on next page

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 10 Version 8: May 2006
4.1 Interpreting DAG 6.1S Card LED Status , continued
LED definitions
The following table describes the LED definitions.
LED Description
LED 1 RX FPGA successfully programmed.
LED 2 LOS: Loss of Signal; no valid optical signal seen by
receiver.
LED 3 Reserved.
LED 4 Reserved.
LED 5 PCI-X FPGA successfully programmed
LED 6 Data capture in progress.
LED 7 Ethernet mode; OFF for PoS.
LED 8 Reserved.
LED 9 PPS Out: Pulse Per Second Out; indicates card is sending a
clock synchronization signal
LED 10 PPS In: Pulse Per Second In; indicates card is receiving an
external clock synchronization signal
The LED’s labelled ‘Reserved’ may be in the ON or OFF state under
varying circumstances and can be ignored.
4.2 DAG 6.1S Card LED Display Functions
Description
When a DAG 6.1S card is powered up the blue coloured LED 5 should
always come on, and the remaining LED's such as green and yellow
display for specific functions.
Figure
Figure 4-2 shows the correct LED state for DAG 6.1S card without optical
input.
Figure 4-2. LED State for DAG 6.1S Card Without Optical Input.

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 11 Version 8: May 2006
4.3 Configuration in WYSYCC Style
Description
Configuration in WYSYCC is the 'What You See You Can Change' style.
Running the command ' dagsix' alone shows the current configuration.
Each of the items displayed can be changed as follows:
Configuration
options
default
Set card to normal defaults.
pos Set framer into Packet-over-SONET [PoS] mode.
[no]lsfcl
[un]set facility loopback on line side of phy.
[no]lseql
[un]set equipment loopback on line side of phy
[no]fcl
[un]set facility loopback on downstream side of phy.
[no]eql
[un]set equipment loopback on downstream side of
phy.
[no]pscramble
[un]set Packet-over-SONET scrambling.
[no]crc
Dis/enable PoS CRC32 checking.
[no]crcstrip
[Do]Don’t include CRC in ERF record or wlen count.
[no]pmin
Ds/enable discard of packets smaller than a predefined
minimum size.
[no]pmax
Dis/enable discard of packets larger than a predefined
maximum size.
long=X
Maximum packet size for pmax.
short=x
Minimum packet size for pmin.
slen=X
Capture X bytes of packet data.
eth
Set framer to 10G Ethernet mode. Defaults to LAN.
lan
Set framer to Ethernet LAN mode 10GBase-LR
wan
Set framer to Ethernet WAN mode 10GBase-LW
Continued on next page

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 12 Version 8: May 2006
4.3 Configuration in WYSYCC Style , continued
Process
Follow these steps configure the DAG 6.1S card in what you see is what
you can change style.
Step 1. Check FPGA Images
Before configuring the DAG 6.1S card, ensure the most recent FPGA image
is loaded on the card. Loading the newest available Rx FPGA image. This
will cause LED 1 to light.
Load the newest available PCI-X FPGA image.
dag@endace:~$ dagrom -rvp –d dag0 -f xilinx/dag61pcix-erf.bit
Load the newest available Rx FPGA image. This will cause LED 1 to light.
dag@endace:~$ dagld –x –d dag0 xilinx/dag61rx-erf.bit
dag@endace:~$ dagsix -d dag0
link ETH nolsfcl nolseql nofcl noeql
sonet slave
PoS nopscramble nocrc nocrcstrip nopmin nopmax long=1502 short=9
packet varlen slen=48 align64
packetA drop=0
pcix 66MHz 64-bit buf=32MB rxstreams=1 txstreams=0 mem=0:0
Step 2. Configure DAG 6.2S Card for Normal Use
The dagsix default command is always used:
dag@endace:~$ dagsix default
link POS nolsfcl nolseql nofcl noeql
sonet slave
PoS pscramble nocrc nocrcstrip nopmin nopmax long=1502 short=9
packet varlen slen=48 align64
packetA drop=0
pcix 66MHz 64-bit buf=32MB rxstreams=1 txstreams=0 mem=32:0
NOTE: The default command also sets the card to PoS mode, which will
cause LED 7 to go out. For Ethernet mode use dagsix default eth lan
or dagsix default eth wan as appropriate.
NOTE: After loading the Rx FPGA firmware, the dagsix default command
must be issued immediately to initialise the thermal management systems of
the to prevent overheating and protective shutdown.
Continued on next page

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 13 Version 8: May 2006
4.3 Configuration in WYSYCC Style , continued
Process , continued
Step 3. Turn Pos Scrambling Off
Type:
dag@endace:~$ dagsix -d dag0 nopscramble
link POS nolsfcl nolseql nofcl noeql
PoS nopscramble nocrc nopmin nopmax long=1502 short=9
packet varlen slen=48 align64
packetA drop=0
pcix 133MHz 64-bit buf=32MB rxstreams=1 txstreams=0 mem=32
:0
Step 4. Set Configuration Options
Removing or adding the "no" prefix changes the configuration option
settings.
Step 5. Select Configuration Option
Choose from complete list of configuration options supported:
default
Set card framer to normal defaults.
pos Set framer into Packet-over-SONET [PoS] mode.
[no]lsfcl
[un]set facility loopback on line side of phy.
[no]lseql
[un]set equipment loopback on downstream side of
phy.
[no]fcl
[un]set facility loopback on downstream side of phy.
[no]eql
[un] equipment loopback. This is for testing only.
[no]pscramble
[un]set Packet-over-SONET scrambling
[no]crcstrip
Do [not] include CRC in ERF record or wlen count.
[no]crc
Dis/enable PoS CRC32 checking.
[no]pmin
Dis/enable discard of packets smaller than a predefined
minimum size.
[no]pmax
Dis/enable discard of packets larger than a predefined
maximum size.
long=X
Maximum packet size for pmax.
Step 6. Select Configuration Option, continued
short=x
Minimum packet size for pmin.
slen=X
Capture X bytes of packet data.
mem=X:Y
Configure memory allocated to streams 0, 1, ..
eth
Set framer to 10G Ethernet made defaults to LAN.
lan
Set framer to Ethernet LAN made 10G Base-LR.
wan
Set framer to Ethernet WAN made 10G Base-LW

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 14 Version 8: May 2006
4.4 dagsix Utility
Description
The dagsix utility supports configuration status and physical layer
interface statistics for DAG 6 series cards.
In a troubleshooting configuration options –si should be passed to the
tool to watch the operational status of the optical, SONET and framing
layers.
More details about the meaning of the various bits are supplied through
the help page ( dagsix –h) and below.
4.5 DAG 6.1S Card Capture Session
Description
A successful DAG 6.1S card capture session is accomplished by checking
receiver port optical signal levels and checking the card has correctly
detected the link. This is followed by configuring the DAG card for
normal use.
Procedure
Follow these steps for a successful DAG 6.1S card capture session.
Step 1. Check Receiver Ports Optical Signal Levels
The DAG 6.1S card supports 1310 nanometer singlemode fibre attachments
with optical signal strength between 0 dBm and -17 dBm.
If there is doubt, check card receiver ports light levels are correct using an
optical power meter. The card receiver port is the single SC-style connector.
Step 2. Understand Link Layer Configuration
Learn about the link layer configuration in use at the network link being
monitored. Important parameters include specific scrambling options in use.
If the information cannot be obtained reliably, the card can be made to work
by varying the parameters until data is arriving at the host system.
Step 4. List Current Settings
For DAG 6.1S framer configuration and statistics the dagsix tool is
supplied. Calling dagsix without arguments lists current settings. The
dagsix -h prints a help listing on tool usage.
Step 3. Check Card is Locked to Data Stream
Configure card according to local settings.
Check through the physical layer statistics that the card is locked to the data
stream.
Continued on next page

EDM 01-11v8 DAG 6.1S Card User Guide
©2005 15 Version 8: May 2006
4.5 DAG 6.1S Card Capture Session , continued
Procedure , continued
Step 4. List Current Settings.
The dagsix tool is supplied for the DAG 6.1S card framer configuration and
statistics. Calling dagsix without arguments lists current settings. The
dagsix -h prints a help listing on tool usage.
4.6 Inspect PoS Interface Statistics
Description
Once the DAG 6.1S card has been configured for PoS mode, the PoS
interface statistics are inspected to check the card is locked to the data
stream.
dag@endace:~$ dagsix -d dag0 -si
The tool displays a number of status bits that have occurred since last
reading. The following example shows the interval is set to one second via
the -i option.
RAI Receive Alarm Indication. The optics report a receive
error. One or more of the following two bits will also
be set.
RLE Receive Lock Error. The optics report a failure in
clock recovery from the received signal.
RPA
Receive Power Alarm. The optics report insufficient
optical input power (<-30dBm).
LOS
Loss Of Signal. The framer reports there is either no
signal at receiver, or optical signal strength is too low
to be recognized.
LOC
Loss Of Clock. The framer is not receiving a valid
clock from the optics.
OOF
Out Of Frame. The framer is not locked to the SONET
frame stream.
LOF
Loss Of Frame. The framer has asserted OOF for more
than 3 milliseconds.
LOP
Loss Of Pointer. The framer cannot lock to the
SONET/SDH frame pointers.
FCS_ERR
Number of PoS FCS [CRC32] errors since last
reading.
GOOD_PACKET
Number of PoS frames received since last reading.
RXF
Receive Fifo Errors. Framer receive FIFO errors since
last reading.
Continued on next page