Endace DAG 4.3S User manual
EDM01.05-10
DAG 4.3S Card User Manual
2.5.5r1
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
Copyright© All rights reserved Revision 6. 22 September 2005.
Leading Network Intelligence
Copyright © 2005.
Published by:
Endace Measurement Systems®Ltd
Building 7
17 Lambie Drive
PO Box 76802
Manukau City 1702
New Zealand
Phone: +64 9 262 7260
Fax: +64 9 262 7261
www.endace.com
International Locations
New Zealand Americas Europe, Middle East & Africa
Endace Technology®Ltd
Level 9
85 Alexandra Street
PO Box 19246
Hamilton 2001
New Zealand
Phone: +64 7 839 0540
Fax: +64 7 839 0543
www.endace.com
Endace USA®Ltd
Suite 220
11495 Sunset Hill Road
Reston
Virginia 20190
United States of America
Phone: ++1 703 382 0155
Fax: ++1 703 382 0155
www.endace.com
Endace Europe®Ltd
Sheraton House
Castle Park
Cambridge CB3 0AX
United Kingdom
Phone: ++44 1223 370 176
Fax: ++44 1223 370 040
www.endace.com
All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in
any form or by any means electronic, mechanical, photocopying, recording, or otherwise, without the prior
written permission of the publisher. Prepared in Hamilton, New Zealand.
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
Copyright© All rights reserved Revision 6. 22 September 2005.
Typographical Conventions Used in this Document
•Command-line examples suitable for entering at command prompts are displayed in
mono-space courier font.
Results generated by example command-lines are also displayed in mono-space
courier font.
•The software version references such as 2.3.x, 2.4.x, 2.5.x are specific to Endace
Measurement Systems and relate to Company software products only.
Protection Against Harmful Interference
When present on product this manual pertains to and indicated by product labelling, the statement "This device complies
with part 15 of the FCC rules" specifies the equipment has been tested and found to comply with the limits for a Class A
digital device, pursuant to Part 15 of the Federal Communications Commission [FCC] Rules.
These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a
commercial environment.
This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the
instruction manual, may cause harmful interference to radio communications.
Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be
required to correct the interference at his own expense.
Extra Components and Materials
The product that this manual pertains to may include extra components and materials that are not essential to its basic
operation, but are necessary to ensure compliance to the product standards required by the United States Federal
Communications Commission, and the European EMC Directive. Modification or removal of these components and/or
materials, is liable to cause non compliance to these standards, and in doing so invalidate the user’s right to operate this
equipment in a Class A industrial environment.
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
Copyright© All rights reserved iRevision 6. 22 September 2005.
Table of Contents
1.0 OVERVIEW.......................................................................................................................1
1.1 User Manual Purpose......................................................................................................1
1.2 DAG 4.3S Card Product Description..............................................................................2
1.3 DAG 4.3S Card Architecture..........................................................................................2
1.4 DAG Card Extended Functions ......................................................................................3
1.5 EMI Suppression Ferrite Fitting......................................................................................4
1.6 DAG 4.3S Card System Requirements...........................................................................4
2.0 INSTALLING DAG 4.3S CARD......................................................................................6
2.1 Installation of Operating System and Endace Software..................................................6
2.2 Insert DAG 4.3S Card into PC........................................................................................6
2.3 DAG 4.3S Card Port Connector......................................................................................7
2.4 Pluggable Optical Transceivers.......................................................................................7
3.0 SETTING DAG 4.3S CARD OPTICAL POWER..........................................................9
3.1 DAG 4.3S Card Optical Power Input..............................................................................9
3.2 Splitter Losses...............................................................................................................10
4.0 CONFIDENCE TESTING..............................................................................................11
4.1 Interpreting DAG 4.3S Card LED Status......................................................................11
4.2 DAG 4.3S Card Capture Session..................................................................................13
4.3 Configuration in WYSYCC Style.................................................................................15
4.4 DAG 4.3S Card Configuration Options........................................................................15
4.5 Inspect Link Data..........................................................................................................20
4.6 Reporting Problems.......................................................................................................21
5.0 RUNNING DATA CAPTURE SOFTWARE................................................................23
5.1 Starting Capture Session...............................................................................................23
5.2 High Load Performance................................................................................................25
5.3 DAG Card Packet Transmission Capabilities...............................................................27
5.3.1 DAG Packet Transmission......................................................................................27
5.3.2 Inline Forwarding....................................................................................................30
6.0 SYNCHRONIZING CLOCK TIME..............................................................................31
6.1 Configuration Tool Usage.............................................................................................32
6.2 Time Synchronization Configurations..........................................................................32
6.2.1 Single Card no Reference Time Synchronization...................................................33
6.2.2 Two Cards no Reference Time Synchronization....................................................33
6.2.3 Card with Reference Time Synchronization...........................................................34
6.3 Synchronization Connector Pin-outs.............................................................................35
7.0 DATA FORMATS OVERVIEW....................................................................................37
7.1 Data Formats.................................................................................................................37
7.2 Timestamps...................................................................................................................39
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
Copyright© All rights reserved ii Revision 6. 22 September 2005.
USE THIS SPACE FOR NOTES
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
1Revision 6. 22 September 2005.
1.0 OVERVIEW
Introduction The installation of the Endace DAG 4.3S card on a PC begins with
installing the operating system and the Endace software. This is followed
by fitting the card and connecting the ports.
Viewing this
document This document, DAG 4.3S Card User Manual is available on the
installation CD.
In this chapter This chapter covers the following sections of information.
•User Manual Purpose
•DAG 4.3S Card Product Description
•DAG 4.3S Card Architecture
•DAG Card Extended Functions
•EMI Suppression Ferrite Fitting
•DAG 4.3S Card System Requirements
1.1 User Manual Purpose
Description The purpose of this DAG 4.3S Card User Manual is to describe:
DAG 4.3S Card Product Description
DAG 4.3S Card Architecture
DAG Card Extended Functions
EMI Suppression Ferrite Fitting
DAG 4.3S Card System Requirements
Prerequisite This document presumes the DAG card is being installed in a PC already
configured with an operating system.
A copy of the Debian Linux 3.1 (Sarge) is available as a bootable ISO
image on one of the CD's shipped with the DAG card.
To install on the Linux/FreeBSD operating system, follow the instructions
in the document EDM04.05-01r1 Linux FreeBSD Installation Manual,
packaged in the CD shipped with the DAG card.
To install on a Windows operating system, follow the instructions in the
document EDM04.05-02r1 Windows Installation Manual, packaged in the
CD shipped with the DAG card.
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
2Revision 6. 22 September 2005.
1.2 DAG 4.3S Card Product Description
Description The DAG 4.3S card is designed only for PCI-X buses. It is capable of cell
and packet capture and generation on IP networks.
Figure Figure 1-1 shows the DAG 4.3S series PCI-X card.
Figure 1-1. DAG 4.3S series PCI-X Card.
The DAG 4.3S card collects packet header and payload from ATM, POS,
and supports ATM, PPP HDLC, CISCO, HDLC over OC40c SONET or
SDH networks.
Full packet or cell capture at line rate allows recording of all header
information payload and with a high precision timestamp, subject to bus
and processor availability.
The DAG 4.3S is capable of transmitting packets at 100% line rate while
simultaneously receiving packets at 100% line rate.
1.3 DAG 4.3S Card Architecture
Description Serial SONET optical network data received by optical interface flows
into a physical layer ASIC, then immediately into the Field-Programmable
Gate Array [FPGA].
The FPGA contains an Endace DAG Universal Clock Kit [DUCK]
timestamp engine, packet record processor, and PCI-X interface logic.
Because of component close association, packets or cells are time-stamped
accurately. Time stamped packet records are stored in an external FIFO
memory before transmission to the host.
Continued on next page
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
3Revision 6. 22 September 2005.
1.3 DAG 4.3S Card Architecture, continued
Figure Figure 1-2 shows the DAG 4.3S card major components and data flow.
Tx
Rx Optics Module Framer
Coprocessor
Connector
DAG 4.3
FPGA CPLD
Time Stamping
Clock Flash
ROM
Sync
In/Out
FIFO
LED’s
PCI-X 64-Bit 66-133MHz
Figure 1-2. DAG 4.3S Card Major Components and Data Flow.
1.4 DAG Card Extended Functions
Description The DAG 4.3S functionality can be extended in many ways.
The co-processor allows for advanced features such as IP packet filtering
in hardware at line rate. Contact the Endace customer support team at
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
4Revision 6. 22 September 2005.
1.5 EMI Suppression Ferrite Fitting
Description In order to ensure compliance to EN55022 and FCC 47 Part 15 Class A
Radiated emission limits, the supplied EMI Suppression Ferrite must be
fitted to any cable connected to the Time Synchronization Connector.
The Ferrite component supplied in the DAG 4.3S product packaging box
must be fitted within 1cm of the plug housing..
Figure Figure 1-3 shows the DAG 4.3S card Ferrite component.
Figure 1-3. DAG 4.3S Card Ferrite Component.
1.6 DAG 4.3S Card System Requirements
Description The DAG 4.3S card and associated data capture system minimum
operating requirements are:
•PC, at least Intel Xeon 1.8GHz or faster
•Intel E7500, ServerWorks Grand Champion LE/HE or newer chip set
256 MB RAM
•At least one free PCI-X 1.0 slot supporting 66-133MHz operation
•Software distribution free space of 30MB
•Endace Linux Install CD requires 6 GB
PCI buses are not compatible with the DAG 4.3S card. Only PCI-X buses
are supported.
Operating
system For convenience, a Debian 3.1 [Sarge] Linux system is included on the
Endace Software Install CD. Endace currently supports Windows XP,
Windows Server 2000, Windows Server 2003, FreeBSD, RHEL 3.0, and
Debian Linux operating systems.
Continued on next page
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
6Revision 6. 22 September 2005.
2.0 INSTALLING DAG 4.3S CARD
Introduction The DAG 4.3S card can be installed in any free PCI-X 1.0 slot. It will
operate in 66, 100, and 133MHz PCI-X mode, however it will not operate
correctly in 32 or 64-bit PCI slots.
Higher speed slots are recommended for best performance.
The DAG 4.3S card should be the only device on the PCI-X bus if
possible as the card makes heavy use of PCI-X bus data transfer resources.
Although by default, the driver supports up to four DAG cards in one
system, there should not be more than one card on a single PCI-X bus due
to bandwidth limitations.
In this section This section covers the following topics of information.
•Installation of Operating System and Endace Software
•Insert DAG 4.3S Card into PC
•DAG 4.3S Card Port Connector
2.1 Installation of Operating System and Endace Software
Description If the DAG device driver is not installed, before proceeding with the next
chapter, install the software on Linux/FreeBSD operating systems by
following the instructions in EDM04-01 Linux/FreeBSD Installation
Guide.
To install the software on a Windows operating system, follow the
instructions in EDM04-02 Windows Installation Guide.
Go to the next chapter of information when the DAG device driver is
installed.
2.2 Insert DAG 4.3S Card into PC
Description Inserting the DAG 4.3S card into a PC involves accessing the bus slot,
fitting the card, and replacing bus slot screw.
Procedure Follow these steps to insert the DAG 4.3S card.
Step 1. Access bus Slot
Power computer down.
Remove PCI-X bus slot cover.
Continued on next page
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
7Revision 6. 22 September 2005.
2.2 Insert DAG 4.3S Card into PC, continued
Procedure (continued)
Step 2. Fit Card
Insert into PCI-X bus slot.
Step 3. Replace bus Slot Screw
Secure card with screw.
Step 4. Power up Computer
2.3 DAG 4.3S Card Port Connector
Description There is one duplex LC-type optical port connector. The bottom
connector is for the received signal, one nearest PCI-X slot.
The top port is for transmission and remains unconnected if a splitter is
used for passive monitoring. If this port is unused, the transceiver optics
should be covered or plugged to prevent ingress of dust.
An 8-pin RJ45 socket is used for time synchronization. This socket
should never be connected to an Ethernet network or telephone line.
2.4 Pluggable Optical Transceivers
Description Some newer versions of the DAG 4.3S cards are available with pluggable
optics. To provide compatibility with the broadest possible range of
optical parameters, Endace offers the industry standard Small Form-factor
Pluggable [SFP] optical transceiver on the DAG 4.3S card.
The SFP transceiver consists of two parts:
•Mechanical chassis attached to the circuit board
•Transceiver unit which may be inserted into the chassis
The correct transceiver is chosen to suit the optical parameters of the
target network installed in the chassis.
The transceiver may then be connected to the network via LC-style optical
connectors.
Further information about the Pluggable Optical Transceiver is available
at the Endace http://www.endace.com/dagPluggable.htm web page.
Continued on next page
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
8Revision 6. 22 September 2005.
2.4 Pluggable Optical Transceivers, continued
Description,continued
Figure Figure 2-1 shows the pluggable optical transceiver.
Figure 2-1. Pluggable Optical Transceiver.
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
9Revision 6. 22 September 2005.
3.0 SETTING DAG 4.3S CARD OPTICAL POWER
Description The optical power range depends on the particular device fitted on the
DAG 4.3S card.
The DAG 4.3S card is shipped fitted with FTRJ 1321S 1300nm single-
mode short range optics module by default.
Optical power
measure Optical power is measured in dBm – decibels relative to 1 mW where 10
dB is equivalent to a factor of 10 in power.
The numbers are all negative, showing powers below 1 mW. The most
sensitive devices can work down to about –30 dBm, or 1 uW.
Configuration The following table describes the DAG 4.3S card optics power module
part, single-mode fibre [SMF], and configuration.
Part No. Fibre Data
Rate Min/Max
Pwr [dBm] in Min/Max
Pwr [dBm] out Min/Max
Wavelength in Min/Max
Wavelength out
Finisar
FTRJ1321S SMF 2488 -18/0 -9.5/-3 1270/1600 1260/1360
Agilent
HFCT5942 SMF 2488 -19/-3 -10/-3 1260/1570 1260/1360
In this chapter This chapter covers the following sections of information.
•DAG 4.3S Card Optical Power Input
•Splitter Losses
3.1 DAG 4.3S Card Optical Power Input
Description The optical power input to the DAG 4.3S card must be within a receiver’s
dynamic range.
When optical power is slightly out of range an increased bit error rate is
experienced. If power is well out of range the system cannot lock onto the
SONET signal. In extreme cases of being out range excess power will
damage a receiver.
When power is above the upper limit the optical receiver saturates and
fails to function. When power is below the lower limit the bit error rate
increases until the device is unable to obtain lock and fails.
Continued on next page
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
10 Revision 6. 22 September 2005.
3.1 DAG 4.3S Card Optical Power Input, continued
Input power When the DAG card is set up, measure the optical power at the receiver
and ensure that it is within the specified power range.
Input power is adjusted by:
•Changing splitter ratio if power is too high or too low, or
•Inserting an optical attenuator if power is too high.
3.2 Splitter Losses
Description Splitters have the insertion losses marked on packaging or in
accompanying documentation.
•A 50:50 splitter will have an insertion loss of between 3 dBm and 4
dBm on each output
•90:10 splitter will have losses of about 10 dBm in the high loss
output, and <2 dBm in the low loss output
Single mode
fibre loss A single mode fibre connected to a multi-mode input has minimal extra
loss.
Multi-mode
fibre loss A multi-mode fibre connected to a single mode input creates large and
unpredictable loss.
Wavelength loss Splitters are designed for a particular wavelength. When mismatched, the
split ratio will be different from that which was intended.
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
11 Revision 6. 22 September 2005.
4.0 CONFIDENCE TESTING
Introduction The confidence testing is a process to determine whether the DAG 4.3S
card is functioning correctly.
The process also involves a card capture session, and demonstrates
configuration in the style of 'What You See You Can Change', WYSYCC.
Interface statistics are also inspected during this process.
In this chapter This chapter covers the following sections of information.
•Interpreting DAG 4.3S Card LED Status
•DAG 4.3S Card Capture Session
•Configuration in WYSYCC Style
•DAG 4.3S Card Configuration Options
•Inspect Link Data
•Reporting Problems
4.1 Interpreting DAG 4.3S Card LED Status
Description When a DAG 4.3S card is powered up LED 1 should always illuminates.
The other LEDs display for specific functions. The DAG 4.3S has 6 status
LEDs, one is coloured blue, one yellow, two green, one orange, and one
red.
Figure Figure 4-1 shows the DAG 4.3S status LEDs.
Figure 4-1. DAG 4.3S Card Status LEDs.
Continued on next page
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
12 Revision 6. 22 September 2005.
4.1 Interpreting DAG 4.3S Card LED Status, continued
Figure Figure 4-2 shows the correct LED state for DAG 4.3S card without optical
input.
Figure 4-2. LED State for DAG 4.3S Card Without Optical Input.
LED definitions The following table describes the LED definitions.
LED Description
LED 1 FPGA successfully programmed.
LED 2 Data capture in progress.
LED 3 Reserved.
LED 4 Transmitter laser ON.
LED 5 SD. Signal Detect. Illuminates when light is detected.
LED 6 LOF. Loss of frame. Illuminates the framer loses lock on a
valid SONET/SDH stream.
LED 7 PPS Out: Pulse Per Second Out – flashes indicate card is
sending a clock synchronization signal.
LED 8 PPS In: Pulse Per Second In – flashes indicate card is
receiving an external clock synchronization signal.
Description The dagfour utility supports configuration status and physical layer
interface statistics for the DAG 4.3S. In a troubleshooting configuration
options –si should be passed to the tool to watch the operational status of
the optical, SONET and framing layers. More details about the meaning of
the various bits are supplied through the help page (dagfour –h) as well
as via the manual page.
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
13 Revision 6. 22 September 2005.
4.2 DAG 4.3S Card Capture Session
Description The DAG 4.3S uses an ASIC SONET ATM/PoS physical layer interface
device to support capturing of ATM cells and HDLC encoded Packet-
over-SONET data frames. The card supports both SONET (STS-48c) and
SDH (STM-16c).
A successful DAG 4.3S card capture session is accomplished by checking
the receiver ports optical signal levels and checking the card has correctly
detected the link. This is followed by configuring DAG for normal use.
Procedure Follow these steps to troubleshoot DAG 4.3S card configuration.
Step 1. Check Receiver Ports Optical Signal Levels.
The card supports 1300 nanometer single-mode fibre attachments with
optical signal strength between 0 dBm and -18 dBm.
If in doubt, check card receiver ports light levels are correct using an optical
power meter.
The card receiver ports are the lower half of the LC-style connector, the
closest to the LEDs.
Cover unused card transmit ports with LC-style plugs to prevent dust and
mechanical hazards from damaging optics.
Step 2. Understand Link Layer Configuration
Learn about the link layer configuration in use at the network link being
monitored.
Important parameters include specific scrambling options in use. If the
information cannot be obtained reliably, the card can be made to work by
varying the parameters until data is arriving at the host system.
Step 3. Check FPGA Image Loaded.
Before configuring the card, ensure the most recent FPGA image is loaded
on the card.
dag@endace:~$ dagrom -rvp –d dag0 -f xilinx/dag43pcix-terf.bit
dag@endace:~$ dagfour -d dag0
light nolaser
link noreset OC48c nofcl noeql
sonet master scramble
ATM discard pscramble norxpkts notxpkts
packet varlen slen=48 noalign64
packetA drop=0
pcix 133MHz 64-bit nodrop routesource=stream0 buf=128MB rxstreams=1 txstreams=1 mem=0:0
Continued on next page
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
14 Revision 6. 22 September 2005.
4.2 DAG 4.3S Card Capture Session, continued
Procedure, continued
Step 4. Check Card is Locked to Data Stream
Configure card according to local settings.
Check through the physical layer statistics that the card is locked to the data
stream.
Step 5. List Current Settings
For DAG 4.3S framer configuration and statistics the dagfour tool is
supplied.
Calling dagfour without arguments lists current settings.
The dagfour -h prints a help listing on tool usage.
Step 6. Configure DAG for Normal Use
The dagfour default command is always used:
dag@endace:~$ dagfour default
light nolaser
link noreset OC48c nofcl noeql
sonet master scramble
POS crc32 nocrcstrip short=16 long=1536 discard nopscramble rxpkts txpkts
packet varlen slen=48 noalign64
packetA drop=0
pcix 133MHz 64-bit nodrop routesource=stream0 buf=32MB rxstreams=1 txstreams=1 mem=32:0
ATM
monitoring The default command always sets the DAG 4.3S card to POS mode. For
ATM monitoring use default atm.
Endace Measurement Systems.
http://www.endace.com EDM01.05-10r1 DAG 4.3S Card User Manual
15 Revision 6. 22 September 2005.
4.3 Configuration in WYSYCC Style
Description The configuration of the tool works in WYSYCC style – what you see you
can change.
To turn on the card’s laser on for instance, type:
dag@endace:~$ dagfour -d dag0 laser
light laser
link noreset OC48c nofcl noeql
sonet master scramble
POS crc32 nocrcstrip short=16 long=1536 discard nopscramble rxpkts txpkts
packet varlen slen=48
packetA drop=0
pcix 133MHz 64-bit nodrop routesource=stream0 buf=128MB rxstreams=1 txstreams=1 mem=128:0
ATM status In ATM mode, the status output changes:
dag@endace:~$ dagfour -d dag0 atm
light laser
link noreset OC48c nofcl noeql
sonet master scramble
ATM discard pscramble rxpkts txpkts
packetA drop=0
pcix 133MHz 64-bit nodrop routesource=stream0 buf=128MB rxstreams=1 txstreams=1 mem=128:0
For configuration options removing or adding the "no" prefix will change
the setting.
4.4 DAG 4.3S Card Configuration Options
Description There are many DAG 4.3S card configuration options supported.
default set framer to normal defaults
[no]laser dis/enable transmit laser
atm set framer into ATM mode
pos set framer into Packet-over-SONET (PoS) mode
[no]reset hold/release framer (in) reset
oc48c set framer to OC48c mode
[no]fcl (un)set facility loop back in the phy. This is useful for
card chaining
[no]eql (un)set equipment loop back in the phy
[no]scramble (un)set SONET scrambling
Continued on next page
Table of contents
Other Endace PCI Card manuals
