HP 3458A User manual

t
T .O . 33K8-4-551-1
TECHNICAL MANUAL
CALIBRATION PROCEDURE
FOR
DIGITAL VOLTMETER
3458A
(HEWLETT-PACKARD)
This publication incorporates Interim Operational Supplement T .O
. 33K8-4-551-1S-1
dated 27 August 2007.
Distribution Statement C - Distribution authorized to U . S . Government agencies and their contractors for
official use or for administrative or operational purposes only, 7 November 1990 . Requests for this
document shall be referred to 562 CBSG/GBHA, 813 Irving-Wick Dr W, Heath, OH 43056-1199.
Destruction Notice - For unclassified, limited documents, destroy by any method that will prevent
disclosure of the contents or reconstruction of the document.
Published under Authority of the Secretary of the Air Force
30 JUNE 2007
CHANGE 1 - 30 SEPTEMBER 2007

it
T
.O . 33K8-4-551-1
INSERT LATEST CHANGED PAGES . DESTROY SUPERSEDED PAGES.
LIST OF EFFECTIVE PAGES
NOTE
: The portion of the text and illustrations affected by the changes is indicated by a vertical
line in the outer margins of the page.
Date of issue for original and changed pages are:
Original  0  30 June 2007
Change  l  30 September 2007
TOTAL NUMBER OF PAGES IN THIS PUBLICATION IS 44, CONSISTING OF THE FOLLOWING:
Page

* Change

Page

* Change

Page

* Change
No .

No .

No .

No .

No .

No.
Title  1
A  1
1 - 16  0
17  1
18 - 31  0
32 Blank  0
A-I - A-10  0
*Zero in this column indicates an original page
A Change 1

USAF

T .O . 33K8-4-551-1
DIGITAL VOLTMETER
3458A
(HEWLETT-PACKARD)
I CALIBRATION DESCRIPTION :
Table I.
Test Instrument (TI)

Performance

Test
Characteristics

Specifications

Method
NOTE
The Performance Specifications listed below for the TI show Relative specifications as found in
the commercial data and Absolute specifications . The absolute specifications were calculated by
combining the uncertainty of the relative specifications found in the commercial data with the
uncertainty of the calibration standards listed in Section 2, Equipment Requirements.
DC Voltage

Range : 0 to 1000 VDC

Compared to a DC
Reference Standard
Accuracy :

and DC Reference
Relative : ±(ppm of rdg + ppm of mg)

Divider or DC Voltage
Absolute : ±[Sgrt(TI ppm of rdg^2 +

Divider
STD 1 ppm of rdg^2 + STD2 ppm of rdg^2)
+ TI ppm of rng]
Standard
Range
Relative

Absolute
100mV
9+10

(9+1 .5+0 .5)+10
lV 8+1

(8+1 .5+0 .2)+1
10V 8+0 .2

(8+1
.5)+0 .2
100V 10+ 0 .3

(10+1 .5+0 .2)+0 .3
1000 V 10+0 .1

(10+ 1 .5+0 .5)+0 .1
Inputs >100 VDC, add
12 ppm X (Vin/1000) 2
Opt 002
Range Relative

Absolute
100mV 5+10

(5+1 .5+0 .5)+10
1V 4+1

(4+1 .5+0
.2)+1
IOV 4+0 .2

(4+1 .5)+0 .2
1

T
.O
. 33K8-4-551-1
Table 1 . (Cont)
Test Instrument (TI)

Performance

Test
Characteristics

Specifications

Method
DC Voltage
(Cont .)
Range : 0 to 1000 VDC

Compared to a DC
Reference Standard
Accuracy :

and DC Reference
Relative : ±(ppm of rdg + ppm of mg)

Divider or DC Voltage
Absolute : ±[Sqrt(TI ppm of rdg A 2 +

Divider
STD 1 ppm of rdg^2 + STD2 ppm of rdg^2)
+ TI ppm of mg]
Opt 002 (Cont .) Range Relative Absolute
100 V 6 + 0 .3 (6 + 1 .5 + 0 .2) + 0
.3
1000 V 6 + 0 .1 (6 + 1 .5 + 0 .5) + 0 .1
Inputs >100 VDC, add
12 ppm X (Vinll000) 2
Resistance
Range
Range : 0 to 1 G52

Compared to a
Resistance Standard
Accuracy:
Relative : ±(ppm of rdg + ppm of mg),
(Add 250 mf g for Two-Wire Ohms)
Absolute: ±[Sgrt(TI ppm of rdg^2 +
STDI ppm of rdg^2) + Ti ppm of mg]
(Add 250 ml) for Two-Wire Ohms)
Relative

Absolute
10 S2 15+5

(15+2 .15)+5
10052 12+5

(12+2 .15)+5
1 kl2 10+0 .5

(10+2 .15)+0 .5
10ki2 10+0 .5

(10+2.1)+0 .5
100kI2 10+0 .5

(10+2.4)+0 .5
1 MSZ 15+2

(15+6)+2
10 MCI 50+10

(50 + 12) + 10
100 MS2 500 + 10

(500 + 50) + 10
1 G1)
5000 + 10

(5000 + 50) + 10
2

T .O . 33K8-4-551-1
Table 1 . (Cont .)
Test Instrument (TI)

Performance
Characteristics

Specifications
Test
Method
DC Current

Range : 0 to 1 ADC Compared to a known
DC Current
Accuracy:
Relative : ±(ppm of rdg + ppm of mg)
Absolute : ±[Sgrt(TI ppm of rdg^2 +
STD1 ppm of rdg^2 + STD2 ppm of rdg^2)
+ TI ppm of mg]
Range

Relative
100 nA *
I

30 + 400
1 µA * I

20 + 40
10µA *'

20+10
100 µA

20 + 8
1 and 10 mA

20 + 5
100mA

35+5
lA

110+ 10
Absolute
N/A
N/A
N/A
(20 + 5 .277 + 5) + 8
(20 + 5 .277 + 5) + 5
(35+5 .277+5)+5
(110+5
.277+6)+10
AC Voltage

Range : 0 to 1000 VAC
(Synchronous Sub-sampled Mode)
AC BAND <_2 MHz
Compared to an
AC Measurement
Standard or Calibrator
*2
Accuracy:
Relative : ±(% of rdg + % of mg)
Absolute:
±[Sgrt(TI % of rdg^2 + STD1 % of rdg^2 +
STD2 % of rdg^2) + TI % of mg +
STD1 µV + STD2 [IV]
Range

Frequency

Relative

Absolute
10 mV

1 to 20 Hz

0 .03 + 0 .03

(0 .03+0+0 .029)+0 .03+0+ 1 .3
20 to 40 Hz

0 .03 + 0 .03

(0 .03+0+0 .019)+0 .03+0+ 1 .3
40 Hz to 1 kHz

0 .02 + 0 .011

(0 .02 + 0 + 0 .011) + 0 .011 + 0 + 1 .3
1 to 20 kHz

0 .03 + 0 .011

(0 .03 +0+0 .011)+0 .011 + 0 + 1 .3
20to50kHz

0 .1+0 .011

(0
.1+0+0 .021)+0 .011+0+2
50 to 100 kHz

0 .5 + 0 .011

(0 .5+0+0 .031)+0 .011+0+2 .5
100 to 300 kHz

4 + 0 .02

(4+0+0 .081)+0 .02+0+4
See footnotes at end of Table .
3

T .O . 33K8-4-551-1

Table 1 . (Cont)
Test Instrument (TI)

Performance
Characteristics

Specifications
Test
Method
AC Voltage

Range : 0 to 1000 VAC

Compared to an
(Synchronous Sub-sampled Mode) (Cont .)

AC Measurement
AC BAND 5 .2 MHz

Accuracy :

Standard or Calibrator
Relative : ±(% of rdg + % of mg)
Absolute:
±[Sgrt(TI % of rdg^2 + STD 1 % of rdg^2 +
STD2 % of rdg^2) + TI % of mg +
STD1 µV + STD2 µV]
Range

Frequency

Relative
100 mV

1 to 20 Hz

0 .007 + 0 .004
20 to 40 Hz

0 .007 + 0 .004
40 Hz to 1 kHz

0 .007 + 0 .002
1 to 20 kHz

0 .014 + 0 .002
20 to 50 kHz

0 .03 + 0 .002
50 to 100 kHz

0 .08 + 0 .002
100to300kHz

0 .3+0 .01
300 to 500 kHz

1 + 0 .01
500 kHz to 1 MHz

1 + 0 .01
1 to2MHz

1 .5+0 .01
1 V

1 to 20 Hz

0 .007 + 0 .004
20 to 40 Hz

0 .007 + 0 .004
40 Hz to 1 kHz

0 .007 + 0 .002
1 to 20 kHz

0 .014 + 0 .002
20 to 50 kHz

0 .03 + 0 .002
50 to 100 kHz

0 .08 + 0 .002
100 to 300 kHz

0 .3 + 0 .01
300to500kHz

1+0 .01
500 kHz to 1 MHz

1 + 0 .01
1to2MHz

1 .5+0 .01
10 V

1 to 20 Hz

0 .007 + 0 .004
20 to 40 Hz

0 .007 + 0 .004
40 Hz to 1 kHz

0 .007 + 0 .002
1 to 20 kHz

0 .014 + 0 .002
20 to 50 kHz

0 .03 + 0 .002
50 to 100 kHz

0 .08 + 0 .002
100 to 300 kHz

0 .3 + 0 .01
300 to 500 kHz

1 + 0 .01
500 kHz to 1 MHz

1 + 0 .01
1 to 2 MHz

1 .5 + 0 .01
See footnote at end of Table .
Absolute
(0 .007+0+0 .021)+0
.004+0+1 .5 *2
(0 .007+0+0 .0085)+0 .004+0+1 .5
(0
.007+0+0 .0038)+0 .002+0+1 .5
(0 .014+0+0 .0038)+0 .002+0+1 .5
(0 .03 +0+0 .0069)+0 .002+0+2
(0 .08+0+0 .016)+0 .002+0+2 .5
(0 .3+0+0 .025)+0 .01 +0+4
(1+0+0 .038)+0 .01+0+8
(1+0+0 .06)+0
.01+0+0
(1 .5+0.1+0 .0038)+0 .01+3+1 .5
(0 .007+0+0 .02)+0 .004+0+0
*
2
(0 .007+0+0 .0066)+0 .004 +0+0
(0 .007+0+0 .0024)+0 .002+0+0
(0 .014+0+0 .0024)+0 .002+0+0
(0 .03+0+0 .0046)+0 .002+0+0
(0
.08+0+0
.0071)+0 .002+0+0
(0 .3+0+0 .016)+0 .01+0+0
(1+0+0 .026)+0 .01+0+0
(1+0+0 .06)+0 .01+0+0
(1 .5+0 .1-1-0 .0024)+0 .01+3+0
(0 .007+0+0 .02)+0 .004+0+0 * 2
(0 .007+0+0 .0067)+0 .004+0+0
(0 .007+0+0 .0027)+0 .002+0+0
(0 .014+0+0 .0027)+0
.002+0+0
(0 .03+0+0 .0048)+0 .002+0+0
(0 .08+0+0 .0081)+0 .002+0+0
(0 .3+0+0 .019)+0 .01+0+0
(1+0+0 .04)+0 .01+0+0
(1+0+0 .06)+0 .01+0+0
(1 .5+0.1+0 .0027)+0 .01+3+0 * 2
4

T .O
. 33K8-4-551-1
Table 1 . (Cont)
Test Instrument (TI)

Performance
Characteristics

Specifications
Test
Method
AC Voltage

Range
: 0 to 1000 VAC
Compared to an
AC Measurement(Synchronous Sub-sampled Mode) (Cont .)
AC BAND <_2 MHz Accuracy :

Standard or Calibrator
Relative : ±(% of rdg + % of mg)
Absolute:
±[Sgrt(TI % of rdg^2 + STD1 % of rdg^2 +
STD2 % of rdg A 2) + TI % of mg +
STD1 µV + STD2 µV]
Range
Frequency Relative Absolute
100 V 1 to 20 Hz 0 .02 + 0 .004 (0 .02+0+0 .02)+0 .004+0+0 * 2
20 to 40 Hz
0 .02 + 0 .004 (0 .02+0+0
.0068)+0 .004+0+0
40 Hz to 20 kHz 0 .02 + 0 .002 (0 .02+0+0 .0031)+0 .002+0+0
20 to 50 kHz 0 .035 + 0 .002 (0 .035+0+0 .0069)+0 .002+0+0
50 to 100 kHz 0 .12 + 0 .002 (0 .12+0+0 .0098)+0 .002+0+0
100 to 300 kHz 0 .4 + 0 .01
(0
.4+0+0
.021)+0 .01+0+0 *2
300 kHz to 1 MHz 1 .5 + 0 .01 (1 .5+0+0 .05)+0
.01+0+0
*
2
1000 V * 3 1 to 20 Hz 0
.04 + 0
.004 (0 .04+0+0 .02)+0 .004+0+0
* 2
20 to 40 Hz 0 .04 + 0 .004 (0 .04+0+0
.0099)+0
.004+0+0
* 2
(<220 V) 40 Hz to 1 kHz 0 .04 + 0 .002 (0 .04+0+0 .0031)+0 .002+0+0
(<_700 V) 40 Hz to 1 kHz 0 .04 + 0 .002 (0 .04+0+0 .0041)+0 .002+0+0
(>700 V) 40 Hz to 1 kHz 0 .04 + 0 .002 (0 .04+0+0 .0038)+0 .002+0+0
(<_700 V) 1 to 20 kHz
0 .06 + 0
.002
(0 .06+0+0
.0041)+0
.002+0+0
(>700 V) I to 20 kHz 0 .06 + 0 .002 (0 .06+0+0 .0038)+0 .002+0+0
20 to 50 kHz 0 .12 + 0 .002 (0 .12+0+0 .013)+0 .002+0+0
* 2
50 to 100 kHz 0 .3 + 0 .002 (0 .3+0+0 .05)+0 .002+0+0 * 2
AC BAND >2 MHz Accuracy:
Relative
: ±(% of rdg + % of mg)
Absolute:
±[Sgrt(TI % of rdg^2 + STD1 % of rdg^2 +
STD2 % of rdg^2) + TI % of mg +
STD1 [IV + STD2 µV]
Range Frequency Relative
Absolute
10 mV 45 Hz to 20 kHz 0 .09 + 0 .06 (0 .09+0+0 .011)+0 .06+0+ 1 .3
20 to 50 kHz 0 .09 + 0 .06 (0 .09+0+0 .021)+0
.06+0+2
50 to 100 kHz 0 .09 + 0 .06
(0 .09 + 0 + 0 .031) + 0 .06 + 0 + 2
.5
100to300kHz 1 .2+0 .05 (1 .2+0+0 .081)+0 .05+0+4
300to500kHz 1 .2+0 .05 (1 .2+0+0 .089)+0 .05+0+8
500 kHz to 1 MHz 1 .2 + 0 .05 (1 .2+0+0 .17)+0 .05+0+8
1 to 2 MHz
7 + 0
.07
(7+0 .1 +0 .011)+0 .07+3+ 1 .3
2to4MHz 7+0 .07 (7+0.2+0 .011)+0
.07+3+ 1
.3
4 to 8 MHz 20 + 0 .08 (20+0 .2 +0 .011)+0 .08 +3 + 1 .3
See footnotes at end of Table .
5

T .O . 33K8-4-551-1
Table 1 . (Cont)
Test Instrument (TI)

Performance
Characteristics

Specifications
Test
Method
AC Voltage

Range : 0 to 1000 VAC Compared to an
AC Measurement (Synchronous Sub-sampled Mode) (Cont .)
AC BAND >2 MHz Accuracy :

Standard or Calibrator
Relative : ±(% of rdg + % of mg)
Absolute:
±[Sgrt(TI % of rdg A 2 + STD1 % of rdg^2 +
STD2 % of rdg A 2) + TI % of mg +
STD1 p .V + STD2 .tV]
Range Frequency Relative Absolute
100 mV 45 Hz to 20 kHz 0 .09 + 0 .06 (0 .09+0+0 .0038)+0 .06+0+ 1 .5
20 to 50 kHz 0 .09 + 0 .06 (0 .09 + 0 + 0 .0069) + 0 .06 + 0 + 2
50 to 100 kHz 0 .09 + 0 .06 (0 .09 + 0 + 0 .016) + 0 .06 + 0 + 2 .5
100 to 300 kHz 2 + 0 .05 (2+0+0 .025)+0 .05+0+4
300 to 500 kHz 2 + 0 .05
(2+0+0
.038)+0 .05+0+8
500 kHz to 1 MHz 2 + 0 .05 (2+0+0 .06)+0 .05+0+0
1 to 2 MHz 4 + 0 .07 (4+0 .1 +0 .0038)+0 .07 +3 + 1 .5
2to4MHz 4+0 .07 (4 + 0 .2 + 0 .0038) + 0 .07 + 3 + 1 .5
4to8MHz 4+0 .08 (4 + 0.2 + 0 .0038) + 0 .08 + 3 + 1 .5
8to10MHz 15+0 .1 (15+0 .2+0 .0038)+0 .1+3+1 .5
1 V 45 Hzto20kHz 0 .09+0 .06
(0
.09+0+0
.0024)+0 .06+0+0
20 to 50 kHz 0 .09 + 0 .06 (0 .09 +0+0 .0046)+0
.06+0+0
50 to 100 kHz 0 .09 + 0 .06 (0 .09+0+0 .0071)+0 .06+0+0
100to300kHz 2+0
.05 (2+0+0
.016)+0
.05+0+0
300to500kHz 2+0 .05 (2+0+0 .026)+0
.05+0+0
500 kHz to 1 MHz 2 + 0 .05 (2+0+0 .06)+0 .05+0+0
1 to2MHz
4+0 .07 (4+0.1+0 .0024)+0 .07+3+0
2to4MHz 4+0
.07 (4+0.2+0 .0024)+0 .07+3 +0
4to8MHz 4+0 .08 (4+ 0 .2 + 0 .0024) + 0 .08 + 3 +
8to10MHz
15+0 .1 (15+0
.2+0
.0024)+0 .1 +3 +0
10V 45 Hz to 20 kHz 0 .09 + 0 .06 (0 .09+0+0 .0027)+0 .06+0+0
20 to 50 kHz 0 .09 + 0 .06 (0 .09+0+0 .0048)+0 .06+0+0
50 to 100 kHz
0
.09 + 0
.06 (0 .09+0+0 .0081)+0
.06+0+0
100to300kHz
2+0
.05
(2+0+0
.019)+0
.05+0+0
300 to 500 kHz 2 + 0 .05
(2+0+0 .04)+0
.05+0+0
500 kHz to 1 MHz 2 + 0 .05 (2+0+0 .06)+0 .05+0+0
1 to2MHz 4+0 .07 (4+0.1+0 .0027)+0 .07+3+0
* 2
2 to 4 MHz 4 + 0 .07 (4+0.2+0 .0027)+0 .07+3+0
*
2
4to8MHz 4+0 .08 (4+0.2+0 .0027)+0 .08+3+0
* 2
8to 10 MHz 15+0 .1 (15+0.2+0 .0027)+0
.1+3+0 * 2
100 V 45 Hz to 20 kHz 0 .12 + 0 .002 (0 .12+0+0 .0031)+0 .002+0+0
20to50kHz 0 .12+0 .002 (0 .12+0+0 .0069)+0 .002+0+0
50 to 100 kHz 0 .12 + 0 .002 (0 .12+0+0 .0098)+0 .002+0+0
1000V
* 3
(<_220 V) 45 Hz to 20 kHz 0 .3 + 0 .01 (0 .3+0+0 .0031)+0 .01+0+0
(<_700 V) 45 Hz to 20 kHz 0 .3 + 0 .01 (0 .3+0+0 .0041)+0
.01+0+0
(>700 V) 45 Hz to 20 kHz 0 .3 + 0 .01 (0 .3+0+0 .0038)+0 .01+0+0
20 to 50 kHz 0 .3 + 0 .01 (0 .3+0+0 .013)+0
.01+0+0
* 2
50 to 100 kHz 0 .3+0 .01 (0 .3+0+0 .05)+0
.01+0+0
See footnotes at end of Table.
6

T .O . 33K8-4-551-1
Table 1 . (Cont)
Test Instrument (TI)
Characteristics
Performance
Specifications
Test
Method
AC Voltage Range : 0 to 1000 VAC

Compared to an
(Analog Mode)
AC Measurement
AC BAND <_2 MHz Accuracy :

Standard or Calibrator
Relative : ±(% of rdg + % of mg)
Absolute:
±[Sgrt(TI % of rdg A
2 + STD 1 % of rdg^2 +
STD2 % of rdg A 2) + TI % of rng +
STD1 µV + STD2 µV]
Range Frequency Relative Absolute
10mV 10 to 20 Hz 0 .4+0 .32 (0 .4+0+0 .029)+0 .32+0+ 1 .3
20 to 40 Hz 0 .15 + 0
.25 (0
.15+0+0 .019)+0
.25+0+ 1 .3
40 to 100 Hz 0 .06 + 0 .25 (0 .06+0+0 .011)+0 .25+0+ 1 .3
100 Hz to 20 kHz 0 .02 + 0 .25 (0 .02+0+0 .011)+0 .25+0+ 1 .3
20to50kHz 0 .15+0 .25 (0 .15+0+0 .021)+0 .25+0+2
50 to 100 kHz 0
.7+0 .35
(0 .7+0+0 .031)+0 .35+0+ 2 .5
100 to 250 kHz 4+0 .7 (4+0+0 .081)+0 .7+0+4
100 mV 10 to 20 Hz
0 .4 + 0 .02 (0
.4+0+0 .021)+0 .02+0+ 1
.5
20 to 40 Hz 0 .15+0 .02 (0 .15 +0+0 .0085)+0 .02+0+ 1 .5
40 to 100 Hz 0 .06 + 0 .01 (0 .06+0+0 .0038)+0 .01 +0+ 1 .5
100 Hz to 20 kHz 0 .02 + 0 .01 (0 .02+0+0 .0038)+0 .01 +0+ 1 .5
20 to 50 kHz 0 .15 + 0 .04 (0 .15 +0+0 .0069)+0 .04+0+2
50 to 100 kHz 0 .6 + 0.08 (0 .6+0+0 .016)+0 .08+0+ 2 .5
100 to 2501(Hz
2+0 .5
(2+0+0 .025)+0 .5+0+4
250 to 300 kHz 3 + 0 .6 (3+0+0 .025)+0 .6+0+4
300 to 500 kHz 3 + 0 .6 (3+0+0 .038)+0 .6+0+8
500 kHz to 1 MHz 5 + 2 (5+0+0 .06)+2+0+0
1to2MHz 10+5 (10+0 .1 +0 .0038)+5 +3 + 1 .5
1 V 10 to 20 Hz 0 .4+0 .02 (0 .4+0+0 .02)+0 .02+0+0
20 to 40 Hz 0 .15 + 0 .02 (0 .15+0+0 .0066)+0 .02+0+0
40 to 100 Hz 0 .06 + 0 .01 (0 .06+0+0 .0024)+0 .01 +0+0
100 Hz to 20 kHz 0 .02+0 .01 (0 .02+0+0 .0024)+0 .01 +0+0
20 to 50 kHz 0 .15 + 0
.04
(0 .15+0+0
.0046)+0 .04+0+0
50 to 100 kHz 0 .6 + 0 .08 (0 .6+0+0 .0071)+0 .08+0+0
100to250kHz 2+0 .5 (2+0+0 .016)+0 .5+0+0
250 to 300 kHz
3+0 .6
(3+0+0 .016)+0
.6+0+0
300 to 500 kHz 3 + 0 .6 (3+0+0 .026)+0 .6+0+0
500 kHz to l MHz 5 + 2 (5+0+0 .06)+2+0+0
1to2MHz 10+5 (10+0 .1+0 .0024)+5+3+0
7

T .O
. 33K8-4-551-1
Table 1 . (Cont .)
Test Instrument (TI) Performance Test
Characteristics Specifications Method
AC Voltage Range : 0
to 1000 VAC Compared
to an
(Analog Mode) (Cont .) AC Measurement
AC
BAND <_2 MHz Accuracy : Standard or Calibrator
Relative : ±(% of rdg + % of mg)
Absolute:
±[Sgrt(TI % of rdg^2 + STD 1 % of rdg^2 +
STD2 % of rdg^2)
+ TI
% of mg +
STD 1 µV + STD2 µV]
Range Frequency Relative Absolute
10 V 10 to 20 Hz 0 .4 + 0 .02 (0 .4+0+0 .02)+0 .02+0+0
20 to 40 Hz 0 .15 + 0 .02 (0 .15 +0+0 .0067)+0 .02+0+0
40 to 100 Hz 0 .06+0 .01 (0 .06 + 0 + 0 .0027) + 0 .01 + 0 + 0
100 Hz to 20 kHz 0 .02 + 0 .01 (0 .02 + 0 + 0 .0027) + 0 .01 + 0 + 0
20to50kHz 0 .15+0 .04 (0 .15 +0+0 .0048)+0 .04+0+0
50 to 100 kHz 0 .6 + 0 .08 (0 .6+0+0 .0081)+0 .08+0+0
100 to 250 kHz 2 + 0 .5 (2+0+0 .019)+0 .5+0+0
250 to 300 kHz 3 + 0 .6 (3+0+0 .019)+0 .6+0+0
300to500kHz 3+0 .6 (3+0+0 .04)+0 .6+0+0
500 kHz to 1 MHz 5 + 2
(5+0+0
.06)+2+0+0
1 to2MHz 10+5 (10+0 .1+0 .0027)+5+3+0
* 2
100 V
10 to 20 Hz 0 .4 + 0 .02 (0 .4+0+0 .02)+0
.02+0+0
20 to 40 Hz 0 .15 + 0 .02 (0 .15+0+0 .0068)+0 .02+0+0
40 to 100 Hz 0 .06 + 0 .01 (0 .06+0+0 .0031)+0 .01
+0+0
100 Hz to 20 kHz 0 .03 + 0 .01 (0 .03+0+0 .0031)+0
.01+0+0
20to50kHz 0 .15+0 .04 (0 .15+0+0 .0069)+0 .04+0+0
50 to 100 kHz 0 .6 + 0 .08 (0 .6+0+0 .0098)+0 .08+0+0
100 to 250 kHz 2+0 .5 (2+0+0 .021)+0 .5+0+0
250 to 300 kHz 3 + 0 .6 (3+0+0 .021)+0 .6+0+0
300 to 500 kHz 3 + 0 .6 (3+0+0 .05)+0
.6+0+0
500 kHz to 1 MHz 5 + 2 (5+0+0 .06)+2+0+0 * 2
1000 V *3
lO to 20 Hz 0
.42+0
.03
(0
.42+0+0 .02)+0
.03+0+0 *2
20 to 40 Hz 0 .17+0 .03 (0 .17+0+0 .0099)+0 .03+0+0
* 2
(<_700 V) 40 to 100 Hz 0 .08 + 0 .02 (0 .08+0+0 .0041)+0 .02+0+0
(>700 V) 40 to 100 Hz 0 .08 + 0 .02 (0 .08+0+0 .0038)+0 .02+0+0
(0 .06+0+0 .0041)+0 .02+0+0
(5700 V) 100 Hz
to 20 kHz
0
.06 + 0 .02
(>700 V) 100 Hz to 20 kHz 0 .06 + 0 .02 (0 .06+0+0 .0038)+0 .02+0+0
20 to 50 kHz 0 .15+0 .04 (0 .15+0+0 .013)+0
.04+0+0
* 2
50 to 100 kHz 0 .6+0 .2 (0 .6+0+0 .05)+0 .2+0+0
See footnotes at end of Table.
8

T .O
. 33K8-4-551-1
Table 1 . (Cont .)
Test Instrument (TI)
Characteristics Performance Specifications
Test
Method
Range : 0 to 1000 VAC
Accuracy:
Relative : ±(% of rdg + % of mg)
Absolute:
±[Sgrt(TI % of rdg^2 + STD1 % of rdg^2 +
STD2 % of rdg A 2) + TI % of mg +
STD1 .tV + STD2 µV]
Range Frequency Relative Absolute
10 mV 20 to 40 Hz 0 .5 + 0 .02 (0 .5 +0+0 .019)+0 .02+0+ 1 .3
40 Hz to 20 kHz 0 .5 + 0 .02 (0 .5 +0+0 .011)+0 .02+0+ 1 .3
20 to 50 kHz 0 .5 + 0 .02 (0 .5 +0+0 .021)+0 .02+0+2
50 to 100 kHz 0 .5 + 0.02 (0 .5 +0+0 .031)+0 .02+0+ 2 .5
100 to 300 kHz 4 + 0 .02 (4+0+0 .081)+0 .02+0+4
100 mV 20 to 40 Hz 0 .08 + 0 .002 (0 .08 + 0 + 0 .0085) + 0 .002 + 0 + 1 .5
40 Hz to 20 kHz 0 .08 + 0 .002 (0 .08 + 0 + 0 .0038) + 0 .002 + 0 + 1 .5
20 to 50 kHz 0 .08 + 0 .002 (0 .08 + 0 + 0 .0069) + 0 .002 + 0 + 2
50 to 100 kHz 0 .08 + 0 .002 (0 .08+0+0 .016)+0 .002+0+ 2 .5
100to300kHz 0 .3+0 .01 (0 .3 +0+0 .025)+0 .01 +0+4
300to500kHz 1+0 .01 (1+0+0 .038)+0 .01+0+8
500 kHz to 1 MHz 1 + 0 .01 (1+0+0 .06)+0 .01+0+0
1 to2MHz 1 .5+0 .01 (1 .5 +0.1 +0 .0038)+0 .01 +3 + 1 .5
1 V 20 to 40 Hz 0 .08 + 0 .002 (0 .08+0+0 .0066)+0 .002+0+0
40 Hz to 20 kHz 0 .08 + 0 .002 (0 .08+0+0 .0024)+0 .002+0+0
20 to 50 kHz 0 .08 + 0 .002 (0
.08+0+0
.0046)+0 .002+0+0
50 to 100 kHz 0 .08 + 0 .002 (0 .08+0+0 .071)+0 .002+0+0
100 to 300 kHz 0 .3 + 0 .01 (0 .3+0+0 .016)+0 .01 +0+0
300to500kHz 1+0 .01 (1+0+0 .026)+0 .01+0+0
500 kHz to 1 MHz 1 + 0
.01
(1+0+0
.06)+0 .01+0+0
1to2MHz 1 .5+0
.01
(1 .5 +0.1 +0 .0024)+0
.01 +3 +0
10V 20 to 40 Hz 0 .08 + 0 .002 (0 .08+0+0 .0067)+0 .002+0+0
40 Hz to 20 kHz
0
.08 + 0 .002 (0 .08+0+0 .0027)+0
.002+0+0
20 to 50 kHz 0 .08 + 0 .002 (0 .08+0+0 .0048)+0 .002+0+0
50 to 100 kHz
0 .08 + 0 .002 (0 .08+0+0 .081)+0 .002+0+0
100 to 300 kHz 0 .3+0 .01 (0 .3 +0+0 .019)+0 .01 +0+0
300 to 500 kHz 1 + 0 .01 (1+0+0 .04)+0 .01+0+0
500 kHz to 1 MHz 1 + 0 .01 (1+0+0 .06)+0 .01+0+0
*2
1 to2MHz 1 .5+0 .01 (1 .5+0 .1 +0.0027)+0 .01+3+0
See footnote at end of Table.
AC Voltage
(Random Sampled Mode)
AC BAND _<2 MHz
Implicitly calibrated
during Synchronous
Sub-sampled Mode
Calibration
9

T .O . 33K8-4-551-1

Table 1 . (Cons)
Test Instrument (TI)

Performance
Characteristics

Specifications
Test
Method
AC Voltage

Range : 0 to 1000 VAC

Implicitly calibrated
(Random Sampled Mode) (Cont .)

during Synchronous
AC BAND 52 MHz

Accuracy :

Sub-sampled Mode
Relative : ±(% of rdg + % of mg)

Calibration
Absolute:
±[Sqrt(TI % of rdg^2 + STD 1 % of rdg^2 +
STD2 % of rdg A 2) + TI % of mg +
STD1 µV + STD2 µV]
100 V

20 to 40 Hz

0 .12 + 0 .002
40 Hz to 20 kHz

0 .12 + 0
.002
20 to 50 kHz

0
.12 + 0
.002
50 to 100 kHz

0 .12 + 0 .002
100 to 300 kHz

0 .4 + 0 .01
300 to 500 kHz

1 .5 + 0 .01
500 kHz to 1 MHz

1 .5 + 0 .01
1000 V * 3 20 to 40 Hz

0 .3 + 0 .01
(5700 V)

40 Hz to 20 kHz

0 .3 + 0 .01
(>700 V)

40 Hz to 20 kHz

0 .3 + 0 .01
20 to 50 kHz

0 .3 + 0 .01
50 to 100 kHz

0 .3+0 .01
(0 .12+0+0 .0068)+0 .002+0+0
(0 .12+0+0 .0031)+0 .002+0+0
(0
.12+0+0 .0069)+0 .002+0+0
(0 .12+0+0 .0098)+0 .002+0+0
(0 .4+0+0 .021)+0 .01 +0+0
(1 .5+0+0 .05)+0 .01+0+0
(1 .5+0+0 .06)+0
.01+0+0
*
2
(0 .3+0+0 .0099)+0 .01+0+0 * 2
(0 .3+0+0 .0041)+0 .01 +0+0
(0 .3+0+0 .0038)+0 .01+0+0
(0 .3+0+0 .013)+0 .01+0+0
* 2
(0 .3+0+0 .05)+0
.01+0+0
*
2
AC BAND >2 MHz

Accuracy:
Relative : ±(% of rdg + % of mg)
Absolute:
±[Sgrt(TI % of rdg^2 + STD 1 % of rdg^2 +
STD2 % of rdg^2) + TI % of mg +
STD1 .tV + STD2 .tV]
Range

Frequency

Relative

Absolute
10 mV

20 Hz to 20 kHz

0 .1 + 0 .05
20 to 50 kHz

0 .1 + 0 .05
50 to 100 kHz

0 .1 +0 .05
100to300kHz

1 .2+0 .05
300 to 500 kHz

1 .2 + 0 .05
500 kHz to 1 MHz

1 .2 + 0 .05
l to2MHz

7+0 .07
2to4MHz

7+0 .07
4 to 8 MHz

20 + 0 .08
100 mV

20 Hz to 20 kHz

0 .1 + 0 .05
20 to 50 kHz

0 .1 + 0 .05
50 to 100 kHz

0 .1 + 0 .05
100to300kHz

2+0 .05
300 to 500 kHz

2 + 0 .05
500 kHz to 1 MHz 2+0 .05
1 to 2 MHz

4 + 0
.07
2 to 4 MHz

4 + 0
.07
4to8MHz

4+0 .08
8to 10 MHz

15+0 .1
See footnotes at end of Table .
(0 .1 +0+0 .011)+0 .05 +0+ 1 .3
(0
.1 + 0+0
.021)+ 0
.05 +0+ 2
(0 .1 +0+0 .031)+0 .05 +0+2 .5
(1 .2+0+0 .081)+0 .05+0+4
(1
.2+0+0 .089)+0 .05+0+8
(1
.2+0+0 .17)+0 .05+0+8
(7+0 .1 +0 .011)+0 .07+3+ 1
.3
(7+0 .2+0 .011)+0 .07+3+ 1
.3
(20+0 .2 +0 .011)+0 .08+3 + 1
.3
(0 .1 +0+0 .0038)+0 .05 +0+ 1 .5
(0 .1 +0+0 .0069)+0 .05+0+2
(0 .1 +0+0 .016)+0 .05+0+2 .5
(2+0+0 .025)+0 .05+0+4
(2+0+0 .038)+0 .05+0+8
(2+0+0 .06)+0 .05+0+0
(4+0 .1 +0 .0038)+0 .07+3 + 1 .5
(4 + 0 .2 + 0 .0038) + 0 .07 + 3 + 1 .5
(4+0.2+0 .0038)+0 .08 +3 + 1 .5
(15+0 .2+0 .0038)+0 .1 +3+ 1 .5
10

T .O . 33K8-4-551-1
Table 1 . (Cons)
Test Instrument (TI)

Performance
Characteristics

Specifications
Test
Method
AC Voltage

Range : 0 to 1000 VAC

Implicitly calibrated
(Random Sampled Mode) (Cont .)

during Synchronous
AC BAND >2 MHz

Accuracy :

Sub-sampled Mode
Relative
: ±(% of rdg + % of mg)

Calibration
Absolute:
±[Sgrt(TI % of rdg^2 + STD 1 % of rdg^2 +
STD2 % of rdg^2) + TI % of mg +
STD1 + STD2 µV]
1
V

20 Hz to 20 kHz

0 .1 + 0 .05
20 to 50 kHz

0 .1 + 0 .05
50 to 100 kHz

0 .1 + 0 .05
100to300kHz

2+0 .05
300 to 500 kHz

2 + 0 .05
500 kHz to 1
MHz
2 + 0 .05
1 to 2 MHz

4 + 0
.07
2to4MHz

4+0 .07
4to8MHz

4+0 .08
8tol0MHz

15+0 .1
10 V

20 Hz to 20 kHz

0 .1 + 0 .05
20 to 50 kHz

0 .1 + 0 .05
50 to 100 kHz

0 .1 + 0 .05
100to300kHz

2+0 .05
300 to 500 kHz

2 + 0 .05
500 kHz to 1 MHz 2 + 0 .05
1 to 2 MHz

4 + 0 .07
2to4MHz

4+0 .07
4 to 8 MHz

4 + 0 .08
8to 10 MHz

15+0 .1
100
V

20 to 40 Hz

0 .12 + 0.002
40 Hz to 20 kHz

0 .12 + 0.002
20to50kHz

0 .12+0
.002
50 to 100 kHz

0 .12 + 0 .002
1000 V * 3

20 to 40 Hz

0 .3 + 0 .01
(<_220 V)

40 Hz to 20 kHz

0
.3 + 0 .01
(< _700 V)

40
Hz
to 20 kHz

0 .3 + 0 .01
(>700 V)

40 Hz to 20 kHz

0 .3 + 0 .01
20 to50kHz

0 .3 + 0 .01
50 to 100 kHz

0 .3+0 .01
Frequency

Range : 0 to 10 MHz, VAC;
0 to 100 kHz, AAC
(0 .1 +0+0
.0024)+0 .05+0+0
(0 .1 +0+0 .0046)+0 .05+0+0
(0 .1 +0+0 .0071)+0 .05+0+0
(2+0+0 .016)+0 .05+0+0
(2+0+0 .026)+0 .05+0+0
(2+0+0
.06)+0 .05+0+0
(4+
0
.1 +0.0024)+0
.07+3+0
(4+0 .2+0 .0024)+0 .07+3+0
(4+0.2+0 .0024)+0 .08+3+0
(15 +0 .2+0 .0024)+0 .1
+3 +0
(0 .1
+0+0
.0027)+0 .05 +0+0
(0 .1 +0+0 .0048)+0 .05 +0+0
(0 .1 +0+0 .0081)+0 .05 +0+0
(2+0+0 .019)+0 .05+0+0
(2+0+0 .04)+0 .05+0+0
(2+0+0 .06)+0 .05+0+0
(4+0 .1 +0 .0027)+0 .07 +3 +0
(4+0 .2+0 .0027)+0 .07+3+0
(4+0 .2+0 .0027)+0 .08+3+0
(15 +0 .2 +0 .0027)+0 .1
+3 +0
(0 .12+0+0 .0068)+0 .002+0+0
(0 .12+0+0 .0031)+0 .002+0+0
(0 .12 + 0 + 0 .0069) + 0 .002 + 0 + 0
(0 .12+0+0 .0098)+0 .002+0+0
(0 .3+0+0 .0099)+0 .01+0+0
(0 .3+0+0 .0031)+0 .01 +0+0
(0 .3+0+0 .0041)+0 .01
+0+0
(0 .3+0+0 .0038)+0 .01+0+0
(0 .3+0+0 .013)+0 .01+0+0
* 2
(0 .3+0+0 .05)+0
.01+0+0
*
2
Compared to a
Synthesized Signal
Generator
*2
*2
*2
*2
Accuracy : 1 to 40 Hz, ±0 .05% of rdg;
40 Hz to 10 MHz, ±0 .01% of rdg
See footnotes at end of Table .
11

T .O . 33 K8-4-551-1

Table 1 . (Cont .)
Test Instrument (TI)
Characteristics
Performance

Test
Specifications

Method
AC Current

Range : 0 to 1 AAC
Accuracy:
Relative: ±(% of rdg + % of mg)
Absolute : ±[Sgrt(TI % of rdg^2 +
STD 1 % of rdg^2 + STD2 % of rdg^2 +
STD3 % of rdg A 2) + TI % of rng]
Implicitly calibrated
during DC Current and
AC Voltage Calibration
Range

Frequency
100 µA 10 to 20 Hz
20 to 40 Hz
40 to 45 Hz
45 to 100 Hz
100 Hz to 1 kHz
1 mAto

10to20Hz
100 mA

20 to 40 Hz
40 to 45 Hz
45 to 100 Hz
100 Hz to 5 kHz
5 to 20 kHz *
20 to 50 kHz *
1
50 to 100 kHz *
1 A

10 to 20 Hz
20 to 40 Hz
40 to 45 Hz
45 to 100 Hz
100 Hz to 5 kHz
5to20kHz * I
20 to 50 kHz *
Relative

Absolute
0.4 + 0 .03

(0 .4 + 0 .02 + 0 .0005277 + 0 .0005) + 0 .03
0 .15 + 0 .03

(0 .15 + 0 .0066 + 0 .0005277 + 0 .0005) + 0 .03
0 .15 + 0 .03

(0 .15 + 0 .0024 + 0.0005277 + 0 .0005) + 0 .03
0 .06 + 0 .03

(0 .06 + 0 .0024 + 0.0005277 + 0 .0005) + 0 .03
0 .06 + 0 .03

(0 .06 + 0 .0024 + 0 .0005277 + 0 .0005) + 0 .03
0 .4 + 0 .03

(0 .4 + 0 .02 + 0 .0005277 + 0 .0005) + 0 .03
0 .15 + 0 .03

(0 .15 + 0 .0066 + 0 .0005277 + 0 .0005) + 0 .03
0 .15 + 0 .03

(0
.15 + 0 .0024 + 0 .0005277 + 0 .0005) + 0 .03
0 .06 + 0 .03

(0 .06 + 0 .0024 + 0 .0005277 + 0 .0005) + 0 .03
0 .06 + 0 .03

(0 .06 + 0 .0024 + 0 .0005277 + 0 .0005) + 0 .03
0 .06 + 0 .02

(0 .06 + 0 .0024 + 0 .0005277 + 0 .0005) + 0 .02
0 .4 + 0 .04

(0.4 + 0 .0046 + 0 .0005277 + 0 .0005) + 0 .04
0 .55 + 0 .15

(0 .55 + 0
.0071 + 0 .0005277 + 0 .0005) + 0 .15
0 .4 + 0 .02

(0.4 + 0 .02 + 0
.0005277 + 0 .0006) + 0 .02
0 .16 + 0 .02

(0 .16 + 0 .0066 + 0 .0005277 + 0 .0006) + 0
.02
0 .16 + 0 .02

(0 .16 + 0 .0024 + 0 .0005277 + 0 .0006) + 0 .02
0 .08 + 0 .02

(0 .08 + 0 .0024 + 0 .0005277 + 0 .0006) + 0 .02
0 .1 + 0 .02

(0.1 + 0 .0024 + 0.0005277 + 0 .0006) + 0 .02
0 .3 + 0 .02

(0 .3 + 0 .0024 + 0 .0005277 + 0 .0006) + 0 .02
1 + 0 .04

(1 + 0 .0046 + 0 .0005277 + 0 .0006) + 0 .04
* 1
*2
* 3
Typical accuracies, will not be calibrated.
Calibration of the complete Voltage and/or Frequency ranges at these points are not possible due to the
capability limitations of the Calibration Standards . The TI does not require a limited certification for these
Standards limitations.
Option HO1 1000 V rms max (All other units 700 V rms max).
12

T .O . 33K8-4-551-1
2 EQUIPMENT REQUIREMENTS:
Noun
Minimum Use
Specifications Calibration Equipment
Sub
Item
2 .1 DC REFERENCE Output : 10 VDC Fluke
STANDARD 734A/AF
2 .2 DC REFERENCE
Accuracy : ±1 .5 ppm of output * I . * 2
FlukeRatio : 10 :1, ±0 .2 ppm ; *I
DIVIDER
* I
100 :1, ±0 .5 ppm 752A
2 .3 SHORTING BARS Range : N/A ESI
(2 EA) SB 103
Accuracy : N/A
Range : 0 to I VDC Hewlett-Packard H-P 2 .4

DIGITAL
VOLTMETER 3458A OPT 002 3458A
Accuracy:
±(4 .277 ppm of rdg + 1 ppm of mg) * 3
for 3458A OPT 002;
±(8 .142 ppm of rdg + 1 ppm of mg) * 4
for 3458A
2.5
2 .6
CALIBRATOR
AC MEASUREMENT
STANDARD
Range : 0 to 1000 VDC and VAC,
20 Hz to 10 MHz
; 1 VAC at 3, 7
and 10 MHz ; 0 to 1 ADC
Accuracy : VDC and ADC, N/A;
1 VAC at 3, 7 and 10 MHz,
±(0 .2% of output + 3 µV)
Range : 0 to 1000 VAC
Accuracy : ±(ppm of rdg + µV)
Fluke
5700A
W/5725A
Fluke
5790A
Range
Frequency ±(ppm of rdg + ]AV)
22 mV
20 to 40 Hz ±(190 + 1 .3) (TAR 2 .5 :1)
40 Hz to 20 kHz ±(110 + 1 .3) (TAR 2 :1)
20 to 50 kHz
±(210 + 2) (TAR 3 .3 :1)
50 to 100 kHz ±(310 + 2
.5)
100 to 300 kHz
±(810 + 4)
See footnotes at end of Equipment Requirements .
13

T .O . 33K8-4-551-1
Noun
Minimum Use
S ' ecifications
Calibration
Eiui'ment
Sub
Item
2 .6 AC MEASUREMENT

Range : 0 to 1000 VAC
STANDARD (Cont .)
Accuracy : ±(ppm of rdg +µV)
Fluke
5790A
Range

Frequency
220mV 20to40Hz
40 Hz to 20 kHz
20 to 50 kHz
50 to 100 kHz
100 to 300 kHz
300 to 500 kHz
500 kHz to 1 MHz
2 .2 V

20 to 40 Hz
40 Hz to 20 kHz
20 to 50 kHz
50 to 100 kHz
100 to 300 kHz
300 to 500 kHz
500 kHz to 1 MHz
22 V

20 to 40 Hz
40 Hz to 20 kHz
20 to 50 kHz
50 to 100kHz
100 to 300 kHz
300 to 500 kHz
500 kHz to 1 MHz
220 V

20 to 40 Hz
40 Hz to 20 kHz
20 to 50 kHz
50 to 100 kHz
±(ppm of rdg + µV)
±(85 + 1 .5) (TAR 1
.7 :1)
± (38 + 1 .5) (TAR 2 .2 :1)
±(69 + 2) (TAR 3 .9 :1)
±
(160+2
.5)
±(250 + 4)
±(380 + 8)
± 600
±66 (TAR 2 .1 :1)
± 24 (TAR 3 .9 :1)
± 46
±71
±160
± 260
±600
± 67 (TAR 2 :1)
±27 (TAR 3
.5
:1)
± 48
±81
±190
± 69
± 98
14

T .O . 33K8-4-551-1
Minimum Use
 Noun 
Specifications
Calibration

Equipment
Sub
Item
2 .6 AC MEASUREMENT

Range
: 0 to 1000 VAC

Fluke
STANDARD (Cont .)

5790A
Accuracy : ±(ppm of rdg + µV)

Range

Frequency

700 V

20 to 40 Hz
40 Hz to 20 kHz
20 to 50 kHz
50 to 100 kHz
1000V 20to50kHz
Range : N/A
Accuracy : N/A
Range : 1 S2 to 10 MS - 2
RESISTORS
Accuracy : AFPSL Certified
±2 .15 ppm, 1 S2 through 1 kS2;
±2 .1 ppm, 10 kS2;
±2 .4 ppm, 100 kS2;
±
6 ppm, 1 MS2, (TAR 3 .0 :1);
± 12 ppm, 10 M52
2
.9 DMM SWITCH

Range : N/A
Accuracy : N/A
2 .10 RESISTANCE

Range : 10 S2 to 1 S2/step

ESI
STANDARD

SR 1060
Accuracy : Charted value *5
10 S2/step,
±6
ppm;
100 S2/step,
±5
ppm,
(TAR 3 .6 :1 @ 1 kS2
w/3458A OPT 002),
*3
(TAR 2 .7 :1 @ 1 k)2 w/3458A) ; * 4
1 1d2/step,
±5
ppm,
(TAR 3 .6 :1 @ 100 S2
w/3458A OPT 002),
* 3
(TAR 2 .7:1 @ 100 S2 w/3458A),
*4
(TAR 3 .0 :1 @ 10 Id-2 w/3458A) * 4
2 .11 RESISTANCE

Range : 10 MCI/step
STANDARD
Accuracy : 100 MS - 2, -1-50 ppm
See footnotes at end of Equipment Requirements.
2 .7 RESISTANCE
MEASUREMENT
SYSTEM
2 .8 STANDARD
±(ppm of rdg + uV)
± 99
± 41
±
130
±500
± 130
Guildline
6625AF
ESI
SR1050
1
Measurements
International
4310AF
Guildline
66252
15

T .O . 33K8-4-551-1
Noun
Minimum Use
Specifications Calibration

Sub
Equipment

Item
2 .12 NULL DETECTOR
2 .13 DC VOLTAGE
DIVIDER
2 .14 SYNTHESIZED
SIGNAL GENERATOR
2 .15 PARALLEL
COMPENSATION
NETWORK
2 .16 TERMINATION
I
2 .17 NANO VOLT/
MICRO OHM METER
Range : 0 to 1000 VDC
Accuracy : N/A
Range : 0 to .8000000
Terminal Linearity : ±0 .2 ppm *2
Range : 2 Hz to 10 MHz
Accuracy : ±0 .0025% of setting
Range : N/A
Accuracy : N/A
Range : 50 Q
Accuracy : NIA
Range : 0 VDC ; 0 Cl
Accuracy : N/A VDC ;
±2
ppm S2
Fluke
845AB
Fluke
720A
Hewlett-Packard
3325B
ESI
PC 101
As Available
Agilent
34420A
*' The following TAR is calculated using the RSS accuracy of the DC Reference Standard and DC Reference
Divider . For high stability TIs, 1 (TAR 3 .5 :1) and 10 VDC range (TAR 3 :1).
*2
The following TAR is calculated using the RSS accuracy of the DC Reference Standard and DC Voltage
Divider . For high stability TIs, 10 VDC range (TAR 3
:1).
*5 The following TAR is calculated using the RSS accuracy of the Digital Voltmeter and Resistance
Standard . For TI 1 mA and 10 mA DC ranges (TAR 3 .6 :1).
* 4
The following TAR is calculated using the RSS accuracy of the Digital Voltmeter and Resistance
Standard . For Tl 100 µA DC range (TAR 3 :1), 1 mA and 10 mA DC ranges (TAR 2 .7 :1).
* 5 See step 3
.9.
3 PRELIMINARY OPERATIONS:
3
.1 Review and become familiar with the entire procedure before beginning the Calibration Process.
WARNING
Unless otherwise designated, and prior to beginning the Calibration Process,
ensure that all test equipment voltage and/or current outputs are set to zero (0) or
turned off, where applicable . Ensure that all equipment switches are set to the
proper position before making connections or applying power.
3 .2 Use low-thermal, shielded leads with spade-lug connectors whenever possible during the Calibration Process.
16

T
.O
. 33K8-4-551-1
3 .3 If the 66252 DMM Switch is not available, disconnect the Automatic Resistance Bridge (P/O 2 .7) rear panel Rs
and Rx connections (terminals P1, P2, Cl and C2) . Connect the Rs connections (P1, P2, Cl and C2) to the Rx
connections (P 1, P2, Cl and C2), respectively. Ensure connections are restored to original configuration upon
completion of the Calibration Process.
3 .4 Connect all test equipment to appropriate power sources . Set all POWER switches to ON and allow test equipment
warm-up period per manufacturer requirements.
3 .5 Ensure that AC power is applied to the temperature stabilized Standard Resistors . Manufacturers suggested
minimum warm-up time is 24 hours .
NOTE
If at any time power is removed from the Standard Resistors for over 1 minute,
there is a minimum 1 hour warm-up time for the oven to stabilize.
3 .6 Connect the Nano Volt/Micro Ohm Meter to the temperature stabilized Standard Resistors temperature monitor
terminals and turn TEMP DEV switch to ON . Using TEMP DEV dial to obtain a VDC null reading on the Nano
Volt/Micro Ohm Meter, record temperature offset of the TEMP DEV dial before and after calibration . TEMP DEV
dial before and after values should be between -20 m°C to +20 m°C (i .e ., on scale).
3
.7 Connect TI to appropriate power source . Set ON/OFF switch to ON and allow a 4 hour warm-up period.
3
.8 Use only that portion of the Calibration Process that pertains to the TI being calibrated.
3 .9 Calibrate Resistance Standard (2 .10), required to perform the calibration, IAW T .O . 33K8-4-1-1 before use . See
T .O
. 33K8-4-1-1 for clarification of (at time of calibration) . Verify accuracies at time of calibration in
T .O . 33K8-4-1-1 still meet the requirements.
3
.10 Perform the DC Reference Divider Self-Calibration IAW the Commercial Data prior to use.
3 .11 Perform the DC Voltage Divider Self-Calibration IAW the MTO prior to use.
3 .12 Verify all TI inputs (including rear input) are disconnected and execute the TEST function . The TI display must
read SELF TEST PASSED.
3 .13 Ensure the TI is in the FULL MENU mode by pressing:
3 .14 Check the TI Internal Temperature by pressing the TI keys in the following sequence:
Menu
Enter
p in . )
431 e)
v
4iHF11
4310
T ESNer
(record this value).
3 .15 Press the TI keys in the following sequence to obtain CAL? 58:
. The TI display must be within ±5 °C of the value recorded in
step 3
.14.
3 .16 Repeat step 3 .15 for CAL? 59 and CAL? 60 .
NOTE
If TI displays greater than 5 °C difference from the internal temperature
recorded in step 3 .14, CAL 0, CAL 10 and CAL 10 k should be performed
IAW the Manufacturers Calibration Manual.
a 5 C
6HF1,
431me)
V
Change 1 17

T
.O
. 33K8-4-551-1
3 .17 Perform ACAL on the TI before beginning calibration by pressing the TI keys in the following sequence:
until ACAL ALL is displayed, then
Ganma)

3

9

5

8

EntEr
NOTE
(,), 3458 is the Security Code for the TI when shipped from the manufacturer . If
the Security Code has been changed, that Security Code will be entered in its
place . If the TI has been unsecured, the Security Code will not be entered.
Refer to the TI Calibration Manual, Chapter 1, for more information.
3 .18 Set the TI for DCV, 8 digit display and NPLC at 100 by pressing the TI keys in the following sequence:
, use the menu scroll keys or
ocv
6H£1)
Elie)
N 8 Enter
NPLC 1
0
0
Enter
3 .19 Connect a low thermal short (12 to 14 Gauge solid copper wire) across the Tl Input and SI Sense HI and LO
terminals, allow 5 minutes for stabilization.
3 .20 Set the TI to each range listed in the Range column of Table 2.
3 .21 The TI should indicate within the corresponding values listed in the Limits column of Table 2.
Table 2.
 Range (VDC)  Limits (VDC)
100 m 0 ±000 .00106 m
0 ±0 .00000106
10 0 ±00 .0000023
100 0 ±000 .000036
1000 0 ±0000 .00010
3 .22 If the TI DC Voltage zero is >90% of the value listed in the Limits column of Table 2 on any range, enter a
K action in the Maintenance Data Collection System . If the TI DC Voltage zero is <_90% of the value listed in the
Limits column of Table 2 on all ranges, performing the following TI CAL 0 steps is not a K action.
NOTE
The TI zero offset adjustment (CAL 0) should be performed individually for
both front and rear terminals
. Once CAL 0 has started, move away from
the TI very slowly until the TI is done (about 5 minutes) . If drafts exist, it may
be necessary to cover the TI INPUT terminals.
3 .23 Set the TI to execute CAL 0 by pressing the TI keys in the following sequence:
(s-l q
(Eke)
C
0 (fie)
f
345 8
18