HP LaserJet 9000 User manual

Native Language Support:
User's Guide
HP 9000
Computers

Native Language Support:
User's Guide
HP 9000 Computers
Fli..- HEWLETT
a:~ PACKARD
HP Part No. 82355-90036
Printed in
USA August 1992
Third Edition
E0892

Legal Notices
The information contained in this document is subject to change without
notice.
Hewlett-Packard makes no warranty of any kind with regard to this manual,
including, but
not limited to, the implied warranties of merchantability or
fitness for a particular purpose. Hewlett-Packard shall not be liable for errors
contained herein or for direct, indirect, special, incidental or consequential
damages
in connection with the furnishing or use of this material.
Copyright © 1983-92 Hewlett-Packard Company
Reproduction, adaptation, or translation without prior written permission is
prohibited, except as allowed under
the copyright laws.
Restricted Rights Legend.. Use, duplication, or disclosure by the U.S.
Government is subject to restrictions as set forth in sub-paragraph
(c)(l)(ii) of
the Rights in Technical Data and Computer Software clause in
DFARS 252.227-7013.
Hewlett-Packard Company
3000 Hanover Street
Palo Alto, CA 94304 U.S.A.
Rights for non-DOD U.S. Government Departments and Agencies are as set
forth in FAR 52.227-19(c)(1,2).
Use of this manual and flexible disk(s) or tape cartridge(s) supplied for this
pack is restricted
to this product only. Additional copies of the programs may
be made for security and back-up purposes only. Resale of the programs in
their present form or with alterations, is expressly prohibited.
All rights reserved.
Copyright © 1980, 1984, 1986 UNIX System Laboratories, Inc.
UNIX® is a registered
trademark of UNIX System Laboratories, Inc. in the
USA and other countries.

Printing History
New editions of this manual will incorporate all material updated since the
previous edition.
The manual printing date and part number indicate its current edition. The
printing date changes when a new edition is printed. (Minor corrections and
updates which are incorporated at reprint do not cause the date to change.)
The manual part number changes when extensive technical changes are
incorporated.
May 1990.
First Edition
January 1991. Second Edition
• This edition updates the previous document called Native Language Support
Concepts and Tutorials. This edition includes corrections and additions for
the HP-UX 8.0 release. Major changes and additions include: An overview
of Native Language Support; improved organization to improve access to
information in a more logical sequence; addition of information on supported
codesets; expanded information on localizing international software; added
illustrations
to simplify complex topics; and added depth and coverage on
may topics.
August 1992. Third Edition
• This edition documents the addition to NLS of World Portability Interface
(WPI), and its wide-character encoding. This is a standardized approach
(XPG4) and is the preferred approach.
iii

Contents
1. Overview
UNIX Background .... .
The NLS Concept .... .
The NLS Conceptual Model
Using this Manual ....
Typographical Conventions in This Manual
Related HP-UX
Manuals. . . . . . . . . .
2. Introduction to NLS
Overview of Software Internationalization . . . . . . .
Components
of Internationalizing and Localizing with NLS .
Internationalization . . . . .
Localization . . . . . . . . . . . .
Aspects
of NLS Support . . . .
Character and Text Handling .
Data Integrity . . . . . .
Character Sets and Encoding
Character Type and Conversion
Local Customs and Conventions
Numeric
Formatting. . . . .
Monetary Formatting . . . . .
Display of Time ...... .
Display of Days, Weeks, Months
Collation. . . . . .
Messages
........... .
Language
Variations. . . . . . .
Comparing Strings
and Comparing Characters
Regular Expressions . . . . . . . . . . . .
1-1
1-1
1-2
1-4
1-7
1-8
2-1
2-3
2-3
2-3 .
2-4
2-4
2-4
2-4
2-6
2-6
2-6
2-7
2-7
2-8
2-8
2-9
2-10
2-10
2-12
Contents-1

3. Using International Software
NLS Environmental Variables 3-1
Default Values . . . . . 3-3
Setting your Environment . . . . .. 3-4
Setting Your Terminal . . . . . . . . . 3-5
Reference Information for Internationalized Commands 3-5
Internationalized Messages . . . . 3-6
Using Internationalized Commands . . . . . . . . . 3-6
4. Administering International Software
Finding NLS Files .....
The Default User Environment
Installing Message Catalogs
Installing Optional Locales .
Peripheral Configuration . . .
5. Localizing International Software
Localizing the User Environment
Localizing Message Catalogs
The C Locale Messages
Translating Messages
Translation Problems . . . . . .
Installing Localized Messages
Creating a Locale . . . . . .
Script Requirements for localedef
localedef Syntax ...... .
LC_ALL Subcategories
LC_COLLATE Subcategories
Single-Character Element
Multi-character Element .
Ellipsis Symbol . . . . .
UNDEFINED Symbol . . . . . . .
LC_CTYPE Subcategories .
LC_MESSAGES Subcategories
LC_MONETARY Subcategories
LC_NUMERIC Subcategories
LC_TIME Subcategories . . . .
Installing a Language Definition Table .
Contents-2
4-2
4-3
4-3
4-4
4-4
5-2
5-2
5-3
5-3
5-4
5-4
5-5
5-7
5-8
5-10
5-11
5-12
5-12
5-13
5-13
5-15
5-20
5-21
5-24
5-25
5-27

6. Developing International Software
General Programming Issues . . .
Aspects of International
Program Design .
Other Aspects . . . .
Initializing
NLS. . . . . . . .
Setting Program Locale . .
Retrieving Locale Information
Accessing Language Tables . .
Programming with the Worldwide Portability Interface
WPI Interfaces . . . . . . . .
Character and String Processing . . . . .
Character Handling . . . . . . . . . .
Upshifting
and Downshifting Characters .
Identifying Character Traits
Numeric
Formatting. . . . . . . . . .
Date and Time
........... .
Input and Output in Internationalized Programs
Printing
Formatted Output
Reading Formatting Input . . . . . .
Using Flexible Formatting . . . . . .
Example program using wide characters.
Conversion of Existing Programs
Non- WPI Interfaces . . . . . . . .
Character and String Processing
Character Handling . . . . . .
Upshifting
and Downshifting Characters
Identifying Character Traits
Numeric Formatting .
Date and Time . . .
Monetary Formatting
String Comparisons .
Guidelines for Creating Internationalized Programs
6-1
6-2
6-4
6-6
6-6
6-8
6-8
6-12
6-12
6-13
6-13
6-14
6-15
6-16
6-16
6-17
6-17
6-17
6-18
6-20
6-21
6-22
6-22
6-22
6-22
6-24
6-25
6-26
6-26
6-28
6-29
Contents-3

7.
The Message Catalog System
Creating and Using a Message Catalog System
7-2
Programming for Messages .
7-3
Opening a Message Catalog with catopen
7-3
Recommended Initialization 7-4
Search Path and Naming Conventions
7-6
Retrieving Messages . 7-7
Closing a Message Catalog
7-8
Default Messages
7-8
Compiling and Linking
7-9
Creating aNew Message Catalog
7-9
The Message Text Source File
7-9
Compiling a Message Catalog .
7-11
An Example of Programming with Message Catalogs
7-11
Special Considerations for Messaging
7-12
Libraries with Messages
7-15
Conversion of Existing Programs for NLS Messaging 7-16
Step 1. Finding Strings in a Program
7-17
Step 2. Removing Non-Messages from the Strings.
7-18
Step 3. Inserting catgets Calls 7-18
Step 4. Editing the Modified Source Program 7-20
Step 5. Editing
the Message Text Source File.
7-20
Step 6. Creating a Message Catalog . 7-20
Testing a Message Catalog
7-21
Installing a Message Catalog 7-22
Source Code Management 7-22
Keeping nl_prog.c Files 7-22
Multi-file Programs 7-22
Adding a Message
to a Messaging Program . 7-23
Using "make" Files 7-24
Guidelines for Using Messaging 7-25
Contents-4

8. Advanced NLS Topics
Codeset Conversion . . . . . . . . . . . . . .
The Character Conversion Command-iconv(l) .
Conversion
Routines-iconv(3C)
Processing Right-to-Left Languages .
Locale
Information
Initialization . . . . . . .
Special Locales . . . . .
Special Message Catalogs
Default Message Catalogs
Programs That Call exec .
Messaging:
printf/scanf Data Formatting
A. Special Topics for HP's 16-bit Interfaces
Aspects of Program Design ..
Code Sets ............ .
Data Integrity . . . . . . . . . . .
Programming with Multi-byte Characters
Version #1 (Single- Byte Codesets)
Version
#2 (Code Set Independent) . .
Conversion of Existing
Programs . . .
Guidelines for Processing Multi-byte
Data
B. Example of Internationalized Software
Example Program Using NLS Routines - rtlcat
Include Files: . . . . . .
External Declarations: .
Forward References:
..
General Constants: . .
Limits:
..... .
Right-to-Left Terminal
Constants: .
Error Message Numbers:
Error Message Strings: .
Types:
..... .
Global Variables:
Main
Program: ..
Makefile Example ..
8-1
8-2
8-2
8-6 .
8-8
8-10
8-10
8-10
8-11
8-11
8-12
A-2
A-3
A-5
A-5
A-6
A-8
A-9
A-I0
B-1
B-2
B-2
B-3
B-3
B-3
B-3
B-3
B-4
B-4
B-4
B-4
B-15
Contents-5

C. NLS References
D. Previous Usage
Obsolete
Routines.
Proprietary Commands and Interfaces .
E. Languages and Codesets
Displaying Character Sets on Your Terminal
F. LC_COLLATE Example for Spanish
Glossary
Index
Contents-6
D-2
D-5
E-5

Figures
1-1. NLS Conceptual Model . . . . .
6-1. Retrieving
the User's Environment
6-2. The
Program Environment . . . .
7-1. The Message Catalog System . . .
7-2. Naming and Locating Message Catalogs
7-3. Using gencat 0 to Generate Message Catalog
7-4. Converting a Non-Internationalized Program . .
7-5. Using
findstr to Locate String Constants .
7-6. Using
the insertmsg Command
E-1. Roman8 Coded Character Set ..... .
1-3
6-5
6-8
7-5
7-6
7-9
7-16
7-17
7-19
E-4
Contents-7

Tables
1-1. Finding Information in the NLS User's Guide ..
2-1. Sorting Example: C vs. German
2-2. Sorting Example: C vs. Spanish
2-3. Sorting Example: C vs German .
3-1.
NLS Environment Variables
4-1.
NLS Directories and Files . . .
5-1. Primary Subdivisions
of a Language Table
5-2. Header Keywords . . . .
...
5-3. LC_ALL Subcategories
5-4. LC_COLLATE Subcategories
5-5.
LC_CTYPE Categories . . .
5-6. LC_MESSAGES Subcategories .
5-7. LC_MONETARY Subcategories
5-8. LC_NUMERIC Keywords . . .
5-9. LC_
TIME Subcategories . . . .
6-1. A Comparison of a "Standard" Application with its
NLS
Version . . . . ..
6-2. Categories for setlocale ..... .
6-3. Locale
parameters. . . . . . . . .
6-4. Parameters Defined for nl_Ianginfo
6-5.
WPI Routines for Character and String Processing
6-6. Character and String Processing Routines . . . .
6- 7. Character Identification Routines
6-8. Numeric Formatting Routines
.....
6-9. Date and Time Routines . . . . . . . .
6-10. Multi-byte Character
and String Conversions .
6-11. Character and String Processing Routines . . . . .
6-12. Character Identification Routines . . . .
6-13. Numeric Formatting Routines
6-14. Date and Time Routines . . . .
Contents-8
1-5
2-10
2-11
2-11
3-2
4-2
5-7
5-8
5-10
5-11
5-15
5-20
5-21
5-24
5-25
6-3
6-7
6-7
6-9
6-13
6-14
6-15
6-16
6-16
6-19
6-23
6-24
6-25
6-26

7-1. Summary of NLSPATH Replacement Specifiers .
8-1. Conversion
Routines. . . . .
A-I. Multi-byte Macros .....
C-1. HP-UX Reference NLS Entries
C-2.
NLS Library Routines . . . .
C-3. NLS Commands
..... .
D-l. Obsolete Routines and Recommended Replacements
D-2. Proprietary Commands
D-3.
Proprietary Library Calls
E-1. Language Codesets . . .
7-7
8-5
A-6
C-2
C-6
C-15
D-2
D-5
D-6
E-2
Contents-9

1
Overview
UNIX Background
The UNIX operating system was originally designed to be used with
terminals
that generated seven bit ASCII characters. The primary users were
English-speaking Americans, so internationalizing the operating system was
not even considered. A number of years have passed since the creation of the
UNIX operating system; it grew to be used industry-wide and world-wide as an
application programming environment.
There became a need to handle characters from coded character sets other than
the standard ASCII codeset, some of which contain thousands of characters.
There became a need to provide interfaces that allow users to interact with
applications
in their own language, rather than forcing them to use English
error messages and instructions. Native Language Support (NLS) was created
to do this in a manner which preserves the traditional UNIX operating system,
but is language independent.
The NLS Concept
NLS enhances the traditional UNIX operating system in a way that benefits
both the users and the application developers. It enables the design of flexible
applications that can support a variety of language environments. NLS consists
of a number of tools
that help preserve the integrity of data across different
codesets, provide interfaces
in the local language, and represent local customs
in software. Much existing software is designed for use only in the country
or locale for which
it was originally written. This means the programmer
must redesign and recompile the software for every local language and local
environment.
Overview 1-1
1

1
However, the features of Hewlett-Packard's NLS enable the application designer
or programmer to create applications for an end-user's needs regardless of
the local language. NLS addresses an application's internal functions (such
as sorting and character handling) and the user interface (which includes
displayed messages, user
inputs, and currency formats). An internationalized
program is really many programs in one, in that it uses and is supported by
tools that separate language-dependent features from the main program logic.
The NLS Conceptual Model
The NLS concept is a simple one. NLS allows one discrete program to
"speak" in a variety of languages. NLS consists of an extensive set of tools
and routines. All of its components support an "extended multi-language
application" consisting of three parts:
• A Language-Independent Program- The program displays messages in the
user's native language by using language-dependent features that are not a
fixed
part of the program. The program does this in either of two ways:
o
it processes the language-dependent data in a codeset-sensitive way; we
could call this the traditional NLS approach. Or,
o the program uses the Worldwide Portability Interface (WPI) to process
the language-dependent data. WPI's wide character encoding enables the
program to deal with data in a way that is codeset non-sensitive.
• Message Catalogs -There are no hard-coded messages in the source code.
Instead messages to the user (such as prompts and error messages) are stored
in external message catalogs with a version for each supported language.
For instance,
instead of the source code containing the statement printf
("display this string"), the program calls a routine that opens a specific
message catalog containing
the language-specific equivalent.
• Language Tables- This component of NLS contains language-specific
information
and conventions unique to a particular locale (such as collation
sequence definitions
and monetary conventions). Programs consult a
specific language table at run time according to the setting of the user's
environmental variables.
1-2 Overview

Message Catalogs
La nguage -I ndependent
Program
#include ~nUypes.h>
setlocole(LC_ALL, "")
cotd=catopen("name", 0);
Figure 1·1. NLS Conceptual Model
1
Language Tables
Overview 1·3

1
Using this Manual
This manual is for people who are using, writing, or localizing programs for
international use and who will need
to make use of the various elements of
Native Language Support (NLS).
Specific sections of this manual were written
at a technical level appropriate
to general users, system administrators, NLS coordinators, or applications
programmers.
• General Users should read Chapters 2 and 3.
• System Administrators should read Chapter 4 and 5.
• Applications Programmers should read Chapter 5, 6, 7 and 8.
For further details, refer
to the Appendices. For example, Appendix B provides
an example of internationalized programming. All of the NLS commands and
subroutines discussed in this manual are referenced in Appendix C and in the
Index.
1-4 Overview

1
Table 1-1. Finding Information in the NLS User's Guide
To find this information. . . Please see ...
Overview: This chapter provides a conceptual overview of NLS and Chapter 1
the internationalized application. This chapter also explains how the
manual is structured. This chapter explains the typographical
conventions used in this
manual and identifies other related manuals.
futroduction to NLS(for the general user): This chapter presents a Chapter 2
basic description
of the scope of Native Language Support,
localization, and internationalization, including general aspects of
character set handling, local conventions and messages.
Using
futernational Software(for the general user): This chapter Chapter 3
shows how
to run a localized application including terminal
configuration, environment setup, and selection of the language.
Administering
futernational Software (for the system Chapter 4
administrator): This chapter identifies the HP- UX directories and
files, and explains how to set up the user environment, to install
message catalogs
and optional locales, and to configure terminals
and peripherals.
Localizing
futernational Software (for the system administrator and Chapter 5
the localizer): This chapter explains the details of localization for
special user requirements, localizing message catalogs,
and creating
specialized locales.
Developing
futernational Software(for the programmer): This Chapter 6
chapter describes the initialization process, character and string
processing,
and gives a brief introduction to setting up the message
interface.
This chapter focuses on the Worldwide Portability
Interface (WPI) approach to internationalizing software.
The Message Catalog System(for the programmer): This chapter Chapter 7
explains how
to call message routines, create the message text
source file, and generate the message catalog.
Advanced NLS Topics (for
the programmer): This chapter explains Chapter 8
about the NLS character- and string-processing tools, about
processing non-Latin character input/output, and about special
treatment of locales and message catalogs.
Overview 1-5