Upload
-
View
223
Download
0
Embed Size (px)
Citation preview
8/12/2019 FOSS - Localization Primer
1/67
Free/Open Source Software:
Localization
Anousak Souphavanh and
Theppitak Karoonboonyanan
Asia-Pacific Development Information Programmee-Primers on Free/Open Source Software
8/12/2019 FOSS - Localization Primer
2/67
United Nations Development Programme-Asia Pacific Development
Information Programme (UNDP-APDIP) - 2005
Web: www.apdip.net
Email: [email protected]
This publication is released under the Creative Commons Attribution 2.0 license.For full details of the license, please refer to the following:
Creative-commons.org/licenses/by/2.0/legalcode
ELSEVIER
A division of
Reed Elsevier India Private Limited
17A/1, Lajpat Nagar IV,
New Delhi 110 024
Tel: 91-11-26447160
Fax: 91-11-26447156
Website: www.asiaelsevier.com
ISBN: 81-8147-754-5
Academic Press, Butterworth-Heinemann, Digital Press, Focal Press, Morgan
Kaufmann, North Holland and Pergamon are the Science and Technology imprints of
Elsevier.
Printed and bound in India
8/12/2019 FOSS - Localization Primer
3/67
FOREWORD v
ACKNOWLEDGEMENTS vii
INTRODUCTION 1
Computers, English, and Local Users 1
Localization 1
The Importance of Localization 2
What is Free/Open Source Software? 3
What is GNU/Linux? 3
Why Localize FOSS? 3
LOCALIZATION EFFORTS IN THE ASIA-PACIFIC 5
A Survey 5The CJK Initiative 5
Indian Languages 5
Thai 6
Vietnamese 6
Malay 6
Khmer 6
Case Studies 7
Thai Localization 7
Lao Localization 10
Khmer Localization 12Status of Localization Projects 15
RECOMMENDATIONS 17
Implementing Localized FOSS in Asia 17
Skills and Tools Required for Localization Projects 18
Costs of FOSS Localization 20
The Work of Localization 22
Annex A. Localization Key Concepts 24
Annex B. Localization Technical Aspects 30
FURTHER READINGS 46
RESOURCES AND TOOLS 49
GLOSSARY 54
ABOUT THE AUTHORS 58
TABLE OF CONTENTS
8/12/2019 FOSS - Localization Primer
4/67
8/12/2019 FOSS - Localization Primer
5/67
Free software means software that respects the users freedom. It means that users are free to run the
programs as they wish, free to study and change the software (or hire others to do it for them), free to
redistribute copies to others, and free to publish modified versions. As a consequence, users are free to
share, and form communities to exercise effective control over the software they use. Free software may
also be gratis, zero price, but this is not always the case.
Some users refer to this as open source. That term focuses on the technical benefits that result when
software can be reviewed by large numbers of developers and users, the business advantages of using
it, and the business models that support its development and use. The term free software refers to the
social and ethical importance of freedom, as well as to the practical benefits it brings.
The social and practical imperatives for sharing and changing useful works such as software create a
revolution in what it means to publish. The technology of the printing press taught readers to think of
written works as fixed written once, for readers to use passively thereafter. This technology did not
make it easy for readers, who generally did not have presses of their own, to adapt, improve, and share
copies of books, and they became accustomed to these limitations. So when citizens in large numbersbegan to use personal computers, many did not question the legal and business systems that placed
similar limitations on using software. But this time, the limitation was not a natural consequence of the
technology. It was imposed by software developers, who found it profitable to keep users under their
control. The developers forbid users to share the software, and by denying users the source code, prevent
them from changing it.
Today, however, there is an alternative: free software, the product of a community built by a million
willing developers some volunteers, some paid to contribute. Free software allows users to take full
advantage of what their computers can do. It is our door to escape from the limitations of the printing
press, into a world where useful works, such as software, are developed among the users, by the users,
for the users.
Where software is not made artificially scarce by misguided incentive systems that encourage
development of software by locking up its users.
Where the users can collaborate as they see fit in making the software do what they want it to do. Where
the users of software are free to run it, share it, and adapt it together or individually. This is the world of
Free and Open Source Software (FOSS).
Non-free software keeps users divided and helpless. When a nation increases the use of non-free software,
it is not development, it is permanent dependency. Only the use of FOSS permits sustainable development
it is technology that local people are free to learn about, maintain, adapt, and reapply.
How can governments move their countries towards FOSS? In two ways. First, switching to Free Software
in schools will teach children the spirit of community cooperation, while producing graduates that are
skilled in using and maintaining Free Software. Second, mandating migration to Free Software in
government agencies will create demand for these graduates skills, and build a local economy of Free
Software support.
The International Open Source Network (IOSN) is an initiative of UNDPs Asia-Pacific Development
Information Programme, and operates under the principle of Software Freedom for All (SFA). Its work
includes provision of support and assistance, a centre of excellence, and an information clearing-house
for Free and Open Source Software in the Asia-Pacific region.
Through the IOSN/SFA initiative, UNDP provides policy support and advisory services to government
bodies, non-profit organizations, donor agencies and others. It publishes practical tools and materials,
FOREWORD
v
8/12/2019 FOSS - Localization Primer
6/67
including simple how to primers and guidebooks, training materials, and live CDs of the GNU/Linux
operating system for FOSS practitioners and end-users. It also supports FOSS R&D activities in localization
and in other areas, and organizes conferences and training programmes to network stakeholders and
strengthen local capacities. It welcomes both those interested in benefiting from these services and
those who would like to collaborate in extending them.
Im pleased to cooperate with the work of IOSN/SFA, APDIP and UNDP in taking the message of software
freedom to the public and the development sector. Together we can help overcome the digital divide,
and replace dependency with development.
Richard M. Stallman
vi
8/12/2019 FOSS - Localization Primer
7/67
The authors would like to acknowledge their debt of gratitude to the following:
Phet Sayo, the Programme Specialist for Building Capacities and Partnerships at UNDP-APDIP, for getting
us started; Kenneth Wong, the Programme Consultant for the International Open Source Network, UNDP-
APDIP; Tan Wooi Tong, the Programme Specialist for the International Open Source Network, UNDP-APDIP, for their patience and hard work. Managing and working on this large-scale project with them as
our colleagues has made our lives less complicated. The team not only facilitated the project but also
provided the feedback and input that makes this primer unique.
Sarmad Hussain, M Sasikumar and Javier Sol, the coordinator of KhmerOS, the Khmer (Cambodia)
Software Initiative, for reviewing this primer and providing invaluable input. We want to specially thank
Javier for his contribution on pages 12-15 on free/open source software and its benefits and the case
study of Khmer localization.
Vorasone Dengkayaphichith, Vincent Berment, Alberto Escudero-Pascual, Pramod Raghavendra and
Guntapalli Karunakar, who read and critiqued this primer.
Arthit-Thai OpenOffice team member, Indian and Vietnamese participants for their responses to the
surveys.
Fred Williams, for his invaluable input, advice and suggestions.
PAN Localization Project (www.panl10n.net), PAN programme of IDRC and Center for Research in Urdu
Language Processing (CRULP, www.crulp.org) at National University of Computer and Emerging Sciences
(www.nu.edu.pk), for providing information from the survey during the Fundamentals of Local Language
Computing training used in the second section.
Anousak dedicates this work to his family and his late parents.
ACKNOWLEDGEMENTS
vii
8/12/2019 FOSS - Localization Primer
8/67
8/12/2019 FOSS - Localization Primer
9/67
INTRODUCTION
This primer provides a broad perspective on the localization of Free/Open Source Software (FOSS) for
the benefit of policy- and decision-makers in developing countries. It highlights the benefits and strategies
of FOSS localization, along with case studies from various countries that are on the road to software
freedom.
The primer begins with an introduction to localization and the benefits of choosing FOSS over proprietary
software. The next section provides a survey of initiatives and efforts in localization of FOSS within the
Asia-Pacific region, including best practices and lessons learned specifically in countries such as Viet
Nam, Thailand, Cambodia, India and Malaysia. The primer also provides three case studies of localization
efforts in Thailand, Lao PDR and Cambodia, as well as recommendations on technical issues, resource
allocation, skills and tools, implementation, costs and language considerations.
To help localizers get started, two annexes regarding key concepts and the technical aspects of localization
are provided. These are intended for project managers and implementers who are planning software
localization projects.
Computers, English, and Local Users
It is almost impossible to use a computer if you cannot read the instructions, buttons and menus. Thus it
is not surprising that many countries in Asia lag behind Europe and America in the adoption and use of
modern computer technologies at work, in schools, and in the home.
Computers dont have to display everything in English. In fact, the computer doesnt care what language
is displayed, since everything is ultimately converted into ones and zeros. Even if the display is translated
into another language, the computer continues to operate as before.
Translating software is nothing new. This process, which is known as localization, is not technically difficult.
However, it requires professional management, a team of translators, and financial resources, especially
for the initial translations.
Commercial companies have localized software for specific markets. Typically, they recoup their costs by
charging license fees for the localized versions of their software. In countries where the average citizen
cannot afford to pay the fees, they either do without localized software or resort to illegal copying.
All countries want the benefits of localized software, but some cannot afford the expensive licenses.
With FOSS, this problem is solved. A combination of policies that encourage software localization/
translation into different languages and the ready availability of FOSS, presents an ideal means forexpanding computer use worldwide.
Now is the time for developing countries to embrace the FOSS movement, and accelerate their adoption
of computing technology by localizing FOSS.
Localization
Localization is the process of adapting, translating and customizing a product (software) for a specific
market (for a specific locale or cultural conventions; the locale usually determines conventions such as
sort order, keyboard layout, date, time, number and currency formats). In terms of software localization,this means the production of interfaces that are meaningful and comprehensible to local users.
The Localization Industry Standards Association (LISA) defines localization as: Localization involves taking
1
8/12/2019 FOSS - Localization Primer
10/67
1The Localization Industry Primer, LISA - The Localization Industry Standards Association, 2nd
Edition, 2003; available from www.lisa.org/
interact/LISAprimer.pdf.
a product and making it linguistically and culturally appropriate to the target locale (country/region and
language) where it will be used and sold.1
Typically, this involves the translation of the user interface
(the messages a program presents to users) to enable them to create documents and data, modify them,
print them, send them by e-mail, etc.
Technically localizing FOSS is no different from localizing commercial software. Fonts must be changed,
keyboard layouts devised, and standards adopted. The difference is price and licensing. With FOSS, the
price is lower and the license open to all. For saving money and time, nurturing local innovation, and
combating illegal copying of software, FOSS localization is a better alternative.
The Importance of Localization
Currently, people who want to use computers must first learn English. In a country with low literacy
rates, this blocks access to information and communications technologies (ICTs), especially for the rural
poor and women who do not have equal access to education. Even after having learnt English, usersmust pay hundreds of dollars to license foreign software, or resort to widespread illegal copying of
software, in order to gain access to ICTs. In short, access to information technology is one of the keys to
development, and localized FOSS applications remain a crucial missing link in communications
infrastructure.
Localization brings the following benefits:
Significantly reduces the amount of training necessary to empower end-users to use a computer
system.
Facilitates the introduction of computer technology in Small and Medium Enterprises (SMEs).
Opens the way for the development of computer systems for a countrys national, provincialand district level administration that will allow civil servants to work entirely in the local lan-
guage and manage databases of local language names and data.
Facilitates the decentralization of data at provincial and district levels. The same applies to utility
companies (electricity, water, telephone), who will develop local language databases, thereby
reducing costs and giving better service to citizens.
Allows citizens to communicate through e-mail in their own language.
Empowers local software development companies to work for the administration, the public
sector and private companies.
Provides the local design industry with good fonts.
Helps universities train more software engineers.
The beneficiaries of this multi-stakeholderproject are:
Directly, all local computer users, who will have easier access to the use of computers as they
will not have to learn English first.
Indirectly, through improvements in governance using native computer systems, all local citizens
in the quality of their dealings with the administration.
The local government who will have the opportunity to develop databases and applications in
the local language. Sufficient technology and empowered local development companies will
be available. The government will also have the tool to coordinate applications among similaradministrations (e.g., provinces), so that IT-based improvements in governance can be made at
the lowest possible cost.
The software industry. The governments use of standards-compliant computer technology
encourages software companies to start developing compatible computer systems that will be
used by the different bodies of the administration, thereby creating a stable software industry
in the country. Once this expertise is developed (using FOSS), these companies will be
empowered to undertake similar projects for foreign companies at extremely competitive prices,
facilitating sales beyond the local market.
2 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
8/12/2019 FOSS - Localization Primer
11/67
What is Free/Open Source Software?
The last decade witnessed a phenomenon which in the preceding one would have been thought of as
impossible. A community of volunteer computer scientists has developed computer operating systems,
advanced user interfaces (desktops), and a number of applications that compete in quality, appearance
and robustness with some of the most advanced proprietary software (such as Microsoft Windows).
The term free in Free/Open Source Software refers to freedom to use, study, modify and share the
software. The freedom to share FOSS implies that it can be used and translated by people without their
having to pay any fees. However, some software that can be used without having to pay user fees, such
as shareware or freeware, cannot be studied, modified or shared, which means that they are not FOSS.
At one time, FOSS was exclusively developed by volunteer enthusiasts. Today, however, even large
computer companies such as IBM and Sun Microsystems support and develop FOSS.
A growing number of European national and local administrations have developed or are developing
policies to promote the use of FOSS instead of proprietary systems and tools. This not only gives them
independence from commercial vendors, but also nurtures their own software development industries.
There is little doubt now that FOSS is viable and of high quality. Therefore, many governments are choosing
FOSS for localization.
What is GNU/Linux?
GNU/Linux is a free Unix-type operating system originally created by Linus Torvalds and the GNU Project
with the assistance of thousands of volunteer developers around the world. It is the most popular FOSS.
Developed under the GNU General Public License, the source code for GNU/Linux is freely available toeveryone. And one does not have to pay a licensing fee to download and use it. It is robust and secure,
and it has no hidden features, because the source code is publicly available. Unlike proprietary operating
systems, thousands of developers across the globe can inspect the code, identify vulnerabilities, provide
security patches, contribute improvements and therefore historically GNU/Linux systems cannot be easily
compromised by attackers.
Why Localize FOSS?
It is an acknowledged fact that the near-monopoly of English language software, controlled by English-
speaking companies, does not serve the long-term needs of any country. Microsoft and a few other largeUS corporations dominate the international software market, earning large profits and wielding enormous
power. For those with limited funds, the burden of paying for proprietary software means less money for
other programmes of vital importance, as well as giving up linguistic freedom.
While proprietary software is often of the highest quality, policy-makers worldwide know that it carries
a high risk of dependence on commercial corporations. If a corporation decides to no longer support
software in another language, only those who are fluent in English would be able to operate computers
effectively. And when local ICT professionals become proficient in both computers and English, they are
quickly lured away from home, leading to a brain-drain that can damage a developing country for
generations to come.
Key Advantages of FOSS Localization
Reduced reliance on imports.
No need for local users to learn English first.
Local programmers gain expertise and experience.
Local control over software appearance and functionality.
New local technical standards and educational opportunities.
Establishment of a local software industry. It is difficult for foreigners to do localization as they
do not normally have an intuitive feel for the local language and therefore the language is com-
promised in most cases. National policy on local content would not be dependant on the availability of proprietary
software or hardware.
Localization of applications can be prioritized according to the national needs.
Introduction 3
8/12/2019 FOSS - Localization Primer
12/67
2The OSS advocacy report: Peruvian Congressman Responds to Microsoft, March 10, 2002; available from www.studioforrecording.org/
mt/Pubdomain_Bread/archivist/000013.html
Languages that are nationally important but financially unfeasible can be used.
Disadvantages of Proprietary Software
Expensive to license and maintain.
Dominated by the English language.
Controlled by foreign corporations.
Dependent on proprietary or closed standards.
Has little or no local support.
The high cost of the software leads to illegal copying of the software.
The local software industry is not developed.
Software cannot be localized or modified.
FOSS is generally much more secure than proprietary or closed source software. In the words of Peruvian
Congressman Villanueva, To guarantee national security, the State must be able to rely on systems without
elements controlled from a distance. Systems with open source code allow the State and citizens toinspect the code themselves and check for back doors and spyware.
2
Certainly, in an uncertain and sometimes dangerous world, few governments can afford to risk their
information infrastructure security by relying on the goodwill of a secretive organization (such as a
commercial software company) that they cannot control.
4 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
8/12/2019 FOSS - Localization Primer
13/67
A Survey
In the winter of 2003, a survey was done on FOSS localization efforts in several Asian countries. Progress
in localization varies considerably from place to place. Governmental sponsorship of the project appears
to be the single most important factor in achieving rapid success in localization. Without exception, thedevelopers surveyed cited Freedom to Develop as their primary reason for choosing to localize FOSS
instead of using proprietary software.
The CJK Initiative
China, Japan and Korea are officially cooperating in FOSS localization. The well-funded and extensively
promoted CJK programmes encouraging use of localized FOSS are at par with that of the wealthiest
nations.
With educational and technological infrastructure and a large pool of skilled technology and languagespecialists, these three countries have the potential to dominate East Asian FOSS development in the
next decade.
As donors and advisors, all three countries have a track record of supporting FOSS initiatives worldwide.
Others should emulate the technical and organizational competence of the CJK FOSS and localization
initiative, which is being led by the the Chinese Software Industry Association (CSIA), Japanese IT Services
Industry Association (JISA), and the Federation of Korean Information Industries (KFII).
This primer is too short to fully detail the impressive work of the CJK initiative. However, a number of
references to CJK as well as contact information for the key leaders of the movement are provided.3
Indian Languages
There are already multiple localized Indic language versions of GNU/Linux, Mozilla and OpenOffice.org
available online. The depth of technical experience of Indian programmers in localization should enable
them to provide assistance to other Asian countries in their localization efforts.
India has world-class IT infrastructure and skills. It also has a multiplicity of languages. Currently, the
Indian Ministry of Information Technology is localizing to Hindi, Marathi, Kannada, Malayalam, Tamil,
Telugu and Sanskrit.
At least two independent groups as well as the Ministry of Information Technology are currently localizing
to Tamil.
An initiative to localize GNU/Linux to around 10 Indian languages, called Indix, is being spearheaded by
the Centre for Development of Advanced Computing (CDAC), a scientific society of the Ministry of
Communications and Information Technology, Mumbai. There is also a Hindi GNU/Linux and a Bangla
version in progress.
English is widely used in India. Therefore, the underlying programming languages are easily understood,
making the work much easier. For English language FOSS development, South Asia can realistically
compete with Europe and the United States today.
LOCALIZATION EFFORTS IN THE ASIA-PACIFIC
3See www.linuxinsider.com/story/32421.html, www.economist.com/business/displayStory.cfm?story_id=2054746,
encyclopedia.thefreedictionary.com/CJK, www.chinadaily.com.cn/english/doc/2004-05/11/content_329529.htm and www.firstmonday.dk/
issues/issue8_10/jesiek/.
5
8/12/2019 FOSS - Localization Primer
14/67
Thai
Localization of FOSS in the Thai language was started in 1993 by Thai students in Japan in an effort to use
Thai in Unix environments. Later, a similar movement commenced in Thailand. These two movements
merged and Linux TLE and the Thai Linux Working Group were launched in 1999. However, the movementwas limited to a small community until mid-2001 when the Thai version of OpenOffice.org, dubbed
Pladao and sponsored by Sun Microsystems (Thailand), was announced to the public. Documentation is
being carried out by private publishers who, in exchange, will retain the copyright on their work for later
sale to the public in the form of books and manuals.
Only 10 individuals are actively involved in the project at this time, with development resources provided
by a combination of private companies and government.
Thai developers are using GNU Compiler and Tools for modifying GNU/Linux, Mozillas Bugzilla for defect
tracking, and CVS for version and source control. In addition, OpenOffice.org, a productivity suite, is
being localized for Thai users.
The primary difficulties the Thais are experiencing include lack of feedback from users, lack of
documentation, and conflicts with other Thai localization projects because of a lack of coordination and
standards.
The Thais intend to roll out the software for both the private sector and public institutions, but are still in
the planning stage at this time. The team has not yet seen a high-profile effort to promote the use of
FOSS in Thailand. This may change in the near future, depending on government and private funding. In
comparison to the CJK efforts, Thailand has fewer developers, less money, and less outside interest due
to the size of its market. Other Thai localization projects are discussed on pages 7-10.
Vietnamese
FOSS localization to the Vietnamese language began in 1998, primarily as an individual effort by an
enthusiast. Today, there are between 20-50 people working on the project. They are volunteers, providing
their resources and time for free, and all are using FOSS tools for the work. But even with the number of
individuals currently involved, there are not enough people to perform all of the necessary work.
Vietnamese localizations of GNU/Linux, Gnome, KDE, XFCE, Fluxbox, OpenOffice.org, Mozilla, XMMS,
GnuCash, Gaim and Knoppix are in progress.
Plans for introducing the software to the Vietnamese people include the publication of books, formation
of user groups in major cities, and provision of the software to private and public institutions. Already,
there has been some effort to promote the use of FOSS in secondary schools, universities and government
offices. Recently the government adopted a FOSS policy.
Malay
The Malaysian Institute of Microelectronic Systems (MIMOS) has launched a Web site to document projects
in FOSS within Asia with links to key resources. MIMOSs goal is to localize key applications into the
national language, Bahasa Melayu. MIMOS has already developed a local language GNU/Linux GUI and
open source applications for the government. Two other localization projects are GNOME, led by Hasbullah
Bin Pit, and OpenOffice.org, spearheaded by MIMOS.
Khmer
The Khmer Software Initiative has an ambitious though under-funded plan to localize FOSS for Khmer
speakers in Cambodia and elsewhere. In addition to a localized version of the GNU/Linux user interface
and some applications, they intend to create a development library, complete documentation both online
and in print, and specialized training materials for developers and end users. It is not known how many
individuals are working on the project currently.
As elsewhere, the Khmer team envisions providing the software to both private and government users.
A publicity campaign is planned and the developers expect significant support from the international
development community to complete much of the work.
6 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
8/12/2019 FOSS - Localization Primer
15/67
The quality of the planning for Khmer, a crucial first step, is very high. As with other developing countries,
funding and personnel to complete the work are the main hurdles. For more information on this area,
please read Khmer Case Studies on pages 12-15.
Case Studies
Thai Localization
Fortunately for localizers, Thai language support has been stabilized by means of standardization achieved
in the preceding years. The only limitation is the readiness of the internationalization frameworks within
Gnome, KDE, Mozilla and Open Office.
FOSS communities of Thailand contribute a lot to both software development and user support.
Governmental organizations also play important roles in FOSS reaching the masses.
Thai LanguageThe official language of Thailand is Thai. Spoken by almost the entire population, with several dialects in
different regions, Thai is a tonal, uninflected and predominantly monosyllabic language. Most polysyllabic
words in the vocabulary have been borrowed, mainly from Khmer, Pali and Sanskrit.
Thai belongs to the Tai language family, which includes languages spoken in Assam, northern Myanmar,
Thailand, Lao PDR, northern Viet Nam, and the Chinese provinces of Yunnan, Guizhou and Guanxi.4
Thai script belongs to the Bhrami family. The oldest evidence of Thai script dates back over 700 years to
the Sukhothai Age. Over the years, Thai script has gradually changed. Contemporary Thai script is
composed of 44 consonants, 21 vowel symbols (32 sounds when combined), four tone marks, two diacritic
marks and 10 decimal digits. Tone marks, diacritic marks and some vowel signs are stacked over or below
the base consonants. The stacking is a shared characteristic among many South-East Asian scripts,
especially those that are derived from Bhrami like Lao, Khmer and Myanmar languages. However, there
are no complex precombined conjuncts in Thai, unlike most Indic scripts (Devanagari, for example). Only
stacking is required. Lao is the script closest to Thai.
StandardizationStandardization is the key to the success of Thai language support in computers. It allows interoperability
and resolves many localization issues. Important standards include character set, keyboard layout and
input/output method specifications.
The standardization of IT in Thailand has been recognized since 1984,5
when there were many efforts to
use the Thai language in computers. More than 26 sets of code pageswere defined by different vendors
resulting in incompatibility. As a solution they were all unified as TIS 620-2529/1986 as the national
standard by the Thai Industrial Standard Institute (TISI). A prominent legacy was the code table defined
by Kasetsart University (KU) in a successful R&D effort to enable the Thai system in MS-DOS. It was the
most widely adopted standard. Therefore, computer programs were obliged to support both encodings
until TIS-620 became more popular and KU became obsolete.
Therefore, when Microsoft released Windows into the Thai market, TIS-620 was the only encoding adopted.
The same was true for Macintosh. Thus, the character encoding issue was firmly settled.
In 1990, TIS-620 was amended to conform to ISO standards, but the code table was left completely
unchanged. This new version was called TIS 620-2533/1990. The amendment enabled TISI to actively
join many international standardization activities. For example, it submitted the character set to the
European Computing Manufacturers Association (ECMA) for registration in the ISO 2375 repertoire, and
was assigned as ISO-IR-166 so that it could be used with ISO/IEC 2022 mixed code page encoding. An
example of such implementation is GNU Emacs. Around 1996, a TISI technical committee drafted a
proposal for the Latin/Thai part (part 11) of ISO/IEC 8859, based on TIS-620. However, it was suspended
due to the prohibition of combining characters. It was reactivated in 1999, and endorsed as an
international standard in 2000.
4Thai Language Audio Resource Center, Some Historical Background of Thai Language; available fromthaiarc.tu.ac.th/thai/thai.htm.
5Koanantakool, T. and the Thai API Consortium, Computer and Thai Language,National Electronics and Computer Technology Center,
1987, in Thai.
Localization Efforts in the Asia-Pacific 7
8/12/2019 FOSS - Localization Primer
16/67
The TIS-620 code table was pushed for inclusion in the Unicode table.Although the influence of the ISCII
encoding scheme (which forced all vowels, including the leading vowels, to always be encoded after
consonants) had made the Unicode consortium force Thai to change its encoding scheme, TISI defended
the TIS-620 practice, as Thai script did not need such complications. Although this made Thai (and Lao)
different from other Indic scripts, it saved Thai (and possibly Lao) implementations from the big hindranceof lacking supporting technology for ISCII practice at that time, as well as from the burdens of migration
from the well-settled and widely-adopted practice. So all Thai language-processing codes for TIS-620
and Unicode, apart from the necessary code conversion, are fully compatible.
In addition to the character set, the Thai keyboard layout was standardized as TIS 820-2531 in 1988, and
later amended by adding keys for special symbols and published again as TIS 820-2538 in 1995. Another
keyboard variant designed after research on character frequencies, called Pattajoti, is also available. But
it is not as popular and is not a national standard.
Thai input/output methods were also standardized through the efforts of the Thai API Consortium (TAPIC),
which was formed by a group of vendors and academies and sponsored by the National Electronics andComputer Technology Center (NECTEC). The specification, called WTT 2.0 (from its Thai abbreviation
Wor Tor Tor, which stands for Wing Took Tee or runs everywhere), was published in 1991. Its contents
were composed of three parts, describing character set and encoding scheme, input/output methods,
and printer identification numbers.
Although not endorsed by TISI as a national standard, WTT 2.0 was adopted by virtually all the major
vendors who participated in the draft, including DEC, Sun, Microsoft, MacIntosh and IBM. WTT 2.0 had
enjoyed being the de factonational standard for seven years, until it was dubbed TIS 1566-2541 by TISI in
1998.
There are other activities
6
with international standards bodies that promote understanding of Thailanguage requirements among vendors. For example, in 1998 the tis-620 MIME character set was
registered with the Internet Assigned Number Authority (IANA) for information interchange on the
Internet.7
Another example is an annex of ISO/IEC 14651, International String Ordering, describing how
the predefined sorting order for Unicode can be tailored to match the requirements of Thai string ordering.
With these established standards, specifications for Thai implementations are clear and interoperability
is guaranteed. The standards have played an important role in several developments in the Thai computer
industry, including FOSS localization.
Localization
Thai localization of FOSS was started in 1993 by Thai students in Japan with the ThaiTeXproject initiatedby Manop Wongsaisuwan as a first effort to use Thai in the versatile typesetting program.
8
Subsequently,
the project was maintained by the Thai Linux Working Group (TLWG)9
which was formed in 1999.
Apart from Thai LaTeX, other surrounding UNIX environments have been modified by the same group of
people to support Thai. Their work may be summarized as follows:
Manop Wongsaisuwan:ThaiTeX (ttex), X bit-map fonts.
Thai Project (by Vuthichai Ampornaramveth):10
cttex (C version of ttex), xiterm+thai (Thai X termi-
nal), likit (Thai text editor for X).
ZzzThai project (led by Poonlap Veerathanabutr):11
thailatex-component, X bit-map fonts, Thai
support in xfig, Thai-HOWTO and Thai RPMs.
At the same time, other Thai support projects were developed by researchers of the NECTEC in Thailand,
including:
Virach Sornlertlamvanich:Thai support in Omega (Unicode-based TeX kernel), Thai in GNU. Emacs,
machine translation, and many other NLP projects.
6Karoonboonyanan, T. and Koanantakool T., Standardization Activities and Open Source Movements in Thailand,Country Report, MLIT-4,
Myanmar; also available at www.nectec.or.th/it-standards/mlit99/mlit99-country.html.
7Tantsetthi, T., Campaign for Internet-Standard-Conforming Thai Usage; available fromsoftware.thai.net/tis-620.
8
Wongsaisuwan, M., Introduction to ThaiTeX; available from thaigate.nii.ac.jp/files/thaitex.pdf.9Thai Linux Working Group, Thai LaTeX; available frominux.thai.net/plone/TLWG/thailatex.
10Ampornaramveth, V., NACSIS R&D Thai Project Page; available from thaigate.nii.ac.jp.
11eucthai, ZzzThai Project; available from www.fedu.uec.ac.jp/ZzzThai/.
8 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
8/12/2019 FOSS - Localization Primer
17/67
Surapant Meknavin:thailatex (babel-based), Thai search engine.
Phaisarn Charoenpornsawat:swath (Thai word break utility).
Theppitak Karoonboonyanan:Thai string collation , Thai Locale.12
The National Fonts Project:Standardized font design specification, three public domain vector
fonts (Kinnari, Garuda and Norasi).
Another project worth mentioning is Linux SIS (School Internet Server),13
which was initiated by NECTEC
for use in the SchoolNet project.14
Although it is a server-centric distribution, it was during this project
that another main task force for Thai FOSS localization was constituted. Through a mailing list for
supporting its users, the volunteers agreed that another distribution for desktops was needed, and was
feasible to develop, as almost all of the specialists mentioned above were there. This task was undertaken
by the Thai Linux Working Group. A Web site (linux.thai.net) was created for general user support. A new
GNU/Linux distribution called Linux TLE (Thai Language Extension) was created to collect, as
comprehensively as possible, the existing works of Thai developers and package them for users.
Apart from being a tool for boosting the use of FOSS by Thai users, Linux TLE also provided a platform fordevelopment, and a test cycle where users could participate through bug reports. The ultimate goal was
to improve Thai support for FOSS from the source. Therefore, getting patches checked-in to upstream
projects was the final success indicator.
So far, lots of source code from TLWG and Linux TLE have been incorporated in upstream projects,
including:
Thai locale definition in GNU C library.
Thai keyboard maps in XFree86.
Thai XIM in XFree86.
Thai fonts in XFree86. Thai Pango modules.
Thai string ordering in MySQL.
GTK+, GLib, Qt, KDE, Mozilla, Xpdf, etc.
In 2000, Linux TLE was handed over to NECTEC for maintenance. Three versions (3.0, 4.0 and 4.1) were
released and gained a lot of recognition from users in all parts of the country. A dedicated Web site was
created for it at opentle.org in 2003. TLWG continued to build its user and developer communities.
Some of the TLWG projects that are hosted and maintained by the community are:
libthai :15
a library of Thai basic support routines, including character sets conversion, input/outputmethods, word break, string collation, etc. Some plug-ins for Pango GTK+ IM are also provided.
thaifonts-scalable :16
a collection of scalable fonts available to the public, plus some fonts
developed in-house. All fonts are maintained and improved based on standard technical
specifications.
thailatex :17
Babel-based Thai support for LaTeX document preparation, based on Surapant
Meknavins work.
Other significant development efforts to boost the Thai environment in FOSS are Pladao18
and OfficeTLE.19
Both projects aim to develop Thai support in OpenOffice.org. Pladao was initiated by Sun Microsystems(Thailand) and was subsidized by Algorithms Co. OfficeTLE was initiated and operated by NECTEC. Both
12Karoonboonyanan, T., Thai Sorting Algorithms; available from linux.thai.net/thep/tsort.html; Karoonboonyanan, T., Raruenrom S. and
Boonma P., Thai-English Bilingual Sorting; available from linux.thai.net/thep/blsort.html; Karoonboonyanan, T., Thai Locale; available
from linux.thai.net/thep/th-locale.
13National Electronics and Computer Technology Center, Linux SIS: Linux School Internet Server; available from www.nectec.or.th/linux-
sis.
14National Electronics and Computer Technology Center, SchoolNet Thailand; available from www.school.net.th.
15Thai Linux Working Group, LibThai Library; available from linux.thai.net/plone/TLWG/libthai/ and libthai.sourceforge.net.
16Thai Linux Working Group, ThaiFonts-Scalable; available from linux.thai.net/plone/TLWG/thaifonts_scalable/.
17Thai Linux Working Group, Thai LaTeX; available from linux.thai.net/plone/TLWG/thailatex/.
18See www.pladao.org.
19See opentle.org/office-tle.
Localization Efforts in the Asia-Pacific 9
8/12/2019 FOSS - Localization Primer
18/67
of these projects are working in parallel, emphasizing different aspects. Pladao is feature-rich, while
OfficeTLE emphasizes Thai language processing quality. Many hope that they will merge, possibly through
upstream projects.
ObstaclesThese are the obstacles to the localization of FOSS in Thailand:
Too few developers.With the growth of the user base, the lack of FOSS developers to serve the
growing requirements and expectations is a big problem. The premature growth of FOSS
adoption in Thailand has unbalanced the community, both in terms of the ratio between users
and developers, and in terms of unrealistic expectations with regard to price and freedom.
Worse, the community existing developers have been fragmented because they are often
employed by competing businesses. Proprietary competition has reduced the traditional
cooperation responsible for the progress of FOSS in Thailand.
Misconception. If one wishes a movement to be initiated by the government, it is necessary forthe government to have a good understanding of all of the concerns. The government must
realize the benefits of FOSS as a means for developing technologies, as well as for improving
the technical skills of the developers. Otherwise, it just becomes exploitative. According to some,
even though the Thai government has popularized FOSS through the recent campaign for
affordable PCs, they have also damaged public opinion of FOSS by their failure to provide proper
support. Premature promotion of FOSS to uninitiated users when it is not ready would only
create a bad impression. On the other hand, claiming that Microsofts decision to lower the price
of proprietary software is actually a success for FOSS, can be seen as exploiting FOSS as a
negotiation tool. Moreover, localization tends to be perceived by the government as an activity
that is about development of local GNU/Linux distributions, which is not true. Thus, many
government policies simply miss the point and sometimes make things worse.
Lao Localization
Laonux is the name of the Lao language version of GNU/Linux. This section deals with Laonux
implementation. An overview of its success and obstacles to its development is also provided.
Traditionally, the Lao language and its literature have been written in two scripts, Lao and Tham. The
Tham script is derived from the Lanna script (of present-day Chiang Mai and northern Thailand), which
in turn originates from ancient Mon.20
The Lao language belongs to the Tai language family, which includes
languages spoken in Assam, northern Myanmar, Thailand, Lao PDR, northern Viet Nam, and the Chineseprovinces of Yunnan, Guizhou, and Guanxi.
21
Lao script is believed to have originated from the Khmer
writing system. It originated in the Grantha script, which was the southern form of the ancient Indian
Brahmi writing system.22
Lao script shares characteristics with other South-East Asian writing systems. It follows complex rules of
layout involving consonants, vowels, special symbols, conjuncts and ligatures. Spaces are not used to
separate words, and vowels appear before and after, under and over consonants.
Obstacles and SuccessesIn localizing FOSS for the Lao script, the following tasks must be completed:
Identifying the technical obstacles to be overcome.
Creating the worlds first English/Lao technical dictionary.
Finding and coordinating technical volunteers.
Establishing de factotechnical standards.
Performing and testing the work.
User training and education.
Identifying the sources of funding.
The work of investigating how GNU/Linux can be localized for Lao began in the summer of 1999 and
20See www.lan-xang.com/literature/lit_3.html.
21Thai Language Audio Resource Center, Some Historical Background of Thai Language; available fromthaiarc.tu.ac.th/thai/thai.htm.
22See seasrc.th.net/font/alphabet.htm.
10 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
8/12/2019 FOSS - Localization Primer
19/67
proceeded slowly at first. Months of research and experimentation identified the technical difficulties
and tools available to resolve them. Anousak Souphavanh, working from Rochester, New York, eventually
formed a team of volunteers, teachers and students from the National University of Lao PDR to focus on
translating KDE into Lao. The KDE desktop in Lao allows the end user to access the basic functionalities of
a computer, including email, Web browser and office applications.
Until 2002, the work progressed slowly but steadily, aided largely by helpful and frequent advice from
fellow FOSS enthusiasts worldwide. The community regularly provides invaluable information and
assistance in tracking down documentation of technical issues, relating experiences in solving similar
problems, or simply encouraging the volunteers in their efforts.
In 2002, the Jhai Foundation provided a small stipend to support the development of Laonux. As before,
research had to be performed on the technical issues and tools, and more volunteers had to be found for
the required translation and programming. The programming work was completed in 2003. However,
the bulk of the translating remains undone. The major obstacle is the lack of an English/Lao technical
dictionary. Without this, any translation will be inconsistent and confusing to users.
Upon completion of the dictionary, it is relatively simple to translate the remaining message strings and
integrate them into the desktop environment. This work can be performed by either professional or
student translators at a relatively low cost. But until the dictionary is completed, the work will continue
at a snails pace.
Funding for the dictionary and translators is now being sought from international development agencies.
In addition, funding for professional documentation, training and user education is required.
Standardization
The lack of technical standards for the Lao script and its implementation in software remains a difficultchallenge. The following standards must be completed and accepted officially:
Character set.
Keyboard layout.
Unicode fonts.
Input methods.
Output methods.
To date this project has yielded some very useful de factotechnical standards. Lao officials now recognize
the vital importance of these standards and have adopted the goal as their own. These standards and
the technical dictionary could dramatically speed up the ensuing. Until the majority of Lao developersagree to follow standards, further development will be hampered.
LocalizationTeam members have resolved the following issues. These solutions follow ISO standards and should be
adopted by future localization efforts to avoid duplication of effort and incompatibility between systems.
First, Unicode fonts were used instead of the existing fonts that override glyphs of English letters as per
keyboard layout because these fonts are not standards compliant. Unicode is now the worldwide standard
for FOSS developers. Also, development tools such as Kbabel and KDE require Unicode compatibility.
Laonux is a KDE localization, which is why the rendering of fonts is handled by the Qt libraries (as opposedto Pango or X Window). The Qt library file Qt-qfont_X11.cpp was modified slightly to point to the
appropriate range for Lao. Initially Lao fonts were not rendered properly while stacking combined
characters (i.e., consonant and a vowel). With the help of Theppitak Karoonboonyanan, patches were
submitted to fix the rendering. Resolving these issues was a major breakthrough for Laonux development.
Inputs are handled by XKB, the keyboard map for X. It is used in converting key-strokes to key symbols
defined in X11/keysymdefs.h, with language switching capability. XKB Lao keys were created with the
appropriate Lao Unicode range. Finally, the GNU C library definition for Lao was created. This is mainly
UTF-8 locale settings for date/time and related issues.
Future Plans Continue work on Laonux.
Begin work on localizing OpenOffice.org.
Continue translation work for PHP Web portal tools.
Localization Efforts in the Asia-Pacific 11
8/12/2019 FOSS - Localization Primer
20/67
Begin work on localizing Mozilla and other Web tools.
Train users and technical staff for localization projects.
The first priority is to create the English/Lao technical dictionary. Whether this will be funded by
governmental sources, grants or international aid is unclear. Without this dictionary, translating andlocalizing the software cannot be completed. Another priority is to continue cooperating with other
regional software localization efforts, especially where they have already addressed similar issues.
Additional modifications and updates to ISO and Lao government IT standards are required for the long
term. These include Input/Output methods, keyboard layout, collation, locales, and additional Lao
OpenType Unicode fonts standards.
Cooperation with universities for localization is ongoing. With most of the technical issues resolved,
localization is now primarily a language issue. To avoid unnecessary anglicisms, professional linguists
are needed. If technical professionals are involved in this process, they are likely to impose what they
already know, which is English. It is far better for the future to adopt native language terms whereverpractical. However, without funding, it is likely that a hodge-podge of anglicisms will prevail.
On the technical level, support for Lao script in IBMs ICU library is needed. ICU is the script support base
for OpenOffice.org and for Java (released by IBM and Sun Microsystems). It is a complete library, including
script rendering, layout, collation (sorting of words), line breaking, spell-checking, etc.
Some difficult and important technical work has been done. However, full integration in ICU will force us
to define all of these issues very clearly, and this will pave the way for the developers to create Lao
applications in Java and C++. Without this, professional Lao software development can be difficult.
Khmer Localization23
Khmer LanguageAs in the case of Thai and Lao, Khmer script originates from the Grantha script, the south Indian form of
the ancient Indian Brahmi writing system.
Khmer script follows complex rules of layout in which consonants may take two different forms (e.g., the
small form is placed on a lower line if it immediately follows another consonant). Space is used not to
separate words but to indicate a pause in reading (very much like a comma in English). Vowels pronounced
after a consonant may appear before, after, above, below; before and after (formed by two glyphs); before
and above; below and above; or under and after the consonant.
At present, the definition of the language is so poor that even the number of vowels in the language is
not clear. The number of vowels in the official reference (the only available dictionary) is different from
the number of vowels taught in schools. The reference dictionary is sorted phonetically, making a
systematic collation algorithm that will follow the same order impossible. Words starting with the same
consonant may be ordered under different listings depending on how that consonant is pronounced in
that word. As in the Lao localization project, an English/Khmer technical dictionary is not available, and
the lack of it severely hampers the efforts to translate software into the local language.
Obstacles and Successes
When the KhmerOS project was first being considered, the technical situation was as follows:
Khmer had already been included in Unicode. Fixed in 1996 by a team of people who had no
contact with the Cambodian government, the definition in Unicode was later disputed, but to
no avail. The Unicode Consortium refused to change anything, including the addition of necessary
Khmer vowels, on the basis that these could be formed by combining other existing Khmer
characters. The Consortium only permitted adding comments to the existing standard. The
standard is now considered fixed by the Khmer government (in its 4.0).
Microsoft had published OpenType specifications for Khmer, and included the language in its
Uniscribe complex text layout engine. MS Publisher worked very well in Khmer, but MS still did
not handle either line-breaking or sorting. MS Word crashed quite often while using Khmer.
Some OpenType Khmer fonts already existed, though none in the public domain.
23This case study has been contributed by Javier Sola
12 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
8/12/2019 FOSS - Localization Primer
21/67
No FOSS programs were implemented in Khmer in the GNU/Linux environment, but some FOSS
(such as Mozilla) worked well in Khmer under Windows, using the Microsoft Uniscribe engine.
Some people had been considering FOSS in Khmer, but the idea had not gone beyond mailing
list discussions.
There has been an amazing proliferation of legacy (non-Unicode) fonts. Up to 26 different fontencodings had been defined. They worked well enough under MS Word by modifying
normal.dot.
It is also important to understand the social situation, as follows:
The lack of computers in the Khmer language increases the digital divide. Only people who
speak English have access to jobs that require the use of computers.
Because computer interfaces are in English, the words used for computer-related work are also
in English, introducing many anglicisms that could have been easily avoided if the software
had been translated.
As people have to memorize new English words (in the menus), training for computer use takesa long time and it is soon forgotten if it is not used.
There is no English/Khmer technical dictionary.
The development of databases for governmental purposes is not possible, as no database man-
agement systems that handle either legacy or Unicode Khmer encodings have been developed.
In order to join the World Trade Organization, Cambodia has passed an intellectual property
law that, when in force will, in theory, compel people to pay for proprietary software. FOSS
allows developing countries to comply with the requirements of WTO without having to spend
large amounts of money.
Spanish computer scientist Javier Sol, who lives in Cambodia and has more experience with computers
and strategy than with FOSS, has decided to see what can be done in this situation. He has started
writing an ambitious project with the following deliverables:
A full computer operating system, office suite and entertainment applications needed by an
average computer user entirely in the Khmer language. A user will see only the Khmer lan-
guage script on his/her screen. The system will include full documentation in Khmer, in elec-
tronic and paper formats.
A development library(a set of programs) to be used by software developers to include sup-
port for the Khmer language in their applications; documentation of the development library.
A set of up to 50 computer fonts (Unicode OpenType fonts) to be used in the application menus,
for word-processing or for computer design.
A keyboard layout, supporting drivers and 5,000 physical keyboards that support the above-
mentioned Unicode fonts.
5,000 copies of an installation disk that would be easy to use and would include all of the above
software and documentation; with 1,000 of them accompanied by a full printed documentation.
Training materials addressed to end-users, including the use of the system and the applications,
and a training course for typing with the new keyboard.
Computer end-user trainers trained to teach the new system using the above-mentioned mate-
rials: University professors, students and software development company personnel trained in
advanced GNU/Linux and FOSS and application development using the Khmer script support
tools provided by the project; computer vendor personnel trained in the installation of the system.
FOSS expertise centres in universities, including trained professors, students and computerswith Internet connectivity.
Software development companies empowered to develop applications based on FOSS that
require support for the Khmer language script.
Government personnel trained to use the system.
Personnel expertise on software purchasing, coordination of applications between similar ad-
ministrations, and analysis of priority applications for improved governance.
Marketing materials for deployment of the system.
Widespread publicity of the system directly or through computer and software vendors.
The project not only considers the final goal but also the order in which the programs will be translated.First Mozilla, an email client, and then OpenOffice.org, an office suite, will be released under MS Windows.
Finally these will be included in a fully Khmer GNU/Linux release when the user interface is translated.
Localization Efforts in the Asia-Pacific 13
8/12/2019 FOSS - Localization Primer
22/67
After considering and later rejecting (for lack of real industry interest) the creation of an Industry
Consortium, the project soon found a home in the local Open Forum of Cambodia, an NGO with a long
history of supporting technologies for social purposes in Cambodia.
Sharing the idea of the project with anybody who would listen, setting up a Web site (www.khmeros.info),and initiating contact with various people interested in Khmer and computers, brought in the first
volunteers.
Typographer Danh Hong put into the public domain one of his Khmer OpenType fonts. This was an
important preliminary step to get the FOSS community interested in this language.
Lin Chear, a Canadian engineer of Khmer origin, started looking at Pango and in a few days created the
necessary programs to support Khmer in Gnome and its family of products. Khmer will be supported by
version 1.6 of Pango. KDE followed soon after.
With the help of Lin Chear, the European maintainer of Qt, developed the routines needed for supporting
Khmer in KDE and programs that use Qt for language support. Lin Chear applied a Pango patch to Mozilla
and got a version of Mozilla working in Khmer on GNU/Linux.
Back in Phnom Penh, the KhmerOS project established itself in a small office at the Open Forum facilities.
Using USD1,500 from the first small donations, they hired two computer scientists and with a couple of
old donated computers, started creating a glossary of Khmer computer terms as preliminary work before
starting the translation. A donation from a Hong Kong businessman would later permit the purchase of
new computers.
Meanwhile, work and discussion regarding keyboards and collation algorithms are ongoing.
Implementations in the Thai language show that dictionary based line-breaking can be done in languages
that do not separate their words. Work on conversion of texts in legacy fonts to Unicode encoding has
also started.
Evangelization for Unicode is a necessary part of the projects work. Large amounts of money are donated
to Cambodia or used by NGOs for computer-related projects, such as creating a database of all Cambodian
laws. If these projects are not done in Unicode, the databases will be useless in a few years.
Future plans include increasing the project team to five translators with at least one of them a professional
translator, and releasing email, browsing, word processing and spreadsheet programs in Khmer
(Thunderbird and Firefox from Mozilla and OpenOffice.org Writer and Calc).
These programs will all be released on MS Windows (2000 and XP), and will have full documentation inKhmer, as well as basic training modules in Khmer to be used by computer training professionals. Training
materials are important in order to fix the language and terminology used by teachers, assuring
standardization and avoiding use of too many anglicisms.
The translation of Gnome or KDE (or both) began in 2004, as well as a series of minor applications that
will allow the release of a complete GNU/Linux-based system in Khmer in the second half of 2005.
Funding is still a major concern. Project speed is adjusted to suit funding, which comes either through
grants or through contracts with corporations or other NGOs that need translated programs or services
related to Khmer Unicode that can be provided by the project itself.
On the technical level, support is still required for Khmer script in IBMs ICU library. Full integration in ICU
will compel the project to define all such issues clearly, as well as open the way for developing Khmer
applications in Java.
Another concern is being able to use low-priced computers. In the Microsoft environment, Khmer Unicode
will work only in Windows 2000 and XP, which require modern computers with a fair amount of memory
and large hard disks. The way to low-priced (i.e., secondhand) Khmer computers will definitely have to
be either through GNU/Linux or by getting Khmer script support in earlier versions of Windows such as
Windows 98.
The projects distribution strategy is to try to have the software pre-installed by computer vendors anddistributed by two-dollars-a-CD software vendors. This is to allow easy copying and wide distribution,
thereby saving the project the cost of making copies.
14 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
8/12/2019 FOSS - Localization Primer
23/67
The government, under an IDRC grant, is pushing for the localization of Windows and MS Office. They
have neither plans nor resources to get involved in FOSS localization, but are said to be interested in
coordinating efforts so as not to duplicate work and to ensure that the Khmer language (collation, etc.)
is implemented consistently in both platforms.
The project aims not to be sectarian about FOSS. It is better to have people using email in Khmer on
Windows in the short run than to try to make them change to a completely new system abruptly. There
are still two or three years before the intellectual property law is expected to be strongly enforced. This
period can be used as transition time, assuring a gradual success rate, rather than trying to force an
overnight change and thereby failing.
Status of Localization Projects
A survey24
of the status of localization projects was conducted by the PAN Localization Project25
during
the training on Fundamentals of Local Language Computing in Lahore, Pakistan in January 2004.Participants from 13 Asian countries were asked to provide information about the status of localization
tasks in their countries. The survey revealed the status of standardization, localization and national policy
for local language computing of the participants countries. Please note that the informal survey technique
employed gives only a rough picture of the actual situation.
Table 1 summarizes the survey on standardization for character set, keyboard layout, key-pad layout
(e.g., for mobile phones), collation sequence, terminology translation and locale definition.
Localization Efforts in the Asia-Pacific 15
24Hussain, S. and Gul S., PAN Localization Project: A regional initiative to develop local language computing capacity in Asia, 2004.
25See www.panl10n.net/.
: complete; *: partially done; ?: dont know; blank: no work done
Country Language Char KBD Keypad Coll. Seq. Interface Locale
Set Term.
Myanmar Burmese * *
Cambodia Khmer
Mongolia Mongolian ? * *
Lao PDR Lao
Nepal Nepali * * * * *
Sri Lanka Sinhalese * * *
Thailand Thai * * *
Bhutan Dzongkha * *
China Tibetan ?
Japan Japanese
Bangladesh Bangla ? * *
Afghanistan Pashto ? *
Iran Farsi * * *
Pakistan Urdu * * * *
Table 1 PAN Survey: Localization Standards
From the table, character set and keyboard layout seems to be well defined for most countries, while
other issues need more work.
Table 2 summarizes the current status of localization of applications on the GNU/Linux platform, namely,
keyboard input, fonts, sorting and find/replace utilities, natural language processing, spell checker, and
thesaurus. It also shows whether any GNU/Linux distribution has been released in the country.
8/12/2019 FOSS - Localization Primer
24/67
Country Language KBD Font Coll. Find / NLP Spell Thes. Linux
Driver Replace Check Distr.
Myanmar Burmese *
Cambodia Khmer
Mongolia Mongolian * * * ?
Lao PDR Lao
Nepal Nepali * *
Sri Lanka Sinhalese * * *
Thailand Thai * * *
Bhutan Dzongkha
China Tibetan * * ?
Japan Japanese ? ? ?
Bangladesh Bangla * * ? *
Afghanistan Pashto * ?
Iran Farsi * * * * *
Pakistan Urdu * * *
Table 2 PAN Survey: Basic Localized Applications on GNU/Linux
: complete; *: partially done; ?: dont know; blank: no work done
16 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
The survey shows that FOSS localization activities are taking place in many countries. Sharing expertise
and resources among countries can boost progress in this area.
For message translation, a number of Asian language localization projects are underway. All of these
projects are tracked in real time on the Internet. The following links provide the current status of some of
these projects.
i18n.kde.org/stats/gui/HEAD/fullinfo.php
www.mandrakelinux.com/l10n/status.php3
l10n-status.gnome.org/gnome-2.6/index.html
As of June 2004, Japanese and Korean translators have already completed most of their initial work in
FOSS localization. China is close behind, followed by India and the South-East Asian nations. The situation
is highly fluid, however, and the above sites should be checked for detailed and updated information on
the current status.
8/12/2019 FOSS - Localization Primer
25/67
Implementing Localized FOSS in Asia
Asia is the worlds battleground for FOSS localization. The monopolistic proprietary companies have not
yet established dominance in Asia. For reasons of national interest, many Asian governments have adopted
policies that encourage software alternatives, primarily FOSS.
In some countries the localization to date has been the work of a few dedicated enthusiasts scattered
around the globe. Few have been paid for their efforts, and the disorganized nature of their translations
has unintentionally produced ambiguities.
For the most part, the volunteers are programmers, not linguists. They need help from translators, technical
writers and testers. Since localization deals primarily with language rather than programming issues,
non-technical staff should outnumber programmers five to one. Even before adopting a formal FOSS
policy, direct support for technical dictionaries and standards for localization can begin. Local language
specialists require only professional salaries and offices. Technical writers and testers can be trained within
a few months.
Supporting international localization initiatives, where languages that share significant similarities (i.e.,
Thai, Lao and Khmer) share programming and technical resources, is very cost effective. The value created
for society as a whole, with new dictionaries and a technical standard enabling programmers and
translators to consistently localize any FOSS for a low price, is undeniable. Other Asian countries should
follow the example of the CJK initiative.
Localization initiatives should have very clear objectives, and the resources required to meet those
objectives. They require funding, professional management and technical expertise. In addition, thorough
linguistic knowledge is critical to success.
These initiatives will result in the creation of local centres where the knowledge is dispersed to those
who will perform the actual work. Such centres can be the product of governmental action or business
partnerships, or operate as part of a university. Regardless of how the centres are founded, they should
enjoy the full support of government policy.
It is time to professionalize the process of Asian software localization, especially for developing countries.
A great opportunity can be lost if haphazard efforts lead to undependable results. Where public good
cannot be achieved by individual effort, the government is expected to help. A professional group can
request the help of volunteers, but central coordination and basic work ought to be done by a dedicated
team of paid staff.
It could be that the yearly fees paid by a developing country for a single departments commercial software
is enough to underwrite that countrys participation in the FOSS movement.
Establish localization centres to be the focal point for FOSS developers to share information, develop
skills, and build on existing accomplishments. Where different countries have linguistic commonalities,
a regional localization centre could share the cost of development. Specialists who are familiar with
source code, linguists and analysts could be available to assist a wide variety of projects and build a
knowledge base to accelerate future development.
Sponsor the creation of technical dictionaries and standards so that consistency is retained in all FOSS
projects. With standard terminology, computer users are less likely to encounter frustration, and withstandard technological procedures and processes, FOSS code can remain comprehensible to all IT
professionals. Adherence to such standards should be mandated in all software procurement policies
implemented by the government.
RECOMMENDATIONS
17
8/12/2019 FOSS - Localization Primer
26/67
18 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
Move fast. It is important to have things done correctly, but it is also important to do them quickly.
Writing a good computer glossary for a low-technology language can take over a year, but a first glossary
that will suffice for translating the first versions of the programs can be done very quickly (e.g., in three
months). Future versions of the programs will use the final glossary, but first versions can be available
within months. An official portal detailing the prescribed terminology and standards should be the firstpriority.
Encourage the distribution of FOSS operating systems, applications and platforms. With little cost,
governments can distribute localized FOSS to schools, businesses and other organizations. This would
jumpstart the rate of adoption of computers and software in general, and prevent the unnecessary illegal
copying of proprietary software. Because FOSS often works with older machines, the total price of
providing computing access to the masses would be lower than that for any other approach.
Provide FOSS training not only for computer professionals, but also in primary and secondary schools. In
developing countries where educational budgets are stretched thin, the use of localized FOSS operating
on low-cost computers is well suited for increasing educational opportunities in rural communities. Thenatural curiosity of the youth should quickly result in a new generation that knows how to use computers
in their native language. Those students who show a special talent for using computers can be encouraged
to learn programming through scholarships, contests and other age-appropriate activities.
Beyond establishing governmental purchasing policies that favour localized FOSS, governments have
an important role in removing obstacles, providing funding and coordinating standards. Without
governmental support, anglicisms and inconsistencies will severely hamper the continued localization
of FOSS, and limit the possibilities for growth of an indigenous software industry.
Skills and Tools Required for Localization ProjectsLocalization often occurs when the country is already using computers in a foreign language. Computer
scientists and trainers are used to an English or French computer vocabulary. Localization therefore
requires creating training materials based on the language used in the glossary, so that trainers and new
users will start using the local language.
As it is difficult to engage linguists, preparatory work can be done first, such as looking for different
translation options for each term.
After this, the work is mainly that of translators, who follow glossary guidelines and rules. There should
be professional translators and computer scientists in the same team to assure linguistic and technicalcorrectness of the terms used.
Localization can increasingly be performed without too many technical resources, once the first layer of
the work is done (fonts, language support, etc.). In the future, it will become easier, since almost all FOSS
projects are adopting new tools and techniques to make it easier for non-experts to perform the work.
The skilled workers who can perform software localization are often already available, or can be trained
locally or abroad. Regional software localization training and coordination centres could act as clearing-
houses and colleges for individuals to improve their skills, and thereby produce new workers for the
years ahead. Fortunately, only the programmers need to have specialized knowledge of FOSS. The other
professionals can have previous experience with any type of software.
Office space that is sufficient and appropriate for the work at hand is a must for any project where work
is not distributed ad hoc around the world. For a professional localization effort, and especially for
multilingual regional localization centres, a commercial space is best. This includes stable low-cost
broadband connections to the Internet, LAN and development servers, sufficient client computers for
each employee and three or four terminals for each tester.
Active participation and cooperation from universities, especially linguists and translators of English,
should be solicited. Publishing rights for scholars who make significant contributions to technical
dictionaries and standards should be granted, as well as public recognition for student volunteers.
Typically, the following people need to be trained, organized and provided with the tools to succeed:
Project managers technical and translation.
8/12/2019 FOSS - Localization Primer
27/67
Analysts and linguists.
FOSS programmers.
Translators and technical writers.
Testers.
Trainers.
Project management for localization should be split into two jobs: (i) Technical Managers direct the actual
editing of code to ensure proper language support; and (ii) Translation Managers coordinate the creative
efforts of linguists, technical writers and trainers.
Analysts and linguists work together with project managers, sociologists and programme sponsors to
identify the technical challenges to be overcome and the cultural-linguistic requirements to be met.
Their work results in requirement specifications and a project description that the project manager uses
to guide the project to completion. This roadmap guides the programmers in their work, and provides
the benchmark against which the software will be tested. The analysts are also responsible for gathering,
organizing and disseminating the technical standards and specifications required by the programmersto perform their work.
Since both the operating system user interface and various application user interfaces should be localized,
often several different types of programmers will be required. Enthusiasts can perform this work remotely
with others worldwide, but only if the problem has been thoroughly documented by the analysts.
Wherever possible, local programming staff should be used for this stage of the work. The lessons they
learn, and write down for later reference, can be spread to others who are performing localization. They
may also create the technical standards for that language if none exists. Compliance with such FOSS
standards as G11N, I18N, L10N (please see Glossary) and others, will ensure that work proceeds quickly
with the confidence that successive developers can continue to update and improve the software.
Translators and technical writers perform the lions share of the work. All the error messages, buttons,
menus, commands, help files and user guides must be translated. In consultation with linguists for
consistency and accuracy, translators and technical writers compile technical dictionaries, often coining
new technical words and phrases that enable future developers to communicate more effectively with
their colleagues. Just as the technical standards for localization are vital to programmers, the technical
dictionary used by the writers and translators is vital to the projects success.
Testers use the requirement specifications to check the complete work of both the programmers and
technical writers. Their painstaking work identifies errors and inconsistencies to be corrected, and
rechecked, before release to the users of the software. Additional apprentice testers, especially those
who speak no English and who are computer novices, can provide excellent feedback for programmersand translators.
Trainers introduce the localized software to the users. Often, local teachers who have been taught how
to use the system give seminars, answer questions and mentor computer enthusiasts. Local businesses
and governments may also hire trainers to educate their workforce. It is important to ensure that these
software trainers are locally recruited and speak the native language, rather than being English speakers
imported at great expense.
For both proprietary and free software, training on how the software works is essential. To teach local
users how to operate the software, one needs:
Training equipment and materials.
Classrooms.
Instructors.
Most often, developers of the software train the trainer, who then instructs novices to make them
advanced users. Training can be further divided between user training, system administrator training
and developer training. Except for user training, which should be widespread, most specialized FOSS
training takes place in educational institutions. Countries that have advanced quickly in FOSS localization
have all devoted considerable resources to training and education. Without actual adoption of the
software by a large segment of the population, the work of localization is an exercise in futility.
Tools and equipment for FOSS development and localization are less expensive than those required for
proprietary localization. Version control, project management, documentation change management,
and development tool kits for programmers are all available either free of charge or at a low cost. To
Recommendations 19
8/12/2019 FOSS - Localization Primer
28/67
20 FREE/OPEN SOURCE SOFTWARE: LOCALIZATION
work on FOSS, experience shows that it is best to use free/open source tools.
All other equipment, including most development computers, should be up to date, in a secure
environment. A separate budget should be set aside for libraries, references and language tools specific
to the language to be localized. If these materials do not already exist, they must be created.
Wherever possible, information on FOSS localization should be shared with the international FOSS
development community so that the necessary tools do not have to be recreated by every team.
Costs of FOSS Localization
Technically speaking, localizing FOSS costs about as much as localizing commercial software. Only the
techniques of programming are significantly different, since the linguistic and operational challenges
exist no matter what type of software is to be localized. To localize any software, the following are needed:
Office space. Office equipment and tools.
Technical staff.
Access to technical information.
Access to linguists and translators.
The largest cost will be staff salaries. The total cost of a project depends heavily on the wage expectations
of local technical, translation, writing and testing staff, and their individual levels of experience with
software localization, language and cultural issues.
The programmers and project managers probably require a higher-than-average education and salary,
but most of the other staff utilizes skills that are not particular to software and can be found more readily
in the general population.
Trainers are hired when the software is near finalization, and presumably remain employed in teaching
new users, system administrators and developers how to use the software.
For countries seeking independence from proprietary English language software, a permanent local
office whose purpose is to train and disseminate technical information about localization could yield
exponential savings. This establishment could be associated with a public library or university, where
interested parties can access information at little or no cost.
FOSS can often operate well on older computers. This offers advantages to both developed countrieswith an overstock of used computers they must dispose of, and developing countries that can configure
these computers to operate FOSS in the local language.
The total cost of localizing any particular piece of software is highly variable. Each project requires
individual analysis for complexity, experience and availability of technical staff, and the characteristics of
the local language.
Software cost and schedule estimating is not a simple calculation. In addition to a rough estimate based
on the number of message strings to be translated, other factors must be considered.
Experience: Do the programmers, translators and testers have previous experience with thiskind of work? If not, it will require extra time and effort to train them in the processes and
standards of localization. But translators learn very quickly, and productivity increases
dramatically after the first month or two. With a stable team, the members become very
productive.
Environment: Does the staff have the tools and equipment needed to perform the work in a
professional manner? Without modern office space, tools and techniques, it is unrealistic to
expect the staff to perform at top efficiency.
Linguistic factors: How different is the local language from English? Translating from English to
Swedish, for example, is fairly simple. The grammar, length of words and vocabulary is verysimilar. There is near universal fluency in English, and translators are easy to find. On the other
hand, translating from English to Lao is very difficult. The gr