Human language technology
Download
1 / 39

Human Language Technology - PowerPoint PPT Presentation


  • 179 Views
  • Uploaded on

Human Language Technology. Machine Translation Key Issues. Outline. MT = Machine Translation Why MT is important What MT is and why MT is difficult MT and the Human Translator. Why Machine Translation is Important. Implications of Multilinguality. Commerical Interest.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Human Language Technology' - deion


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Human language technology

Human Language Technology

Machine Translation

Key Issues


Outline
Outline

  • MT = Machine Translation

  • Why MT is important

  • What MT is and why MT is difficult

  • MT and the Human Translator

CSA4050 MT I




Commerical interest
Commerical Interest

  • US has invested in MT for intelligence purposes

  • MT is popular on the web - the most used of Google's special features

  • EU spends more that €1B per annum on translation

CSA4050 MT I


Academic interest
Academic Interest

  • Different NL technologies include

    • parsing

    • generation

    • morphology

    • pronoun resolution

    • understanding ...

CSA4050 MT I


Facts about mt
Facts about MT

  • There are many situations where the ability to less than perfect translations is valuable.

  • MT systems can take over some of the boring, repetitive translation jobs

  • ... and allow human translation to concentrate on more interesting specialist tasks.

  • Building an MT system is complex.

CSA4050 MT I


The place for mt
The Place for MT

  • Human Translators are good at:

    • Getting the right turn of phrase

    • Preserving translation equivalence

  • Human Translators are bad at

    • Dictionary look-up

    • Consistency of translation

    • Translation of terminology

  • MT can exploit these weaknesses

CSA4050 MT I


Summary
Summary

MT is important because

  • There are too few human translators

  • Availability of materials in appropriate language has significant economic consequences.

  • Scientifically, it is still one of the best test areas for language technology

CSA4050 MT I


Why translation is difficult

Why Translation is Difficult


What makes mt hard
What Makes MT Hard

  • Style and Meaning

  • Word Order

  • Word Sense

  • Pronouns

  • Tense

  • Idioms

CSA4050 MT I


Style and meaning

As recently as a decade ago it was widely believed that infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

Il y a une dizaine d’annees, on croyait que les pays industrialises etait debarasses des risques lies aux maladies infectieuses et que la sante publique n’etait menacee que par des maladies comme le cancer, les troubles cardiaques, et les anomolies genetiques

Style and Meaning

CSA4050 MT I


Style and meaning1

English infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

Two sentences

infectious disease was no longer much of a threat in the developed world

The remaining challenges to public health there

noninfectious conditions

French

One sentence

les pays industrialises etait debarasses des risques lies aux maladies infectieuses

la sante publique n’etait menacee que

maladies

Style and Meaning

CSA4050 MT I


Different word orders
Different word orders infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • English word order is subject - verb - object

  • Japanese order is subject - object - verb

    • English: IBM bought Lotus

    • Japanese: IBM Lotus bought

    • English: Reporters said IBM bought Lotus

    • Japanese: Reporters IBM Lotus bought said

CSA4050 MT I


Word sense ambiguity
Word Sense Ambiguity infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Bank as in river

  • Bank as in financial insitution

  • Plant as in tree

  • Plant as in factory

  • Different senses usually translate into different words

CSA4050 MT I


Hutchins somers 1992
Hutchins & Somers (1992) infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

CSA4050 MT I


Problems contextual interpretation

OPEN infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

Problems: Contextual Interpretation

OPEN

CSA4050 MT I


Different cultural models
Different Cultural Models infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

English: Health Insurance

German: Krankenversicherung

French: Assurance Maladie

English: validate

French: obliterer

CSA4050 MT I


Differences in marking of semantic information
Differences in Marking infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.of Semantic Information

  • Head marking.

    • In English possessive relation is marked on the head: The man's house

    • In Hungarian it is marked on the dependent:The man house-his

    • his house / sa maison

  • Direction and manner of motion marking

    • He ran into the room (English)

    • He entered the room running (French)

CSA4050 MT I


Summary1
Summary infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Translation is about more than equivalence of meaning.

  • Translation may involve the resolution of ambiguity.

  • Preservation of intention involves cultural background as well as linguistic knowledge.

  • Translation is a hard problem – for humans let alone machines.

CSA4050 MT I


Similarities and differences between languages

Differences infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

Morphology

Word order and syntactic structures

Marking of semantic distinctions

Lexical

Similarities

Communicative function for survival

Mechanisms for reference to people, eating, politeness, time.

Syntactic complexity

Nouns

Verbs

Similarities and Differences Between Languages

CSA4050 MT I


Machine translation and human translators

Machine Translation and Human Translators infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.


In the beginning was the dream of famt
In the Beginning .... infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.was the dream of FAMT

  • Fully Automatic (High Quality) Machine Translation (Bar Hillel 1960)

Source Language text

FAHQMT

TargetLanguage text

CSA4050 MT I


FAMT infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Basic Charactistics

    • No human intervention

    • Arbitrary text

  • Evaluation Criteria

    • Quality of ouput

    • Cost ($/page)

    • Speed (pages/hour)

CSA4050 MT I


Famt success story taum meteo
FAMT Success Story infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.TAUM METEO

  • Written by Chevalier et al. 1978.

  • Translation of weather reports from English to French

  • Highly constrained subset of English:

    • Small number of senses for each word

    • Restricted syntactic constructions

  • System determines whether a given sentence is within its capabilities

  • Very fast, very accurate, no post-editing

CSA4050 MT I


Famt moral
FAMT: MORAL infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • FAMT can work well but only if we give up one or more of the goals e.g.

    • Unrestricted text input

    • High quality translation

  • This observation has lead to research on sub-languages

  • And to the use of FALQT

CSA4050 MT I


Famt is not the only way
FAMT is not the only way infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • FAMT lies at one extreme of a continuum of ways in which technology can be brought to bear upon the translation problem

  • At the other extreme there are word processing software, fax machines, and even mobile phones

  • Between these two extremes there are other points of interest where technology can radically affect the productivity of the individual translator.

CSA4050 MT I


Maht and hamt
MAHT and HAMT infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Machine Aided Human Translation (MAHT)

  • Human Aided Machine Translation (HAMT).

  • The essential difference between these two lies not only in the way in which the person is involved but also in the extent of their involvement

CSA4050 MT I


Maht translation memories
MAHT - Translation Memories infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Systems consist of a database in which each source sentence of a translation is stored together with the target sentence (this is called a translation memory "unit")

  • Any new source sentences will be searched for in the database and a match value is calculated.

  • When the match value is 100%, the translation of the source sentence from the database is inserted into the text being translated.

CSA4050 MT I


Maht translation memories1
MAHT - Translation Memories infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • If the match value is below 100% and above a certain user-definable percentage (i.e., "fuzzy match"), the old translation will be inserted as a translation proposal for the translator to review and edit.

  • Sentences with match values below that margin have to be translated from scratch.

  • New and changed translation proposals will then be stored in the database for future use.

CSA4050 MT I


Maht translation memories advantages
MAHT - Translation Memories – Advantages infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Avoid redoing translation of repeated material

  • Use previous texts as a model for new translations

  • Ensure consistency throughout a translation

CSA4050 MT I


Maht translation memories drawbacks
MAHT - Translation Memories - Drawbacks infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • If terminology changes between projects the content of a TM needs to be updated to reflect these changes.

  • Blind faith in exact matches (without validation) can generate incorrect translation since there is no verification of the context where the new segment is used compared to where the original one was used.

CSA4050 MT I


Maht translation memories remarks
MAHT - Translation Memories - Remarks infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Translation Process: TM tools may not easily fit into existing translation or localization processes: work best where work can be signed off in pieces rather than as a whole.

  • Customisation: rarely works straight out of the box. Menu adaptation, filters to desktop applications may require significant effort.

  • Investment costs are high

  • Setup and maintenance of TMs has to factored in.

  • OpenTag/TMX formats for exchanging TM data between competing systems

CSA4050 MT I


Maht other technology
MAHT – Other Technology infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Communication/coordination amongst translators

  • Integration of internet technologies and web services.

  • Database technology, smart indexing, and networking

  • Improvements can be achieved that are well within the scope of current technology.

CSA4050 MT I


Hamt human assisted machine translation
HAMT – Human Assisted Machine Translation infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Machine retains the initiative but works in collaboration with human consultant.

  • System translates autonomously until it recognises that a linguistic difficulty of a certain type has arisen, e.g.

    • ambiguity

    • pronoun reference

    • unknown word

    • unrecognised construction

  • At this point it seeks help from the consultant.

CSA4050 MT I


Hamt challenges
HAMT – Challenges infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Reliable identification/classification of difficulty.

  • Reliable communication of difficulty to user.

  • Tradeoff between quality and scope of translation.

CSA4050 MT I


Hamt advantages
HAMT - Advantages infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Modulo challenges – a high quality of translation can be guaranteed.

  • Speed – if large sections of text can be translated automatically.

  • Human consultant need not necessarily have all the skills of a human translator; native competence in one or both languages may suffice.

CSA4050 MT I


Summary2
Summary infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Machine Translation is a continuum

    • FAMT

    • HAMT

    • MAHT

  • The utility of a given type of system cannot be assessed with very simple criteria

  • Utlility function involves at least the human cost, the machine cost, the quality of the result, and the nature of the translation requirements.

CSA4050 MT I


Some references
Some References infectious disease was no longer much of a threat in the developed world. The remaining challenges to public health there, it was thought, stemmed from noninfectious conditions such as cancer, heart disease and degenerative diseases.

  • Jonathan Slocum, Machine Translation: its History, Current Status, and Future Prospects, Proc ACL 1984, Stanford University, http://acl.ldc.upenn.edu/P/P84/P84-1116.pdf

  • Martin Kay – Machine Translation, Computational Linguistics vol 11 numbers 2-3 1985.

  • Richard Kittredge – Sublanguages, Computational Linguistics vol 11 numbers 2-3 1985.

CSA4050 MT I


ad