Carnegie Mellon Christian Monson ParaMor Finding Paradigms Across Morphology Christian Monson

Carnegie Mellon

Christian Monson

ParaMorFinding Paradigms

Across Morphology

Christian Monson

2Carnegie Mellon

Christian Monson

Turkish Morphology – Beads on a String

take passive negativepresent

progressive2nd person singular

You are not being taken

3Carnegie Mellon

Christian Monson

götür ül m sunüyor

progressive

You are not being taken

2nd person singular

Turkish Morphology – Beads on a String

4Carnegie Mellon

Christian Monson

Applications of Computational Morphology

• Machine Translation– Turkish-English (Oflazer, 2007)

– Czech-English (Goldwater and McClosky, 2005)

• Speech Recognition– Finnish (Creutz, 2006)

• Information Retrieval

5Carnegie Mellon

Christian Monson

Challenges of Computational Morphology

• Time Consuming for a New Language– Kemal Oflazer estimates

• 3-4 months to build basic Turkish analyzer• Plus lexicon development and maintenance

• Expertise Needed– Greenlandic

• Official language of Greenland• Agglutinative Inuit language• 50,000 speakers• Per Langaard

6Carnegie Mellon

Christian Monson

The SolutionRaw Text

Unsupervised Morphology

Induction

7Carnegie Mellon

Christian Monson

ParaMor – Paradigm MorphologyParaMor

IdentifySearchClusterFilter

SegmentEvaluationResults• ParaMor

– Unsupervised morphology induction system

• Paradigm– The natural structure of morphology

8Carnegie Mellon

Christian Monson

Paradigms – The Structure of Morphology

ül m sunüyor

progressive2nd person singular

Stem Voice PolarityTense &

MoodPerson & Number

götür

9Carnegie Mellon

Christian Monson

ül m umüyor

MoodPerson & Number

progressive 1st person singular

umgötür

10Carnegie Mellon

Christian Monson

ül m umüyor

MoodPerson & Number

progressive3rd person singular

götür

11Carnegie Mellon

Christian Monson

ül m umüyor

MoodPerson & Number

progressive

1st person plural

umØuz

götür

12Carnegie Mellon

Christian Monson

ül m umüyor

MoodPerson & Number

progressive

umØuz

götür

13Carnegie Mellon

Christian Monson

ül m umüyor

MoodPerson & Number

take passive negativefuture

umØuz

yecekgötür

14Carnegie Mellon

Christian Monson

ül m umüyor

MoodPerson & Number

take passive negative

umØuz

yecekgötür

15Carnegie Mellon

Christian Monson

ül m umüyor

MoodPerson & Number

umØuz

16Carnegie Mellon

Christian Monson

ül m umüyorumØuz

Paradigms

17Carnegie Mellon

Christian Monson

ül m umüyorumØuz

Paradigms

• Paradigm– Set of mutually replaceable strings

18Carnegie Mellon

Christian Monson

ül m umüyorumØuz

Paradigm

• Paradigm– Set of mutually replaceable strings

19Carnegie Mellon

Christian Monson

The ParaMor AlgorithmParaMor

SegmentEvaluationResults

• Identify suffix paradigms in 3 steps

20Carnegie Mellon

Christian Monson

• Identify suffix paradigms in 3 steps1.Search for candidate paradigms

21Carnegie Mellon

Christian Monson

2.Cluster candidates modeling the same paradigm

22Carnegie Mellon

Christian Monson

The ParaMor Algorithm

3.Filter

ParaMorIdentify

SearchClusterFilter

23Carnegie Mellon

Christian Monson

The ParaMor Algorithm

3.Filter

• Segment words – Using the discovered paradigms

ParaMorIdentify

SearchClusterFilter

24Carnegie Mellon

Christian Monson

ParaMorIdentify

SearchClusterFilter

Search for Candidate Paradigms

• All character boundaries are candidate morpheme boundaries

25Carnegie Mellon

Christian Monson

s10662

ParaMorIdentify

SearchClusterFilter

autorizacionesbuscabamos

costasimportadoras

vallas…

• Begin search with the most frequent word-final string

Spanish

26Carnegie Mellon

Christian Monson

s10662

ParaMorIdentify

SearchClusterFilter

autorizacionesbuscabamos

costasimportadoras

vallas…

Ø s5501

• Identify the most frequent mutually replaceable string– Stems that occur with one

suffix in a paradigm will likely occur with other suffixes in that paradigm Spanish

27Carnegie Mellon

Christian Monson

s10662

ParaMorIdentify

SearchClusterFilter

• Stop adding suffixes – When the most frequent mutually

replaceable string severly decreases the stem count.

Ø s5501

Ø r s

287autorizaciones

buscabamoscostas

importadorasvallas

28Carnegie Mellon

Christian Monson

s10662

ParaMorIdentify

SearchClusterFilter

• Move on to the next most frequent word-final string

Ø s5501

Ø r s

29Carnegie Mellon

Christian Monson

s10662

a o2304

a o os

a as o os892

Ø s5501

Ø r s

ParaMorIdentify

SearchClusterFilter

30Carnegie Mellon

Christian Monson

s10662

Ø n1874

Ø n r

Ø do n r354

Ø da das do dos n ndo r ron

a o2304

a o os

a as o os892

Ø s5501

Ø r s

ParaMorIdentify

SearchClusterFilter

31Carnegie Mellon

Christian Monson

s10662

Ø n1874

Ø n r

Ø do n r354

a o2304

a o os

a as o os892

Ø s5501

es2751

Ø es874

Ø r s

ParaMorIdentify

SearchClusterFilter

32Carnegie Mellon

Christian Monson

an1786

s10662

a an1049

a an ar

a an ar ó353

a ada adas ado ados an

ar aron ó149

Ø n1874

Ø n r

Ø do n r354

a o2304

a o os

a as o os892

Ø s5501

es2751

Ø es874

Ø r s

ParaMorIdentify

SearchClusterFilter

33Carnegie Mellon

Christian Monson

...strado

15rado167

an1786

s10662

a an1049

a an ar

a an ar ó353

a ada adas ado ados an

ar aron ó149

rada radas rado rados

rada radorados

rada rado89

ra rada radasrado rados ran

rar raron ró23

Ø n1874

Ø n r

Ø do n r354

a o2304

a o os

a as o os892

Ø s5501

strada strado12

strada strado stró

strada strado strar stró

strada stradas strado strar stró

es2751

Ø es874

Ø r s

ParaMorIdentify

SearchClusterFilter

34Carnegie Mellon

Christian Monson

Cluster Candidates per Paradigm

15: a aba ada adas ado ados an ando ar aron arse ará arán aría ó22 Stems: anunci, aplic, apoy, celebr, concentr, …

330 Covered Types

15: a aba ada adas ado ados an ando ar ara aron arse ará arán ó23 Stems: anunci, apoy, confirm, consider, declar, …

345 Covered Types

ParaMorIdentify

SearchClusterFilter

35Carnegie Mellon

Christian Monson

330 Covered Types

345 Covered Types

16: a aba ada adas ado ados an ando ar ara aron arse ará arán aría óCosine Similarity: 0.664

451 Covered Types

ParaMorIdentify

SearchClusterFilter

36Carnegie Mellon

Christian Monson

15: a aba aban ada adas ado ados an ando ar aron arse ará arán ó25 Stems: anunci, aplic, apoy, celebr, consider, …

375 Covered Types

330 Covered Types

345 Covered Types

451 Covered Types

ParaMorIdentify

SearchClusterFilter

37Carnegie Mellon

Christian Monson

15: a aba aban ada adas ado ados an ando ar aron arse ará arán ó25 Stems: anunci, aplic, apoy, celebr, consider, …

375 Covered Types

330 Covered Types

345 Covered Types

451 Covered Types

17: a aba aban ada adas ado ados an ando ar ara aron arse ará arán aría óCosine Similarity: 0.715

532 Covered Types

ParaMorIdentify

SearchClusterFilter

38Carnegie Mellon

Christian Monson

Filter Candidate ParadigmsParaMor

• 2 types of filtering1. Remove small unclustered

candidate paradigms

2. Remove candidates modeling unlikely morpheme boundaries (Harris, 1955)

39Carnegie Mellon

Christian Monson

Segment Words Using ParadigmsParaMor

administradas

40Carnegie Mellon

Christian Monson

administradas

a ada adas ado ados an ar aron ó ...

41Carnegie Mellon

Christian Monson

administradas

administrada

42Carnegie Mellon

Christian Monson

administradas

administr +adas

administrada

43Carnegie Mellon

Christian Monson

administradas

administr +adas

a as o os

administrada

44Carnegie Mellon

Christian Monson

administradas

administr +adas, administrad +as

a as o os

administrada

Old way: Separate alternative analysis

45Carnegie Mellon

Christian Monson

administradas

administr +adas, administrad +as

a as o os

administrada

administr +ad +as New way: Augment the current segmentation

46Carnegie Mellon

Christian Monson

administradas

administr +ad +a +s

administradaØ

administr +adas, administrad +as, administrada +s

47Carnegie Mellon

Christian Monson

Morpho Challenge 2007ParaMor

• Peer operated competition – For unsupervised morphology

induction algorithms

• 4 languages– English– German– Finnish– Turkish

48Carnegie Mellon

Christian Monson

ParaMor in Morpho Challenge 2007ParaMor

• Developed on Spanish – ParaMor’s free parameters were

frozen

49Carnegie Mellon

Christian Monson

2 Methods of EvaluationParaMor

1. LinguisticSegmentations compared to a morphologically analyzed lexicon

Analysis Answer

administradas administr +ad +a +s administrar +Adj +Fem +Pl

administrada administr +ad +a administrar +Adj +Fem

50Carnegie Mellon

Christian Monson

1. LinguisticSegmentations compared to a morphologically analyzed lexicon

Analysis Answer

administradas administr +ad +a +s administrar +Adj +Fem +Pl

administrada administr +ad +a administrar +Adj +Fem

51Carnegie Mellon

Christian Monson

2. Task basedInformation retrieval– Short two-sentence queries– About international news topics – Binary relevance assessments – About 50 queries and 20K

relevance judgements for each language.

52Carnegie Mellon

Christian Monson

English German Finnish Turkish

Linguistic Evaluation

ParaMorIdentify

SearchClusterFilter

53Carnegie Mellon

Christian Monson

ParaMorIdentify

SearchClusterFilter

54Carnegie Mellon

Christian Monson

ParaMorIdentify

SearchClusterFilter

or47.2

50.6 50.7

55Carnegie Mellon

Christian Monson

ParaMorIdentify

SearchClusterFilter

56Carnegie Mellon

Christian Monson

ParaMorIdentify

SearchClusterFilter

57Carnegie Mellon

Christian Monson

ParaMorIdentify

SearchClusterFilter

56.352.9 53.4

58Carnegie Mellon

Christian Monson

ParaMorIdentify

SearchClusterFilter

56.352.9

59Carnegie Mellon

Christian Monson

ParaMorIdentify

SearchClusterFilter

56.352.9

48.2 48.5

60Carnegie Mellon

Christian Monson

ParaMorIdentify

SearchClusterFilter

56.352.9

48.2 48.5

61Carnegie Mellon

Christian Monson

English German Finnish

IR Evaluation (TF/IDF)

Average PrecisionM

ParaMorIdentify

SearchClusterFilter

27.0 – No Morphological Analysis

62Carnegie Mellon

Christian Monson

Average PrecisionM

ParaMorIdentify

SearchClusterFilter

aMor 27.0 – No Morphological Analysis

28.9 29.3

63Carnegie Mellon

Christian Monson

Average PrecisionM

ParaMorIdentify

SearchClusterFilter

. 30.7 – No Morphological Analysis28.9 29.3

64Carnegie Mellon

Christian Monson

Average PrecisionM

ParaMorIdentify

SearchClusterFilter

. 30.7 – No Morphological Analysis28.9 29.3

38.3 38.2

65Carnegie Mellon

Christian Monson

Average PrecisionM

ParaMorIdentify

SearchClusterFilter

32.0 – No Morphological Analysis

28.9 29.3

38.8 38.2

66Carnegie Mellon

Christian Monson

ParaMor: State-of-the-Art Unsupervised Morphology Induction System

• Combined system among the best in Morpho Challenge 2007

• Consistent across languages

• Better than no morphology– Task based (IR) measure

67Carnegie Mellon

Christian Monson

Many Future Directions

• Improve Performance– F1 of 50-60% is state-of-the-art!

– Inflection classes– Morphophonology

• Beyond beads-on-a-string

68Carnegie Mellon

Christian Monson

Carnegie Mellon Christian Monson ParaMor Finding Paradigms Across Morphology Christian Monson

Documents

Statistical Digital Signal Proc - Monson H. Hayes

Dianna Monson Tolotti - UFSM

President Monson Quotes

[Monson H. Hayes] Statistical Digital Signal Processing

President Thomas S. Monson

Advanced Organic Synthesis (Monson-1971)

MonsonPeer Review – 24 October 2013 SPP/FIELDS LNPS PEER REVIEW Steven Monson University of Minnesota monson@waves.space.umn.edu 1

Arizona Homeowner presented by Mark Monson

Monson Public Schools A Community of Learners October 6, 2010First Public Forum Monson Public School’s Restructuring Proposal First Public Forum October

Full page photo - wrestlingmad.com · Chad Litt [e-STMÅ Chad (BYE) BYE Little- STMA Chad Little- ... Danny Monson-MW 126 37Ø (Champion) BSM Danny Monson (T :4.56) 44 Danny Monson-MW

Wilbraham & Monson Academy - WMAF).2014.pdf · Wilbraham & Monson Academy was established by the merger of two early nineteenth-century academies: Monson Academy, founded in 1804,

Building NLP Systems for Two Resource Scarce Indigenous Languages: Mapudungun and Quechua, and some other languages Christian Monson, Ariadna Font Llitjós,

richard and monson advanced organic synthesis

Evaluating an Agglutinative Segmentation Model for ParaMor

Monson Riffs

PARAMOR:cmonson/Thesis/Thesis-Ch1-Ch3-2008-11-19.doc · Web viewfrom Paradigm Structure to Natural Language Morphology Induction Christian Monson Language Technologies Institute School

MonsonFIELDS iPDR – LNPS SPP/FIELDS Low Noise Power Supply Preliminary Design Review Steve Monson University of Minnesota monson@waves.space.umn.edu 1

Canadian History Final Summative - Bram Monson

Craft to Heal with Nancy Monson

Eric E Monson, Text->Data 08 Nov 2012