Embed Size (px)
DESCRIPTION
This presentation is a part of the MosesCore project that encourages the development and usage of open source machine translation tools, notably the Moses statistical MT toolkit. MosesCore is supported by the European Commission Grant Number 288487 under the 7th Framework Programme. For the latest updates, follow us on Twitter - #MosesCore
Citation preview
TAUS OPEN SOURCE MACHINE TRANSLATION SHOWCASE
Moses inside Symantec14:00-14:20Monday 4 June
Fred HollowoodSymantec
Moses inside Symantec
Fred HollowoodResearch Director
Why look at Moses?
MosesCore Workshop June 4th 2012 3
Broad Domain
MosesCore June 4th 2012 4
Forum Translation (User Generated Content)
MosesCore June 4th 2012 5
Automatic Scores
MosesCore June 4th 2012 6
German Engines BLEU GTM Meteor TER
CSMT 0.32 0.39 0.28 0.60MS2 0.34 0.44 0.32 0.57CSYS6 0.31 0.41 0.27 0.63VICTOR 0.30 0.39 0.24 0.65
French Engines BLEU GTM Meteor TER
CSMT 0.40 0.45 0.21 0.56MS2 0.39 0.46 0.21 0.54CSYS6 0.35 0.42 0.17 0.61VICTOR 0.37 0.43 0.19 0.58
http://symeval.sourceforge.net
Comprehensibility Scores – Human Evaluation
MosesCore June 4th 2012 7
0%10%20%30%40%50%60%70%80%90%
100%
Victor 1 Systran6 MS Translator
5
4
3
2
1
Comprehensibility Scores – Human Evaluation
MosesCore June 4th 2012 8
0%10%20%30%40%50%60%70%80%90%
100%
Victor1 Systran6 MS Translator
5
4
3
2
1
Human Evaluation
en-de Mono. Comp. Bil. Comp. Bil. Fid. Bil. Combined
Human 4.63 4.68 0.98 5.67CSMT (3) 2.37 2.32 0.39 2.71MS2 (1) 2.60 2.63 0.55 3.18
CSYS6 (2) 2.45 2.50 0.47 2.97VICTOR (4) 2.21 2.21 0.31 2.52
en-frHuman 4.43 4.37 0.97 5.34CSMT 2.35 2.44 0.43 2.87MS2 2.45* 2.48^ 0.45 2.93`
CSYS6 2.36 2.40 0.44 2.85VICTOR 2.37 2.38 0.38^ 2.75`
MosesCore June 4th 2012 9
Perceptions from Technical Support
MosesCore June 4th 2012 10
Automated Community Content Editing PorTal The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 288769.
MosesCore June 4th 2012 11
Starting Date: January 2012 Duration: 36 months
Thank you!
Copyright © 2011 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners.
This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.
MosesCore June 4th 2012 12
Fred [email protected]
