Evaluating the English-Turkish parallel treebank for machine translation

Name: Evaluating the English-Turkish parallel treebank for machine translation
Author: Görgün, O., Yıldız, Olcay Taner

İsim	Evaluating the English-Turkish parallel treebank for machine translation
Yazar	Görgün, O., Yıldız, Olcay Taner
Basım Tarihi:	2022
Basım Yeri	- TÜBİTAK
Konu	Parallel treebank, Parallel corpora, Turkish, English, Syntax-based
Tür	Süreli Yayın
Dil	İngilizce
Dijital	Evet
Yazma	Hayır
Kütüphane:	Özyeğin Üniversitesi
Demirbaş Numarası	1300-0632
Kayıt Numarası	c0e97190-d786-46f3-9dfc-acc618b4ec82
Lokasyon	Computer Science
Tarih	2022
Notlar	TÜBİTAK
Örnek Metin	This study extends our initial efforts in building an English-Turkish parallel treebank corpus for statistical machine translation tasks. We manually generated parallel trees for about 17K sentences selected from the Penn Treebank corpus. English sentences vary in length: 15 to 50 tokens including punctuation. We constrained the translation of trees by (i) reordering of leaf nodes based on suffixation rules in Turkish, and (ii) gloss replacement. We aim to mimic human annotator’s behavior in real translation task. In order to fill the morphological and syntactic gap between languages, we do morphological annotation and disambiguation. We also apply our heuristics by creating Nokia English-Turkish Treebank (NTB) to address technical document translation tasks. NTB also includes 8.3K sentences in varying lengths. We validate the corpus both extrinsically and intrinsically, and report our evaluation results regarding perplexity analysis and translation task results. Results prove that our heuristics yield promising results in terms of perplexity and are suitable for translation tasks in terms of BLEU scores.
DOI	10.3906/elk-2102-57
Cilt	30

Kaynağa git Özyeğin Üniversitesi

Aramaya Dön

Özyeğin Üniversitesi

Kaynağa git

Evaluating the English-Turkish parallel treebank for machine translation

Yazar Görgün, O., Yıldız, Olcay Taner

Basım Tarihi 2022

Basım Yeri - TÜBİTAK

Konu Parallel treebank, Parallel corpora, Turkish, English, Syntax-based

Tür Süreli Yayın

Dil İngilizce

Dijital Evet

Yazma Hayır

Kütüphane Özyeğin Üniversitesi

Demirbaş Numarası 1300-0632

Kayıt Numarası c0e97190-d786-46f3-9dfc-acc618b4ec82

Lokasyon Computer Science

Tarih 2022

Notlar TÜBİTAK

Örnek Metin This study extends our initial efforts in building an English-Turkish parallel treebank corpus for statistical machine translation tasks. We manually generated parallel trees for about 17K sentences selected from the Penn Treebank corpus. English sentences vary in length: 15 to 50 tokens including punctuation. We constrained the translation of trees by (i) reordering of leaf nodes based on suffixation rules in Turkish, and (ii) gloss replacement. We aim to mimic human annotator’s behavior in real translation task. In order to fill the morphological and syntactic gap between languages, we do morphological annotation and disambiguation. We also apply our heuristics by creating Nokia English-Turkish Treebank (NTB) to address technical document translation tasks. NTB also includes 8.3K sentences in varying lengths. We validate the corpus both extrinsically and intrinsically, and report our evaluation results regarding perplexity analysis and translation task results. Results prove that our heuristics yield promising results in terms of perplexity and are suitable for translation tasks in terms of BLEU scores.

DOI 10.3906/elk-2102-57

Cilt 30