Building the language resource for a Cebuano-Filipino neural machine translation system

College

College of Computer Studies

Department/Unit

Software Technology

Document Type

Conference Proceeding

Source Title

ACM International Conference Proceeding Series

First Page

127

Last Page

132

Publication Date

6-28-2019

Abstract

Parallel corpus is a critical resource in machine learning based translation. The task of collecting, extracting, and aligning texts in order to build an acceptable corpus for doing translation is very tedious most especially for low-resource languages. In this paper, we present the efforts made to build a parallel corpus for Cebuano and Filipino from two different domains: biblical texts and the web. For the biblical resource, subword unit translation for verbs and copy-able approach for nouns were applied to correct inconsistencies in translation. This correction mechanism was applied as a preprocessing technique. On the other hand, for Wikipedia being the main web resource, commonly occurring topic segments were extracted from both the source and the target languages. These observed topic segments are unique in 4 different categories. The identification of these topic segments may be used for automatic extraction of sentences. A Recurrent Neural Network was used to implement the translation using OpenNMT sequence modeling tool in TensorFlow. The two different corpora were then evaluated by using them as two separate inputs in the neural network. Results have shown a difference in BLEU score in both corpora. © 2019 Copyright is held by the owner/author(s). Publication rights licensed to ACM.

html

Digitial Object Identifier (DOI)

10.1145/3342827.3342833

Disciplines

Computer Sciences

Keywords

Cebuano language—Machine translating; Cebuano language—Transliteration into Filipino; Natural language processing (Computer science)

Upload File

wf_yes

This document is currently not available here.

Share

COinS