Technical details

Mantra is an automatic Manga translation system based on text recognition and machine translation technologies. Despite recent advances of machine learning methods for machine translation and text recognition, automatic Manga translation is still a challenging task. The major reasons are: 1) large parallel corpus for Manga is unavailable, 2) Manga text includes various fonts and distortion. Mantra solves these problems by two novel techniques. First, Mantra automatically extract parallel corpora from published Manga. It learns to translate Manga-specific expressions from these corpora. Second, Mantra learns a robust text recognition model by using synthetically generating data with various fonts and distortion as training data. Combination of these two technologies enables high-quality Manga translation.

Exhibition content

Mantra is Manga automatic translation system. In the exhibition, we show the demo of translating Japanese Manga to English.