no code implementations • WMT (EMNLP) 2020 • Akifumi Nakamachi, Hiroki Shimanaka, Tomoyuki Kajiwara, Mamoru Komachi
We introduce the TMUOU submission for the WMT20 Quality Estimation Shared Task 1: Sentence-Level Direct Assessment.
no code implementations • LREC 2020 • Reo Hirao, Mio Arai, Hiroki Shimanaka, Satoru Katsumata, Mamoru Komachi
In this study, we created an automated essay scoring (AES) system for nonnative Japanese learners using an essay dataset with annotations for a holistic score and multiple trait scores, including content, organization, and language scores.
no code implementations • WS 2019 • Ryoma Yoshimura, Hiroki Shimanaka, Yukio Matsumura, Hayahide Yamagishi, Mamoru Komachi
We use the outputs of off-the-shelf MT systems as pseudo-references filtered by paraphrasing in addition to a single human reference (gold reference).
no code implementations • 29 Jul 2019 • Hiroki Shimanaka, Tomoyuki Kajiwara, Mamoru Komachi
We introduce the metric using BERT (Bidirectional Encoder Representations from Transformers) (Devlin et al., 2019) for automatic machine translation evaluation.
1 code implementation • WS 2018 • Hiroki Shimanaka, Tomoyuki Kajiwara, Mamoru Komachi
We introduce the RUSE metric for the WMT18 metrics shared task.
no code implementations • NAACL 2018 • Hiroki Shimanaka, Tomoyuki Kajiwara, Mamoru Komachi
Sentence representations can capture a wide range of information that cannot be captured by local features based on character or word N-grams.