no code implementations • LREC 2022 • Kento Tanaka, Taichi Nishimura, Hiroaki Nanjo, Keisuke Shirai, Hirotaka Kameko, Masatake Dantsuji
We focus on image description and a corresponding assessment system for language learners.
no code implementations • 25 Mar 2024 • Keyaki Ohno, Hirotaka Kameko, Keisuke Shirai, Taichi Nishimura, Shinsuke Mori
By utilizing hyperlinks, we can accurately assign location expressions with coordinates even with ambiguous location expressions in the texts.
1 code implementation • 2 Nov 2023 • Keisuke Shirai, Cristian C. Beltran-Hernandez, Masashi Hamaya, Atsushi Hashimoto, Shohei Tanaka, Kento Kawaharazuka, Kazutoshi Tanaka, Yoshitaka Ushiku, Shinsuke Mori
By generating PDs from language instruction and scene observation, we can drive symbolic planners in a language-guided framework.
no code implementations • 31 May 2023 • Keisuke Shirai, Hirotaka Kameko, Shinsuke Mori
In this work, we propose a framework based on the recipe FG for flow graph prediction of open-domain procedural texts.
no code implementations • COLING 2022 • Keisuke Shirai, Atsushi Hashimoto, Taichi Nishimura, Hirotaka Kameko, Shuhei Kurita, Yoshitaka Ushiku, Shinsuke Mori
We present a new multimodal dataset called Visual Recipe Flow, which enables us to learn each cooking action result in a recipe text.
no code implementations • 28 Dec 2020 • Keisuke Shirai, Kazuma Hashimoto, Akiko Eriguchi, Takashi Ninomiya, Shinsuke Mori
In this paper, we propose to suppress an arbitrary type of errors by training the text generation model in a reinforcement learning framework, where we use a trainable reward function that is capable of discriminating between references and sentences containing the targeted type of errors.