no code implementations • 25 Feb 2024 • Masanari Ohi, Masahiro Kaneko, Ryuto Koike, Mengsay Loem, Naoaki Okazaki
In this paper, we investigate the presence and impact of likelihood bias in LLM-based evaluators.
1 code implementation • 14 Nov 2023 • Ryuto Koike, Masahiro Kaneko, Naoaki Okazaki
Furthermore, our analysis indicates that the high instruction-following ability of LLMs fosters the large impact of such constraints on detection performance.
1 code implementation • 21 Jul 2023 • Ryuto Koike, Masahiro Kaneko, Naoaki Okazaki
Experiments in the domain of student essays show that the proposed detector improves the detection performance on the attacker-generated texts by up to +41. 3 points F1-score.