Probing for Incremental Parse States in Autoregressive Language Models

1 code implementation • 17 Nov 2022 • Tiwalayo Eisape, Vineet Gangireddy, Roger P. Levy, Yoon Kim

This suggests implicit incremental syntactic inferences underlie next-word predictions in autoregressive neural language models.

Sentence