Tracing and Manipulating Intermediate Values in Neural Math Problem Solvers

1 code implementation • 17 Jan 2023 • Yuta Matsumoto, Benjamin Heinzerling, Masashi Yoshikawa, Kentaro Inui

Previous research has shown that information about intermediate values of these inputs can be extracted from the activations of the models, but it is unclear where that information is encoded and whether that information is indeed used during inference.

Math