Neuro-algorithmic Policies for Discrete Planning
Although model-based and model-free approaches to learning control of systems have achieved impressive results on standard benchmarks, most have been shown to be lacking in their generalization capabilities. These methods usually require sampling an exhaustive amount of data from different environment configurations. We introduce a neuro-algorithmic policy architecture with the ability to plan consisting of a model working in unison with a shortest path solver to predict trajectories with low way-costs. These policies can be trained end-to-end by blackbox differentiation. We show that this type of hybrid architectures generalize well to unseen environment configurations. https://sites.google.com/view/neuro-algorithmic
PDF Abstract
ProcGen
