Search Results for author: Yanxun Xu

Found 7 papers, 1 papers with code

TransformerLSR: Attentive Joint Model of Longitudinal Data, Survival, and Recurrent Events with Concurrent Latent Structure

no code implementations4 Apr 2024 Zhiyue Zhang, Yao Zhao, Yanxun Xu

However, current methods only address joint modeling of longitudinal measurements at regularly-spaced observation times and survival events, neglecting recurrent events.

Epidemiology Point Processes

MoMA: Model-based Mirror Ascent for Offline Reinforcement Learning

no code implementations21 Jan 2024 Mao Hong, Zhiyue Zhang, Yue Wu, Yanxun Xu

Model-based offline reinforcement learning methods (RL) have achieved state-of-the-art performance in many decision-making problems thanks to their sample efficiency and generalizability.

Decision Making Offline RL +1

A Policy Gradient Method for Confounded POMDPs

no code implementations26 May 2023 Mao Hong, Zhengling Qi, Yanxun Xu

To the best of our knowledge, this is the first work studying the policy gradient method for POMDPs under the offline setting.

Offline Reinforcement Learning with Instrumental Variables in Confounded Markov Decision Processes

no code implementations18 Sep 2022 Zuyue Fu, Zhengling Qi, Zhaoran Wang, Zhuoran Yang, Yanxun Xu, Michael R. Kosorok

Due to the lack of online interaction with the environment, offline RL is facing the following two significant challenges: (i) the agent may be confounded by the unobserved state variables; (ii) the offline data collected a prior does not provide sufficient coverage for the environment.

Offline RL reinforcement-learning +1

Personalized Dynamic Treatment Regimes in Continuous Time: A Bayesian Approach for Optimizing Clinical Decisions with Timing

no code implementations8 Jul 2020 William Hua, Hongyuan Mei, Sarah Zohar, Magali Giral, Yanxun Xu

In the second step, we propose a policy gradient method to learn the personalized optimal clinical decision that maximizes the patient survival by interacting the MTPP with the model on clinical observations while accounting for uncertainties in clinical observations learned from the posterior inference of the Bayesian joint model in the first step.

Methodology

A Bayesian Nonparametric Approach for Estimating Individualized Treatment-Response Curves

no code implementations18 Aug 2016 Yanbo Xu, Yanxun Xu, Suchi Saria

We study the problem of estimating the continuous response over time to interventions using observational time series---a retrospective dataset where the policy by which the data are generated is unknown to the learner.

Decision Making Kidney Function +2

Cannot find the paper you are looking for? You can Submit a new open access paper.