Search Results for author: Joseph Jay Williams

Found 12 papers, 2 papers with code

Opportunities for Adaptive Experiments to Enable Continuous Improvement that Trades-off Instructor and Researcher Incentives

no code implementations18 Oct 2023 Ilya Musabirov, Angela Zavaleta-Bernuy, Pan Chen, Michael Liut, Joseph Jay Williams

In adaptive experiments, as different arms/conditions are deployed to students, data is analyzed and used to change the experience for future students.

Decision Making

Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perception

no code implementations13 Oct 2023 Harsh Kumar, Ilya Musabirov, Mohi Reza, Jiakai Shi, Xinyuan Wang, Joseph Jay Williams, Anastasia Kuzminykh, Michael Liut

Personalized chatbot-based teaching assistants can be crucial in addressing increasing classroom sizes, especially where direct teacher presence is limited.

Chatbot

Getting too personal(ized): The importance of feature choice in online adaptive algorithms

no code implementations6 Sep 2023 ZhaoBin Li, Luna Yee, Nathaniel Sauerberg, Irene Sakson, Joseph Jay Williams, Anna N. Rafferty

We explore these issues in the context of using multi-armed bandit (MAB) algorithms to learn a policy for what version of an educational technology to present to each student, varying the relation between student characteristics and outcomes and also whether the algorithm is aware of these characteristics.

Contextual Bandits in a Survey Experiment on Charitable Giving: Within-Experiment Outcomes versus Policy Learning

no code implementations22 Nov 2022 Susan Athey, Undral Byambadalai, Vitor Hadad, Sanath Kumar Krishnamurthy, Weiwen Leung, Joseph Jay Williams

We design and implement an adaptive experiment (a ``contextual bandit'') to learn a targeted treatment assignment policy, where the goal is to use a participant's survey responses to determine which charity to expose them to in a donation solicitation.

Multi-Armed Bandits

Using Adaptive Experiments to Rapidly Help Students

no code implementations10 Aug 2022 Angela Zavaleta-Bernuy, Qi Yin Zheng, Hammad Shaikh, Jacob Nogas, Anna Rafferty, Andrew Petersen, Joseph Jay Williams

Adaptive experiments can increase the chance that current students obtain better outcomes from a field experiment of an instructional intervention.

Thompson Sampling

Increasing Students' Engagement to Reminder Emails Through Multi-Armed Bandits

no code implementations10 Aug 2022 Fernando J. Yanez, Angela Zavaleta-Bernuy, Ziwen Han, Michael Liut, Anna Rafferty, Joseph Jay Williams

We highlight problems with these adaptive algorithms - such as possible exploitation of an arm when there is no significant difference - and address their causes and consequences.

Management Multi-Armed Bandits +1

Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventions

no code implementations4 Mar 2022 Nina Deliu, Joseph Jay Williams, Bibhas Chakraborty

In recent years, reinforcement learning (RL) has acquired a prominent position in the space of health-related sequential decision-making, becoming an increasingly popular tool for delivering adaptive interventions (AIs).

Causal Inference Decision Making +3

Challenges in Statistical Analysis of Data Collected by a Bandit Algorithm: An Empirical Exploration in Applications to Adaptively Randomized Experiments

no code implementations22 Mar 2021 Joseph Jay Williams, Jacob Nogas, Nina Deliu, Hammad Shaikh, Sofia S. Villar, Audrey Durand, Anna Rafferty

We therefore use our case study of the ubiquitous two-arm binary reward setting to empirically investigate the impact of using Thompson Sampling instead of uniform random assignment.

Thompson Sampling

Sequential Explanations with Mental Model-Based Policies

no code implementations17 Jul 2020 Arnold YS Yeung, Shalmali Joshi, Joseph Jay Williams, Frank Rudzicz

The act of explaining across two parties is a feedback loop, where one provides information on what needs to be explained and the other provides an explanation relevant to this information.

Combining Difficulty Ranking with Multi-Armed Bandits to Sequence Educational Content

no code implementations14 Apr 2018 Avi Segal, Yossi Ben David, Joseph Jay Williams, Kobi Gal, Yaar Shalom

We present a new computational approach to this problem called MAPLE (Multi-Armed Bandits based Personalization for Learning Environments) that combines difficulty ranking with multi-armed bandits.

Multi-Armed Bandits

Cannot find the paper you are looking for? You can Submit a new open access paper.