Journal
PHARMACEUTICAL STATISTICS
Volume 21, Issue 4, Pages 729-739Publisher
WILEY
DOI: 10.1002/pst.2216
Keywords
backward induction; decision problem; reinforcement learning; sequential design
Categories
Funding
- Division of Mathematical Sciences [NSF/DMS 1952679]
Ask authors/readers for more resources
In this paper, we review some simulation-based methods for implementing optimal decisions in sequential design problems that arise in clinical trial design. Using a simplified version of a dose-ranging design in the ASTIN trial as a motivating example, we characterize the approach as constrained backward induction. The constraint involves restricting decisions to a set of actions that are implicitly functions of the current history through a low-dimensional summary statistic.
We review some simulation-based methods to implement optimal decisions in sequential design problems as they naturally arise in clinical trial design. As a motivating example we use a stylized version of a dose-ranging design in the ASTIN trial. The approach can be characterized as constrained backward induction. The nature of the constraint is a restriction of the decisions to a set of actions that are functions of the current history only implicitly through a low-dimensional summary statistic. In addition, the action set is restricted to time-invariant policies. Time-dependence is only introduced indirectly through the change of the chosen summary statistic over time. This restriction allows computationally efficient solutions to the sequential decision problem. A further simplification is achieved by restricting optimal actions to be described by decision boundaries on the space of such summary statistics.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available