Sequential Hypothesis Testing Under Stochastic Deadlines

Abstract

Most models of decision-making in neuroscience assume an infinite horizon, which yields an optimal solution that integrates evidence up to a fixed decision threshold; however, under most experimental as well as naturalistic behavioral settings, the decision has to be made before some finite deadline, which is often experienced as a stochastic quantity, either due to variable external constraints or internal timing uncertainty. In this work, we formulate this problem as sequential hypothesis testing under a stochastic horizon. We use dynamic programming tools to show that, for a large class of deadline distributions, the Bayes-optimal solution requires integrating evidence up to a threshold that declines monotonically over time. We use numerical simulations to illustrate the optimal policy in the special cases of a fixed deadline and one that is drawn from a gamma distribution.

Cite

Text

Frazier and Yu. "Sequential Hypothesis Testing Under Stochastic Deadlines." Neural Information Processing Systems, 2007.

Markdown

[Frazier and Yu. "Sequential Hypothesis Testing Under Stochastic Deadlines." Neural Information Processing Systems, 2007.](https://mlanthology.org/neurips/2007/frazier2007neurips-sequential/)

BibTeX

@inproceedings{frazier2007neurips-sequential,
  title     = {{Sequential Hypothesis Testing Under Stochastic Deadlines}},
  author    = {Frazier, Peter and Yu, Angela J.},
  booktitle = {Neural Information Processing Systems},
  year      = {2007},
  pages     = {465-472},
  url       = {https://mlanthology.org/neurips/2007/frazier2007neurips-sequential/}
}