Decision-Dependent Risk Minimization in Geometrically Decaying Dynamic Environments

Abstract

This paper studies the problem of expected loss minimization given a data distribution that is dependent on the decision-maker's action and evolves dynamically in time according to a geometric decay process. Novel algorithms for both the information setting in which the decision-maker has a first order gradient oracle and the setting in which they have simply a loss function oracle are introduced. The algorithms operate on the same underlying principle: the decision-maker deploys a fixed decision repeatedly over the length of an epoch, thereby allowing the dynamically changing environment to sufficiently mix before updating the decision. The iteration complexity in each of the settings is shown to match existing rates for first and zero order stochastic gradient methods up to logarithmic factors. The algorithms are evaluated on a ``semi-synthetic" example using real world data from the SFpark dynamic pricing pilot study; it is shown that the announced prices result in an improvement for the institution's objective (target occupancy), while achieving an overall reduction in parking rates.

Cite

Text

Ray et al. "Decision-Dependent Risk Minimization in Geometrically Decaying Dynamic Environments." AAAI Conference on Artificial Intelligence, 2022. doi:10.1609/AAAI.V36I7.20780

Markdown

[Ray et al. "Decision-Dependent Risk Minimization in Geometrically Decaying Dynamic Environments." AAAI Conference on Artificial Intelligence, 2022.](https://mlanthology.org/aaai/2022/ray2022aaai-decision/) doi:10.1609/AAAI.V36I7.20780

BibTeX

@inproceedings{ray2022aaai-decision,
  title     = {{Decision-Dependent Risk Minimization in Geometrically Decaying Dynamic Environments}},
  author    = {Ray, Mitas and Ratliff, Lillian J. and Drusvyatskiy, Dmitriy and Fazel, Maryam},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2022},
  pages     = {8081-8088},
  doi       = {10.1609/AAAI.V36I7.20780},
  url       = {https://mlanthology.org/aaai/2022/ray2022aaai-decision/}
}