HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Kullback-Leibler-Quadratic Optimal Control in a Stochastic Environment

Abstract : This paper presents advances in Kullback-Leibler-Quadratic (KLQ) optimal control: a stochastic control framework for Markovian models. The motivation is distributed control of large networked systems. The objective function is composed of a control cost in the form of Kullback-Leibler divergence plus a quadratic cost on the sequence of marginal distributions. With this choice of objective function, the optimal probability distribution of a population of agents over a finite time horizon is shown to be an exponential tilting of the nominal probability distribution. The same is true for the controlled transition matrices that induce the optimal probability distribution. However, one limitation of the previous work is that randomness can only be introduced via the control policy; all uncontrolled processes must be modeled as deterministic to render them immutable under an exponential tilting. In this work, only the controlled dynamics are subject to tilting, allowing for more general probabilistic models. Numerical experiments are conducted in the context of power networks. The distributed control techniques described in this paper can transform a large collection of flexible loads into a 'virtual battery' capable of delivering the same grid services as traditional batteries. Additionally, quality of service to the load owner is guaranteed, privacy is preserved, and computation and communication requirements are reduced, relative to alternative centralized control techniques.
Complete list of metadata

Contributor : Ana Busic Connect in order to contact the contributor
Submitted on : Monday, January 24, 2022 - 8:20:30 PM
Last modification on : Thursday, March 17, 2022 - 10:08:55 AM
Long-term archiving on: : Tuesday, April 26, 2022 - 8:33:22 AM


Files produced by the author(s)


  • HAL Id : hal-03541774, version 1


Neil Cammardella, Ana Bušić, Sean Meyn. Kullback-Leibler-Quadratic Optimal Control in a Stochastic Environment. CDC 2021 - 60th IEEE conference on Decision and Control, Dec 2021, Austin (online), United States. ⟨hal-03541774⟩



Record views


Files downloads