M-measurements Indefinite Linear Quadratic Optimal Control for Bilinear Stochastic Systems with Multiplicative Noises
-
摘要: 研究了带有乘性噪声和受扰动观测的离散时间随机系统不定线性二次(Linear quadratic, LQ) 最优输出反馈控制问题. 对此类问题而言,二次成本函数的加权矩阵不定号,并且最优控制具有对偶效果.为在最优性和计算复杂度间 进行折衷,本文采用了一种M量测反馈控制设计方法.基于动态规划方法,将未来的测量结合到当前控制 计算当中的M量测反馈控制可以通过倒向求解一类与原系统维数相同的广义差分Riccati方程(Generalized difference Riccati equation, GDRE)得到.仿真结果 表明本文提出的算法与目前普遍采用的确定等价性方法相比具有优越性.Abstract: The finite horizon indefinite linear quadratic (LQ) optimal output feedback control problem for discrete time stochastic systems with multiplicative noises and disturbed measurements is considered. In this problem, the weighting matrices of the quadratic cost functional are indefinite, and the optimal control does have the so-called dual effect. In order to make a compromise between the optimality and the computation complexity, a kind of M-measurements feedback control design approach is adopted. Based on the dynamic programming, the M-measurements feedback control for the bilinear stochastic systems (BLSS), which incorporates future measurements into the current control computation, can be solved in backward time, and the optimal solution is given in terms of a kind of generalized difference Riccati equation of the same dimensions as that of the plant. Simulation results show the superiority of the proposed algorithm over other widely used methods based on the certainty equivalence.
-
[1] Maclane P J. Optimal stochastic control of linear systems with state and control-dependent disturbances. IEEE Transactions on Automatic Control, 1971, 16(6): 793-798[2] Kleinman D L. Optimal stationary control of linear systems with control-dependent noise. IEEE Transactions on Automatic Control, 1969, 14(6): 673-677[3] Dragan V, Morozan T, Stoica A. H2 optimal control for linear stochastic systems. Automatica, 2004, 40(7): 1103-1113[4] Gershon E, Shaked U. H∞ output-feedback control of discrete-time systems with state-multiplicative noise. Automatica, 2008, 44(2): 574-579[5] Hassibi B, Sayed A H, Kailath T. Indefinite-quadratic Estimation and Control: A Unified Approach to H2 and H∞ Theories. New York: SIAM, 1998[6] Wang Guang-Chen, Wu Zhen. Stochastic maximum principle for a kind of risk-sensitive optimal control problem and application to portfolio choice. Acta Automatica Sinica, 2007, 33(10): 1043-1047(王光臣, 吴臻. 一个风险敏感最优控制问题的随机最大值原理及在投资选择中的应用. 自动化学报, 2007, 33(10): 1043-1047)[7] Cui Peng, Zhang Cheng-Hui. Indefinite linear quadratic optimal control problem for singular linear discrete-time system: Krein space method. Acta Automatica Sinica, 2007, 33(6): 635-640(崔鹏, 张承慧. 线性离散奇异系统的不定二次最优控制问题: Krein空间方法. 自动化学报, 2007, 33(6): 635-640)[8] Zhao Hong-Guo, Zhang Huan-Shui, Zhang Cheng-Hui. Optimal robust estimation for linear uncertain systems with single delayed measurement. Acta Automatica Sinica, 2008, 34(2): 202-207(赵洪国, 张焕水, 张承慧. 单观测时滞线性不确定系统最优鲁棒估计. 自动化学报, 2008, 34(2): 202-207)[9] Qi Jun-Jun, Zhang Wei-Hai. Discrete-time indefinite stochastic LQ optimal control: infinite horizon case. Acta Automatica Sinica, 2009, 35(5): 613-617(祁军军, 张维海. 离散时间不定号随机线性二次型最优控制:无限时区情形. 自动化学报, 2009, 35(5): 613-617)[10] Chen S P, Li X J, Zhou X Y. Stochastic linear quadratic regulators with indefinite control weight costs. SIAM Journal on Control and Optimization, 1998, 36(5): 1685-1702[11] Rami M A, Zhou X Y. Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls. IEEE Transactions on Automatic Control, 2000, 45(6): 1131-1143[12] Rami M A, Chen X, Zhou X Y. Discrete-time indefinite LQ control with state and control dependent noises. Journal of Global Optimization, 2002, 23(3-4): 245-265[13] Peng S G. A general stochastic maximum principle for optimal control problems. SIAM Journal on Control and Optimization, 1990, 28(4): 966-979[14] Feldbaum A. Optimal Control Systems. New York: Academic Press, 1965[15] Alspach D L. A dual control for linear systems with control dependent plant and measurement noise. In: Proceedings of the 1973 IEEE Conference on Decision and Control including the 12th Symposium on Adaptive Processes. San Diego, USA: IEEE, 1973. 681-689[16] Bar-Shalom Y, Tse E. Dual effect, certainty equivalence, and separation in stochastic control. IEEE Transactions on Automatic Control, 1974, 19(5): 494-500[17] Filatov N M, Unbehauen H. Survey of adaptive dual control methods. IEE Proceedings on Control Theory and Applications, 2002, 147(1): 118-128[18] Li D, Qian F C, Fu P L. Variance minimization approach for a class of dual control problems. IEEE Transactions on Automatic Control, 2002, 47(12): 2010-2020[19] Lee J M, Lee J H. An approximate dynamic programming based approach to dual adaptive control. Journal of Process Control, 2009, 19(5): 859-864[20] Todorov E. Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system. Neural Computation, 2005, 17(5): 1084-1108[21] Carravetta F, Mavelli G. Suboptimal stochastic linear feedback control of linear systems with state- and control-dependent noise: the incomplete information case. Automatica, 2007, 43(5): 751-757[22] Curry R. A new algorithm for suboptimal stochastic control. IEEE Transactions on Automatic Control, 1969, 14(5): 533-536[23] Chen S, Yong J. Stochastic linear quadratic optimal control problems. Applied Mathematics and Optimization, 2001, 43(1): 21-45[24] Dragan V, Morozan T, Stoica A M. Mathematical methods in robust control of linear stochastic systems. New York: Springer, 2006. 50[25] Moore J B, Zhou X Y, Lim A E B. Discrete time LQG controls with control dependent noise. System and Control Letters, 1999, 36(3): 199-206
点击查看大图
计量
- 文章访问数: 1666
- HTML全文浏览量: 35
- PDF下载量: 564
- 被引次数: 0