Second-order hyperparameter tuning of model-based and adaptive observers for time-varying and unknown chaotic systems

In this paper, a second-order hyperparameter tuning method is proposed to improve the performance of online gradient-descent optimization. Second-order gradient information of a cost function obtained from extremum seeking optimization is embedded into the adaptation of states and parameters. Thus, a faster adaptation capability is provided without computing the inverse Hessian matrix. The convergence property of the adaptation dynamics via proposed hyperparameter is shown using Lyapunov approach. The proposed hyperparameters and conventional learning rates are compared in numerical applications of model-based estimation and adaptive estimation as follows: i) model-based synchronization of chaotic Lu-systems with time-varying parameters is performed by using an efficient nonlinear observer, ii) an adaptive fuzzy neural-network observer based state estimation is conducted for unknown Duffing oscil-lator. In both cases, online gradient-descent adaptations are boosted using the proposed hyperparameter and conventional learning rates and their capabilities are measured in terms of root-mean squared-error performance. As a result, the proposed hyperparameter tuning method presented more accurate perfor-mances where application results are illustrated in figures and in a table.

Automated summary

In this paper, a second-order hyperparameter tuning method is proposed to improve the performance of online gradient-descent optimization. The method embeds second-order gradient information into the adaptation of states and parameters, providing faster adaptation capability without computing the inverse Hessian matrix. The method is compared with conventional learning rates in model-based and adaptive estimation applications, and its accuracy is evaluated using root-mean squared-error performance. Experimental results demonstrate that the proposed hyperparameter tuning method achieves more accurate performance.