Info
- Utilizzare la checkbox di selezione a fianco di ciascun documento per attivare le funzionalità di stampa, invio email, download nei formati disponibili del (i) record.
Electronic warfare target location methods / / Richard A. Poisel
| Electronic warfare target location methods / / Richard A. Poisel |
| Autore | Poisel Richard |
| Edizione | [Second edition] |
| Pubbl/distr/stampa | Boston : , : Artech House, , 2012 |
| Descrizione fisica | 1 online resource (439 p.) |
| Disciplina | 623.043 |
| Soggetto topico |
Electronics in military engineering
Automatic tracking Automatic control Target acquisition Control automàtic Electrònica en enginyeria militar |
| ISBN |
1-5231-1712-5
1-60807-524-9 |
| Formato | Materiale a stampa  |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Nota di contenuto |
Electronic WarfareTarget Location Methods Second Edition; Contents; Preface; References; Chapter 1 Introduction to Emitter Geolocation; 1.1 Introduction; 1.2 Gradient Descent Algorithm; 1.3 Concluding Remarks; References; Chapter 2 Triangulation; 2.1 Introduction; 2.2 Basic Concepts; 2.3 Least-Squares Error Estimation; 2.4 Total Least-Squares Estimation; 2.5 Least-Squares Distance Error PF Algorithm; 2.5.1 Brown's Least-Squares Triangulation Algorithm; 2.5.2 Hemispheric Least-Squares Error Estimation Algorithm; 2.5.3 Pages-Zamora Least-Squares; 2.5.4 Total Least-Squares Error.
2.6 Minimum Mean-Squares Error Estimation2.6.1 Dynamical Systems; 2.6.2 Linear Minimum Mean-Square Estimation; 2.6.3 Target Location Estimation with the Linear Model; 2.6.4 Kalman Filter Methods; 2.7 The Discrete Probability Density Method; 2.8 Generalized Bearings; 2.9 Maximum Likelihood PF Algorithm; 2.9.1 Maximum Likelihood Estimation Triangulation Algorithm; 2.9.2 Maximum Likelihood Estimation Algorithm Comparison; 2.10 Multiple Sample Correlation; 2.11 Bearing-Only Target Motion Analysis; 2.12 Sources of Error in Triangulation; 2.12.1 Geometric Dilution of Precision in Triangulation. 2.12.2 LOB Error2.12.3 Effects of Bias on Bearing-Only PF; 2.12.4 Combining Noisy LOB Measurements; 2.12.5 Effects of Navigation Error; 2.13 Concluding Remarks; References; Appendix 2A Least-Squares Error Estimation Program Listing; Appendix 2B Generalized Bearing Program Listing; Chapter 3 DF Techniques; 3.1 Introduction; 3.2 Array Processing Direction of Arrival Measurement Methods; 3.2.1 Introduction; 3.2.3 Array Covariance Modeling; 3.2.4 Direction of Arrival; 3.2.5 Subspace-Based Methods; 3.2.6 Beamforming AOA Estimation; 3.2.7 Maximum Likelihood AOA Estimation. 3.2.8 Least-Squares Error AOA Estimation3.2.9 Decoupling Sample Source Signals from AOA Parameters; 3.2.10 Gram-Schmidt Orthogonalization; 3.2.11 Nonlinear Programming; 3.3 Other Methods of Estimating the AOA; 3.3.1 Phase Interferometry; 3.3.2 Amplitude Systems; 3.3.3 Doppler Direction Finder; 3.4 MSE Phase Interferometer; 3.4.1 Introduction; 3.4.2 The Algorithm; 3.4.3 Simulation; 3.5 DF with a Butler Matrix; 3.5.1 Introduction; 3.5.2 Beamforming Network; 3.6 Phase Difference Estimation Using SAW Devices; 3.6.1 Introduction; 3.6.2 SAW Characteristics; 3.7 Concluding Remarks; References. Chapter 4 MUSIC4.1 Introduction; 4.2 MUSIC Overview; 4.3 MUSIC; 4.3.1 The MUSIC Algorithm; 4.4 Performance of MUSIC in the Presence of Modeling Errors; 4.4.1 Model Errors; 4.4.2 Error Expressions; 4.4.3 Results; 4.5 Determining the Number of Wavefields; 4.6 Effect of Phase Errors on the Accuracy of MUSIC; 4.6.1 Introduction; 4.6.2 Accuracy; 4.6.3 Solutions for Errors; 4.6.4 Statistics; 4.6.5 Horizontal Planar Arrays; 4.6.6 Simulations; 4.6.7 Summary; 4.7 Other Superresolution Algorithms; 4.7.1 Maximum Likelihood Method; 4.7.2 Adaptive Angular Response; 4.7.3 Thermal Noise Algorithm. |
| Record Nr. | UNINA-9910790328503321 |
Poisel Richard
|
||
| Boston : , : Artech House, , 2012 | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. Federico II | ||
| ||
Electronic warfare target location methods / / Richard A. Poisel
| Electronic warfare target location methods / / Richard A. Poisel |
| Autore | Poisel Richard |
| Edizione | [Second edition] |
| Pubbl/distr/stampa | Boston : , : Artech House, , 2012 |
| Descrizione fisica | 1 online resource (439 p.) |
| Disciplina | 623.043 |
| Soggetto topico |
Electronics in military engineering
Automatic tracking Automatic control Target acquisition Control automàtic Electrònica en enginyeria militar |
| ISBN |
1-5231-1712-5
1-60807-524-9 |
| Formato | Materiale a stampa |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Nota di contenuto |
Electronic WarfareTarget Location Methods Second Edition; Contents; Preface; References; Chapter 1 Introduction to Emitter Geolocation; 1.1 Introduction; 1.2 Gradient Descent Algorithm; 1.3 Concluding Remarks; References; Chapter 2 Triangulation; 2.1 Introduction; 2.2 Basic Concepts; 2.3 Least-Squares Error Estimation; 2.4 Total Least-Squares Estimation; 2.5 Least-Squares Distance Error PF Algorithm; 2.5.1 Brown's Least-Squares Triangulation Algorithm; 2.5.2 Hemispheric Least-Squares Error Estimation Algorithm; 2.5.3 Pages-Zamora Least-Squares; 2.5.4 Total Least-Squares Error.
2.6 Minimum Mean-Squares Error Estimation2.6.1 Dynamical Systems; 2.6.2 Linear Minimum Mean-Square Estimation; 2.6.3 Target Location Estimation with the Linear Model; 2.6.4 Kalman Filter Methods; 2.7 The Discrete Probability Density Method; 2.8 Generalized Bearings; 2.9 Maximum Likelihood PF Algorithm; 2.9.1 Maximum Likelihood Estimation Triangulation Algorithm; 2.9.2 Maximum Likelihood Estimation Algorithm Comparison; 2.10 Multiple Sample Correlation; 2.11 Bearing-Only Target Motion Analysis; 2.12 Sources of Error in Triangulation; 2.12.1 Geometric Dilution of Precision in Triangulation. 2.12.2 LOB Error2.12.3 Effects of Bias on Bearing-Only PF; 2.12.4 Combining Noisy LOB Measurements; 2.12.5 Effects of Navigation Error; 2.13 Concluding Remarks; References; Appendix 2A Least-Squares Error Estimation Program Listing; Appendix 2B Generalized Bearing Program Listing; Chapter 3 DF Techniques; 3.1 Introduction; 3.2 Array Processing Direction of Arrival Measurement Methods; 3.2.1 Introduction; 3.2.3 Array Covariance Modeling; 3.2.4 Direction of Arrival; 3.2.5 Subspace-Based Methods; 3.2.6 Beamforming AOA Estimation; 3.2.7 Maximum Likelihood AOA Estimation. 3.2.8 Least-Squares Error AOA Estimation3.2.9 Decoupling Sample Source Signals from AOA Parameters; 3.2.10 Gram-Schmidt Orthogonalization; 3.2.11 Nonlinear Programming; 3.3 Other Methods of Estimating the AOA; 3.3.1 Phase Interferometry; 3.3.2 Amplitude Systems; 3.3.3 Doppler Direction Finder; 3.4 MSE Phase Interferometer; 3.4.1 Introduction; 3.4.2 The Algorithm; 3.4.3 Simulation; 3.5 DF with a Butler Matrix; 3.5.1 Introduction; 3.5.2 Beamforming Network; 3.6 Phase Difference Estimation Using SAW Devices; 3.6.1 Introduction; 3.6.2 SAW Characteristics; 3.7 Concluding Remarks; References. Chapter 4 MUSIC4.1 Introduction; 4.2 MUSIC Overview; 4.3 MUSIC; 4.3.1 The MUSIC Algorithm; 4.4 Performance of MUSIC in the Presence of Modeling Errors; 4.4.1 Model Errors; 4.4.2 Error Expressions; 4.4.3 Results; 4.5 Determining the Number of Wavefields; 4.6 Effect of Phase Errors on the Accuracy of MUSIC; 4.6.1 Introduction; 4.6.2 Accuracy; 4.6.3 Solutions for Errors; 4.6.4 Statistics; 4.6.5 Horizontal Planar Arrays; 4.6.6 Simulations; 4.6.7 Summary; 4.7 Other Superresolution Algorithms; 4.7.1 Maximum Likelihood Method; 4.7.2 Adaptive Angular Response; 4.7.3 Thermal Noise Algorithm. |
| Record Nr. | UNINA-9910827296703321 |
|
Poisel Richard
|
||
| Boston : , : Artech House, , 2012 | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. Federico II | ||
| ||
Encyclopedia of systems and control / / John Bailieul, Tariq Samad, editors
| Encyclopedia of systems and control / / John Bailieul, Tariq Samad, editors |
| Edizione | [Second edition.] |
| Pubbl/distr/stampa | Cham, Switzerland : , : Springer, , [2021] |
| Descrizione fisica | 1 online resource (2497 pages) |
| Disciplina | 004 |
| Soggetto topico |
Computer systems
Sistemes informàtics Control automàtic |
| Soggetto genere / forma | Llibres electrònics |
| ISBN | 3-030-44184-9 |
| Formato | Materiale a stampa |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Record Nr. | UNINA-9910495250703321 |
| Cham, Switzerland : , : Springer, , [2021] | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. Federico II | ||
| ||
Essays on Pareto Optimality in Cooperative Games [[electronic resource] /] / by Yaning Lin, Weihai Zhang
| Essays on Pareto Optimality in Cooperative Games [[electronic resource] /] / by Yaning Lin, Weihai Zhang |
| Autore | Lin Yaning |
| Edizione | [1st ed. 2022.] |
| Pubbl/distr/stampa | Singapore : , : Springer Nature Singapore : , : Imprint : Springer, , 2022 |
| Descrizione fisica | 1 online resource (169 pages) |
| Disciplina | 629.8 |
| Soggetto topico |
Control engineering
Mathematics - Philosophy Mathematical optimization Control and Systems Theory Philosophy of Mathematics Optimization Jocs diferencials Control automàtic Optimització matemàtica |
| Soggetto genere / forma | Llibres electrònics |
| ISBN | 981-19-5049-0 |
| Formato | Materiale a stampa |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Nota di contenuto | Introduction -- Existence conditions of Pareto solutions in the finite horizon stochastic differential game -- Existence conditions of Pareto solutions in the infinite horizon stochastic differential game -- LQ Pareto game of the stochastic singular systems in finite horizon -- LQ Pareto game of the stochastic singular systems in infinite horizon -- Pareto-based guaranteed cost control of the uncertain mean-field stochastic systems -- Existence conditions of Pareto solutions in the finite horizon cooperative difference game -- Existence conditions of Pareto solutions in the infinite horizon cooperative difference game -- References. |
| Record Nr. | UNISA-996490343803316 |
|
Lin Yaning
|
||
| Singapore : , : Springer Nature Singapore : , : Imprint : Springer, , 2022 | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. di Salerno | ||
| ||
Essays on Pareto Optimality in Cooperative Games / / by Yaning Lin, Weihai Zhang
| Essays on Pareto Optimality in Cooperative Games / / by Yaning Lin, Weihai Zhang |
| Autore | Lin Yaning |
| Edizione | [1st ed. 2022.] |
| Pubbl/distr/stampa | Singapore : , : Springer Nature Singapore : , : Imprint : Springer, , 2022 |
| Descrizione fisica | 1 online resource (169 pages) |
| Disciplina | 629.8 |
| Soggetto topico |
Control engineering
Mathematics - Philosophy Mathematical optimization Control and Systems Theory Philosophy of Mathematics Optimization Jocs diferencials Control automàtic Optimització matemàtica |
| Soggetto genere / forma | Llibres electrònics |
| ISBN | 981-19-5049-0 |
| Formato | Materiale a stampa |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Nota di contenuto | Introduction -- Existence conditions of Pareto solutions in the finite horizon stochastic differential game -- Existence conditions of Pareto solutions in the infinite horizon stochastic differential game -- LQ Pareto game of the stochastic singular systems in finite horizon -- LQ Pareto game of the stochastic singular systems in infinite horizon -- Pareto-based guaranteed cost control of the uncertain mean-field stochastic systems -- Existence conditions of Pareto solutions in the finite horizon cooperative difference game -- Existence conditions of Pareto solutions in the infinite horizon cooperative difference game -- References. |
| Record Nr. | UNINA-9910595060303321 |
|
Lin Yaning
|
||
| Singapore : , : Springer Nature Singapore : , : Imprint : Springer, , 2022 | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. Federico II | ||
| ||
Event-triggered active disturbance rejection control : theory and applications / / Dawei Shi [et al.]
| Event-triggered active disturbance rejection control : theory and applications / / Dawei Shi [et al.] |
| Autore | Shi Dawei |
| Pubbl/distr/stampa | Singapore : , : Springer, , [2021] |
| Descrizione fisica | 1 online resource (xv, 228 pages) : illustrations (some color) |
| Disciplina | 629.8 |
| Altri autori (Persone) |
HuangYuan WangJunzheng ShiLing |
| Collana | Studies in systems, decision and control |
| Soggetto topico |
Automatic control
Mechatronics Robotics System theory Control automàtic Robòtica Mecatrònica Teoria de sistemes |
| Soggetto genere / forma | Llibres electrònics |
| ISBN | 981-16-0293-X |
| Formato | Materiale a stampa |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Nota di contenuto |
Intro -- Preface -- Contents -- Acronyms -- 1 Introduction -- 1.1 Event-Based Sampled-Data Control -- 1.1.1 Sampled-Data Systems -- 1.1.2 Event-Based Sampling and Control -- 1.2 Active Disturbance Rejection Control -- 1.2.1 Functions fhan and fal -- 1.2.2 Tracking Differentiator -- 1.2.3 Extended State Observer -- 1.2.4 Nonlinear Feedback -- 1.3 Related Literature -- 1.3.1 Event-Based Sampled-Data Control -- 1.3.2 Active Disturbance Rejection Control -- 1.3.3 Event-Based Active Disturbance Rejection Control -- 1.4 Organization of the Book -- References -- Part I Theoretic Developments -- 2 Performance Assessment of Discrete-Time Extended State Observers -- 2.1 Problem Formulation -- 2.1.1 Discrete-Time Nonlinear System -- 2.1.2 Discrete-Time Extended State Observer -- 2.1.3 Description of the Problem -- 2.2 Observation Performance Analysis of Discrete-Time Extended State Observer -- 2.2.1 Gain Parameters Design Based on Spectral Radius Method -- 2.2.2 Observation Performance Analysis Through Ellipsoidal Set Approach -- 2.2.3 Extensions and Special Cases -- 2.3 Numerical Example -- 2.4 Experimental Results -- 2.5 Summary -- References -- 3 Event-Triggered Extended State Observer -- 3.1 Problem Formulation -- 3.1.1 Continuous-Time Nonlinear System -- 3.1.2 Event-Triggered Extended State Observer -- 3.1.3 ET-ESO Design Problem -- 3.2 Main Theoretic Results -- 3.2.1 Event-Triggering Condition Design -- 3.2.2 Non-existence of Zeno Phenomenon -- 3.2.3 Convergence Analysis of Event-Triggered Extended State Observer -- 3.2.4 Other Extensions -- 3.2.5 Event-Triggered Extended State Observer with Designed Initial Value -- 3.3 Numerical Example -- 3.3.1 Observation Performance Verification for ET-ESO -- 3.4 Summary -- References -- 4 Event-Triggered Active Disturbance Rejection Control -- 4.1 Problem Description.
4.2 Event-Triggered Control Based on Continuous-Time Observations -- 4.3 Separate Event-Triggered Observation and Control -- 4.4 Experimental Results -- 4.5 Summary -- References -- 5 A High-Gain Approach to Event-Triggered Control -- 5.1 Problem Formulation -- 5.2 Theoretic Results -- 5.3 Discussions on Special Sampling Schemes -- 5.3.1 Case 1: Only Sampling Output -- 5.3.2 Case 2: Only Sampling Control Signal -- 5.4 Numerical Example -- 5.5 Experimental Performance Evaluation -- 5.6 Summary -- References -- Part II Applications -- 6 Event-Triggered Active Disturbance Rejection Control of DC Torque Motors -- 6.1 Background -- 6.2 Problem Description and System Dynamics -- 6.3 Event-Triggered ADRC Design -- 6.4 Experimental Performance Evaluation -- 6.4.1 Experimental Results with Squarewave-Type Input -- 6.4.2 Experimental Results with Multitone Sinusoid Input -- 6.5 Summary -- References -- 7 Event-Triggered ADRC for Electric Cylinders with PD-Type Event-Triggering Conditions -- 7.1 Background -- 7.2 Nonlinear Modeling and Problem Formulation -- 7.3 Event-Triggered ADRC of Electric Cylinders -- 7.4 Experiment Results -- 7.4.1 Squarewave-Type Reference -- 7.4.2 Multitone Sinusoid Reference -- 7.5 Discussion -- References -- 8 Event-Triggered Attitude Tracking for Rigid Spacecraft -- 8.1 Background -- 8.2 Problem Formulation -- 8.3 ET-ADRC Design -- 8.4 Numerical Evaluation -- 8.4.1 Desired Angular Velocity in Sinusoidal Form -- 8.4.2 Desired Angular Velocity in Square Wave Form -- 8.5 Summary -- References -- 9 Event-Triggered Adaptive Disturbance Rejection for Artificial Pancreas -- 9.1 Background -- 9.2 Related Literature -- 9.3 Controller Structure Design -- 9.3.1 Time-Optimal Control Synthesis Function -- 9.3.2 Tracking Differentiator -- 9.3.3 Extended State Observer -- 9.3.4 Nonlinear Feedback -- 9.3.5 Safety Constraints. 9.3.6 Pump-Discretization -- 9.4 Event-Triggered Parameter Adaptation for ADRC -- 9.4.1 Adaptation of ESO and IOB -- 9.4.2 Parameter Adaptation for Nonlinear Feedback -- 9.4.3 Parameter Design -- 9.5 In Silico Performance Analysis -- 9.5.1 Announced Meals with Nominal Basal Rate -- 9.5.2 Unannounced Meals with Nominal Basal Rate -- 9.5.3 Robust Performance Evaluation -- 9.6 Summary -- References -- 10 Summary and Future Work -- Correction to: Event-Triggered Active Disturbance Rejection Control -- Correction to: D. Shi et al., Event-Triggered Active Disturbance Rejection Control, Studies in Systems, Decision and Control 356, https://doi.org/10.1007/978-981-16-0293-1. |
| Record Nr. | UNINA-9910483901603321 |
|
Shi Dawei
|
||
| Singapore : , : Springer, , [2021] | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. Federico II | ||
| ||
Event-triggered control of switched linear systems / / Jun Fu, Tai-Fang Li
| Event-triggered control of switched linear systems / / Jun Fu, Tai-Fang Li |
| Autore | Fu Jun |
| Pubbl/distr/stampa | Cham, Switzerland : , : Springer, , [2021] |
| Descrizione fisica | 1 online resource (173 pages) |
| Disciplina | 629.832 |
| Collana | Studies in Systems, Decision and Control |
| Soggetto topico |
Linear control systems
Switching theory Discrete-time systems Control automàtic Teoria de la commutació Sistemes de temps discret |
| Soggetto genere / forma | Llibres electrònics |
| ISBN | 3-030-71604-X |
| Formato | Materiale a stampa |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Record Nr. | UNINA-9910483409203321 |
|
Fu Jun
|
||
| Cham, Switzerland : , : Springer, , [2021] | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. Federico II | ||
| ||
Handbook of reinforcement learning and control / / Kyriakos G. Vamvoudakis [and three others], editors
| Handbook of reinforcement learning and control / / Kyriakos G. Vamvoudakis [and three others], editors |
| Pubbl/distr/stampa | Cham, Switzerland : , : Springer, , [2021] |
| Descrizione fisica | 1 online resource (839 pages) |
| Disciplina | 006.31 |
| Collana | Studies in Systems, Decision and Control |
| Soggetto topico |
Reinforcement learning
Automatic control - Sensitivity Aprenentatge per reforç (Intel·ligència artificial) Control automàtic |
| Soggetto genere / forma | Llibres electrònics |
| ISBN | 3-030-60990-1 |
| Formato | Materiale a stampa |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Nota di contenuto |
Intro -- Preface -- Contents -- Part ITheory of Reinforcement Learning for Model-Free and Model-Based Control and Games -- 1 What May Lie Ahead in Reinforcement Learning -- References -- 2 Reinforcement Learning for Distributed Control and Multi-player Games -- 2.1 Introduction -- 2.2 Optimal Control of Continuous-Time Systems -- 2.2.1 IRL with Experience Replay Learning Technique ch2Modares2014Automatica,ch2Kamalapurkar2016 -- 2.2.2 mathcalHinfty Control of CT Systems -- 2.3 Nash Games -- 2.4 Graphical Games -- 2.4.1 Off-Policy RL for Graphical Games -- 2.5 Output Synchronization of Multi-agent Systems -- 2.6 Conclusion and Open Research Directions -- References -- 3 From Reinforcement Learning to Optimal Control: A Unified Framework for Sequential Decisions -- 3.1 Introduction -- 3.2 The Communities of Sequential Decisions -- 3.3 Stochastic Optimal Control Versus Reinforcement Learning -- 3.3.1 Stochastic Control -- 3.3.2 Reinforcement Learning -- 3.3.3 A Critique of the MDP Modeling Framework -- 3.3.4 Bridging Optimal Control and Reinforcement Learning -- 3.4 The Universal Modeling Framework -- 3.4.1 Dimensions of a Sequential Decision Model -- 3.4.2 State Variables -- 3.4.3 Objective Functions -- 3.4.4 Notes -- 3.5 Energy Storage Illustration -- 3.5.1 A Basic Energy Storage Problem -- 3.5.2 With a Time-Series Price Model -- 3.5.3 With Passive Learning -- 3.5.4 With Active Learning -- 3.5.5 With Rolling Forecasts -- 3.5.6 Remarks -- 3.6 Designing Policies -- 3.6.1 Policy Search -- 3.6.2 Lookahead Approximations -- 3.6.3 Hybrid Policies -- 3.6.4 Remarks -- 3.6.5 Stochastic Control, Reinforcement Learning, and the Four Classes of Policies -- 3.7 Policies for Energy Storage -- 3.8 Extension to Multi-agent Systems -- 3.9 Observations -- References -- 4 Fundamental Design Principles for Reinforcement Learning Algorithms -- 4.1 Introduction.
4.1.1 Stochastic Approximation and Reinforcement Learning -- 4.1.2 Sample Complexity Bounds -- 4.1.3 What Will You Find in This Chapter? -- 4.1.4 Literature Survey -- 4.2 Stochastic Approximation: New and Old Tricks -- 4.2.1 What is Stochastic Approximation? -- 4.2.2 Stochastic Approximation and Learning -- 4.2.3 Stability and Convergence -- 4.2.4 Zap-Stochastic Approximation -- 4.2.5 Rates of Convergence -- 4.2.6 Optimal Convergence Rate -- 4.2.7 TD and LSTD Algorithms -- 4.3 Zap Q-Learning: Fastest Convergent Q-Learning -- 4.3.1 Markov Decision Processes -- 4.3.2 Value Functions and the Bellman Equation -- 4.3.3 Q-Learning -- 4.3.4 Tabular Q-Learning -- 4.3.5 Convergence and Rate of Convergence -- 4.3.6 Zap Q-Learning -- 4.4 Numerical Results -- 4.4.1 Finite State-Action MDP -- 4.4.2 Optimal Stopping in Finance -- 4.5 Zap-Q with Nonlinear Function Approximation -- 4.5.1 Choosing the Eligibility Vectors -- 4.5.2 Theory and Challenges -- 4.5.3 Regularized Zap-Q -- 4.6 Conclusions and Future Work -- References -- 5 Mixed Density Methods for Approximate Dynamic Programming -- 5.1 Introduction -- 5.2 Unconstrained Affine-Quadratic Regulator -- 5.3 Regional Model-Based Reinforcement Learning -- 5.3.1 Preliminaries -- 5.3.2 Regional Value Function Approximation -- 5.3.3 Bellman Error -- 5.3.4 Actor and Critic Update Laws -- 5.3.5 Stability Analysis -- 5.3.6 Summary -- 5.4 Local (State-Following) Model-Based Reinforcement Learning -- 5.4.1 StaF Kernel Functions -- 5.4.2 Local Value Function Approximation -- 5.4.3 Actor and Critic Update Laws -- 5.4.4 Analysis -- 5.4.5 Stability Analysis -- 5.4.6 Summary -- 5.5 Combining Regional and Local State-Following Approximations -- 5.6 Reinforcement Learning with Sparse Bellman Error Extrapolation -- 5.7 Conclusion -- References -- 6 Model-Free Linear Quadratic Regulator. 6.1 Introduction to a Model-Free LQR Problem -- 6.2 A Gradient-Based Random Search Method -- 6.3 Main Results -- 6.4 Proof Sketch -- 6.4.1 Controlling the Bias -- 6.4.2 Correlation of "0362 f(K) and f(K) -- 6.5 An Example -- 6.6 Thoughts and Outlook -- References -- Part IIConstraint-Driven and Verified RL -- 7 Adaptive Dynamic Programming in the Hamiltonian-Driven Framework -- 7.1 Introduction -- 7.1.1 Literature Review -- 7.1.2 Motivation -- 7.1.3 Structure -- 7.2 Problem Statement -- 7.3 Hamiltonian-Driven Framework -- 7.3.1 Policy Evaluation -- 7.3.2 Policy Comparison -- 7.3.3 Policy Improvement -- 7.4 Discussions on the Hamiltonian-Driven ADP -- 7.4.1 Implementation with Critic-Only Structure -- 7.4.2 Connection to Temporal Difference Learning -- 7.4.3 Connection to Value Gradient Learning -- 7.5 Simulation Study -- 7.6 Conclusion -- References -- 8 Reinforcement Learning for Optimal Adaptive Control of Time Delay Systems -- 8.1 Introduction -- 8.2 Problem Description -- 8.3 Extended State Augmentation -- 8.4 State Feedback Q-Learning Control of Time Delay Systems -- 8.5 Output Feedback Q-Learning Control of Time Delay Systems -- 8.6 Simulation Results -- 8.7 Conclusions -- References -- 9 Optimal Adaptive Control of Partially Uncertain Linear Continuous-Time Systems with State Delay -- 9.1 Introduction -- 9.2 Problem Statement -- 9.3 Linear Quadratic Regulator Design -- 9.3.1 Periodic Sampled Feedback -- 9.3.2 Event Sampled Feedback -- 9.4 Optimal Adaptive Control -- 9.4.1 Periodic Sampled Feedback -- 9.4.2 Event Sampled Feedback -- 9.4.3 Hybrid Reinforcement Learning Scheme -- 9.5 Perspectives on Controller Design with Image Feedback -- 9.6 Simulation Results -- 9.6.1 Linear Quadratic Regulator with Known Internal Dynamics -- 9.6.2 Optimal Adaptive Control with Unknown Drift Dynamics -- 9.7 Conclusion -- References. 10 Dissipativity-Based Verification for Autonomous Systems in Adversarial Environments -- 10.1 Introduction -- 10.1.1 Related Work -- 10.1.2 Contributions -- 10.1.3 Structure -- 10.1.4 Notation -- 10.2 Problem Formulation -- 10.2.1 (Q,S,R)-Dissipative and L2-Gain Stable Systems -- 10.3 Learning-Based Distributed Cascade Interconnection -- 10.4 Learning-Based L2-Gain Composition -- 10.4.1 Q-Learning for L2-Gain Verification -- 10.4.2 L2-Gain Model-Free Composition -- 10.5 Learning-Based Lossless Composition -- 10.6 Discussion -- 10.7 Conclusion and Future Work -- References -- 11 Reinforcement Learning-Based Model Reduction for Partial Differential Equations: Application to the Burgers Equation -- 11.1 Introduction -- 11.2 Basic Notation and Definitions -- 11.3 RL-Based Model Reduction of PDEs -- 11.3.1 Reduced-Order PDE Approximation -- 11.3.2 Proper Orthogonal Decomposition for ROMs -- 11.3.3 Closure Models for ROM Stabilization -- 11.3.4 Main Result: RL-Based Closure Model -- 11.4 Extremum Seeking Based Closure Model Auto-Tuning -- 11.5 The Case of the Burgers Equation -- 11.6 Conclusion -- References -- Part IIIMulti-agent Systems and RL -- 12 Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms -- 12.1 Introduction -- 12.2 Background -- 12.2.1 Single-Agent RL -- 12.2.2 Multi-Agent RL Framework -- 12.3 Challenges in MARL Theory -- 12.3.1 Non-unique Learning Goals -- 12.3.2 Non-stationarity -- 12.3.3 Scalability Issue -- 12.3.4 Various Information Structures -- 12.4 MARL Algorithms with Theory -- 12.4.1 Cooperative Setting -- 12.4.2 Competitive Setting -- 12.4.3 Mixed Setting -- 12.5 Application Highlights -- 12.5.1 Cooperative Setting -- 12.5.2 Competitive Setting -- 12.5.3 Mixed Settings -- 12.6 Conclusions and Future Directions -- References. 13 Computational Intelligence in Uncertainty Quantification for Learning Control and Differential Games -- 13.1 Introduction -- 13.2 Problem Formulation of Optimal Control for Uncertain Systems -- 13.2.1 Optimal Control for Systems with Parameters Modulated by Multi-dimensional Uncertainties -- 13.2.2 Optimal Control for Random Switching Systems -- 13.3 Effective Uncertainty Evaluation Methods -- 13.3.1 Problem Formulation -- 13.3.2 The MPCM -- 13.3.3 The MPCM-OFFD -- 13.4 Optimal Control Solutions for Systems with Parameter Modulated by Multi-dimensional Uncertainties -- 13.4.1 Reinforcement Learning-Based Stochastic Optimal Control -- 13.4.2 Q-Learning-Based Stochastic Optimal Control -- 13.5 Optimal Control Solutions for Random Switching Systems -- 13.5.1 Optimal Controller for Random Switching Systems -- 13.5.2 Effective Estimator for Random Switching Systems -- 13.6 Differential Games for Systems with Parameters Modulated by Multi-dimensional Uncertainties -- 13.6.1 Stochastic Two-Player Zero-Sum Game -- 13.6.2 Multi-player Nonzero-Sum Game -- 13.7 Applications -- 13.7.1 Traffic Flow Management Under Uncertain Weather -- 13.7.2 Learning Control for Aerial Communication Using Directional Antennas (ACDA) Systems -- 13.8 Summary -- References -- 14 A Top-Down Approach to Attain Decentralized Multi-agents -- 14.1 Introduction -- 14.2 Background -- 14.2.1 Reinforcement Learning -- 14.2.2 Multi-agent Reinforcement Learning -- 14.3 Centralized Learning, But Decentralized Execution -- 14.3.1 A Bottom-Up Approach -- 14.3.2 A Top-Down Approach -- 14.4 Centralized Expert Supervises Multi-agents -- 14.4.1 Imitation Learning -- 14.4.2 CESMA -- 14.5 Experiments -- 14.5.1 Decentralization Can Achieve Centralized Optimality -- 14.5.2 Expert Trajectories Versus Multi-agent Trajectories -- 14.6 Conclusion -- References. 15 Modeling and Mitigating Link-Flooding Distributed Denial-of-Service Attacks via Learning in Stackelberg Games. |
| Record Nr. | UNINA-9910488722303321 |
| Cham, Switzerland : , : Springer, , [2021] | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. Federico II | ||
| ||
Intelligent control and smart energy management : renewable resources and transportation / / edited by Maude Josée Blondin [and three others]
| Intelligent control and smart energy management : renewable resources and transportation / / edited by Maude Josée Blondin [and three others] |
| Pubbl/distr/stampa | Cham, Switzerland : , : Springer, , [2022] |
| Descrizione fisica | 1 online resource (434 pages) |
| Disciplina | 658.26 |
| Collana | Springer Optimization and Its Applications |
| Soggetto topico |
Renewable energy sources
Automated vehicles Estalvi d'energia Automatització Control automàtic Xarxes elèctriques intel·ligents Energies renovables |
| Soggetto genere / forma | Llibres electrònics |
| ISBN | 3-030-84474-9 |
| Formato | Materiale a stampa |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Record Nr. | UNISA-996479372303316 |
| Cham, Switzerland : , : Springer, , [2022] | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. di Salerno | ||
| ||
Intelligent control and smart energy management : renewable resources and transportation / / edited by Maude Josée Blondin [and three others]
| Intelligent control and smart energy management : renewable resources and transportation / / edited by Maude Josée Blondin [and three others] |
| Pubbl/distr/stampa | Cham, Switzerland : , : Springer, , [2022] |
| Descrizione fisica | 1 online resource (434 pages) |
| Disciplina | 658.26 |
| Collana | Springer Optimization and Its Applications |
| Soggetto topico |
Renewable energy sources
Automated vehicles Estalvi d'energia Automatització Control automàtic Xarxes elèctriques intel·ligents Energies renovables |
| Soggetto genere / forma | Llibres electrònics |
| ISBN | 3-030-84474-9 |
| Formato | Materiale a stampa |
| Livello bibliografico | Monografia |
| Lingua di pubblicazione | eng |
| Record Nr. | UNINA-9910574094303321 |
| Cham, Switzerland : , : Springer, , [2022] | ||
| Materiale a stampa | ||
| Lo trovi qui: Univ. Federico II | ||
| ||
Soggetto topico
-
Control automàtic
(28)
- Automatic control (11)
- Automatització (7)
- Automation (5)
- Models matemàtics (5)