Logo
Undergraduate Education

Learning-Based Control

Code: 3.3.3279.9 | 9th Semester | Obligatory by selection | Flow S | ECTS: 4

Lecturers: Ioannis Kordonis

Lecture Hours - Lab Hours: 3 - 0

Description

Introduction to learning-based control methodologies. Review of fundamental regression concepts. Sparse Identification of Nonlinear Dynamics (SINDy). Real-time system identification. Classical adaptive control principles, including both indirect methods and direct architectures (e.g. MRAC). Parameter convergence analysis. Advanced state estimation techniques based on stochastic approaches, including Variational Inference. Learning control policies from demonstration data (Imitation Learnin. In the second part, the course focuses on stochastic optimal control and Reinforcement Learning (RL). Dynamic programming is studied for both finite- and infinite-horizon problems, followed by the transition to model-free reinforcement learning methods. Actor–critic algorithms for continuous control (e.g., DDPG) and stochastic policy-gradient methods (e.g., PPO, TRPO) are presented. A significant component of the course consists of computational exercises and a final project.


/el//en//el/education/undergraduate/info/en/education/undergraduate/info/el/education/undergraduate/courses/en/education/undergraduate/courses/el/education/undergraduate/schedule/en/education/undergraduate/schedule/el/education/undergraduate/quality/en/education/undergraduate/quality/el/education/postgraduate/en/education/postgraduate/el/education/doctoral/info/en/education/doctoral/info/el/education/doctoral/courses/en/education/doctoral/courses/el/education/doctoral/schedule/en/education/doctoral/schedule/el/education/erasmus/en/education/erasmus/el/thesis/search/el/thesis/regulation/el/thesis/contour/el/research/results/en/research/results/el/research/labs/en/research/labs/el/research/iccs/en/research/iccs/el/research/libraries/en/research/libraries/el/staff/academic/faculty/en/staff/academic/faculty/el/staff/academic/emeriti/en/staff/academic/emeriti/el/staff/academic/retired/en/staff/academic/retired/el/staff/academic/visiting/en/staff/academic/visiting/el/staff/laboratory/edip/en/staff/laboratory/edip/el/staff/laboratory/etep/en/staff/laboratory/etep/el/staff/research/iccs/en/staff/research/iccs/el/staff/research/researchAssociate/en/staff/research/researchAssociate/el/staff/research/phd/en/staff/research/phd/el/staff/administrative/permanent/en/staff/administrative/permanent/el/staff/administrative/associates/en/staff/administrative/associates/el/school/history/historicalReview/en/school/history/historicalReview/el/school/history/historyNTUA/en/school/history/historyNTUA/el/school/access/en/school/access/el/school/organization/en/school/organization/el/school/regulatory-texts/el/school/news/en/school/news/el/school/events/en/school/events/el/services/services/en/services/services/el/files/undergraduate/en/files/undergraduate/el/contact/en/contact/el/alumni/register/en/alumni/register/el/cookies/en/cookies/el/announcementsECE Home Page (EL)ECE Home Page (EN)