ECE411H1: Adaptive Control and Reinforcement Learning


An introduction to adaptive control and reinforcement learning for discrete-time deterministic linear systems. Topics include: discrete-time state space models; stability of discrete time systems; parameter adaptation laws; error models in adaptive control; persistent excitation; controllability and pole placement; observability and observers; classical regulation in discrete-time; adaptive regulation; dynamic programming; Rescorla-Wagner model; value iteration methods; Q-learning; temporal difference learning.

51.9 (Fall), 51.9 (Winter), 103.8 (Full Year)