Learning Solution Manifolds for Control Problems via Energy Minimization

Miguel Zamora, Roi Poranne, Stelian Coros

Research output: Contribution to journalArticlepeer-review

Abstract

A variety of control tasks such as inverse kinematics (IK), trajectory optimization (TO), and model predictive control (MPC) are commonly formulated as energy minimization problems. Numerical solutions to such problems are well-established. However, these are often too slow to be used directly in real-time applications. The alternative is to learn solution manifolds for control problems in an offline stage. Although this distillation process can be trivially formulated as a behavioral cloning (BC) problem, our experiments highlight a number of significant shortcomings arising due to incompatible local minima, interpolation artifacts, and insufficient coverage of the state space. In this paper, we propose an alternative to BC that is efficient and numerically robust. We formulate the learning of solution manifolds as a minimization of the energy terms of a control objective integrated over the space of problems of interest. We minimize this energy integral with a novel method that combines Monte Carlo-inspired adaptive sampling strategies with the derivatives used to solve individual instances of the control task. We evaluate the performance of our formulation on a series of robotic control problems of increasing complexity, and we highlight its benefits through comparisons against traditional methods such as behavioral cloning and Dataset aggregation (Dagger).

Original languageEnglish
Pages (from-to)7912-7919
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume7
Issue number3
DOIs
StatePublished - 1 Jul 2022

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

Keywords

  • Imitation learning
  • Machine learning for robot control
  • Optimization and optimal control

ASJC Scopus subject areas

  • Mechanical Engineering
  • Control and Optimization
  • Artificial Intelligence
  • Human-Computer Interaction
  • Control and Systems Engineering
  • Computer Vision and Pattern Recognition
  • Biomedical Engineering
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Learning Solution Manifolds for Control Problems via Energy Minimization'. Together they form a unique fingerprint.

Cite this