Formal Methods with a Touch of Magic

Par Alizadeh Alamdari, Guy Avni, Thomas A. Henzinger, Anna Lukina

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Machine learning and formal methods have complimentary benefits and drawbacks. In this work, we address the controller-design problem with a combination of techniques from both fields. The use of black-box neural networks in deep reinforcement learning (deep RL) poses a challenge for such a combination. Instead of reasoning formally about the output of deep RL, which we call the wizard, we extract from it a decision-tree based model, which we refer to as the magic book. Using the extracted model as an intermediary, we are able to handle problems that are infeasible for either deep RL or formal methods by themselves. First, we suggest, for the first time, a synthesis procedure that is based on a magic book. We synthesize a stand-alone correct-by-design controller that enjoys the favorable performance of RL. Second, we incorporate a magic book in a bounded model checking (BMC) procedure. BMC allows us to find numerous traces of the plant under the control of the wizard, which a user can use to increase the trustworthiness of the wizard and direct further training.

Original languageEnglish
Title of host publicationProceedings of the 20th Conference on Formal Methods in Computer-Aided Design, FMCAD 2020
EditorsAlexander Ivrii, Ofer Strichman, Warren A. Hunt, Georg Weissenbacher
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages138-147
Number of pages10
ISBN (Electronic)9783854480426
DOIs
StatePublished - 21 Sep 2020
Externally publishedYes
Event20th International Conference on Formal Methods in Computer-Aided Design, FMCAD 2020 - Virtual, Haifa, Israel
Duration: 21 Sep 202024 Sep 2020

Publication series

NameProceedings of the 20th Conference on Formal Methods in Computer-Aided Design, FMCAD 2020

Conference

Conference20th International Conference on Formal Methods in Computer-Aided Design, FMCAD 2020
Country/TerritoryIsrael
CityVirtual, Haifa
Period21/09/2024/09/20

Bibliographical note

Funding Information:
This research was supported in part by the Austrian Science Fund (FWF) under grant Z211-N23 (Wittgenstein Award).

Publisher Copyright:
© 2020 FMCAD Association.

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Graphics and Computer-Aided Design
  • Software
  • Safety, Risk, Reliability and Quality
  • Modeling and Simulation

Fingerprint

Dive into the research topics of 'Formal Methods with a Touch of Magic'. Together they form a unique fingerprint.

Cite this