Skip to content

MasWag/FalCAuN-ARCH-COMP

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

94 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FalCAuN-ARCH-COMP

Build License: MIT

This repository contains the materials to execute FalCAuN with the benchmark for ARCH-COMP's falsification track.

Requirements

To execute the scripts in this repository. You need to install FalCAuN.

In addition to FalCAuN, you need to install the following tools.

  • MATLAB with Simulink and Stateflow. Some benchmarks require additional toolboxes.
  • kscript

Usage

You can run the experiment by running the scripts, for example, cd AT && ./AT1.main.kts. Since the scripts are sensitive to the current directory, you need to run the scripts in the directory of the benchmark. You can also specify the number of repetitions, for example, cd AT && ./AT1.main.kts 10.

Old scripts

For archival purposes, we keep the old shell scripts used until ARCH-COMP 2023. The usage is similar to the current scripts, for example, cd ./AT && ./run_falcaun_AT1.sh.

On the benchmarks

FalCAuN can handle the following benchmarks

  • AT
    • AT1
    • AT2
    • AT6{a,b,c,abc}
  • CC
    • CC1
    • CC2
    • CC3
    • CC4
  • SC
  • PM

Note on the unsupported benchmarks

AFC (powertrain)

FalCAuN can execute the AFC model but for any requirements, it crashes due to stack overflow. This is because, in FalCAuN, always_[11, 50] is encoded to an LTL formulas with 50 nests of next operators, which is too large for its back-end model checker.

AT (transmission)

FalCAuN can falsify AT1, AT2, and AT6{a,b,c,abc}. However, AT5{1,2,3,4} are infeasible because encoding of ev_[0.001, 0.1] is impossible or makes the LTL formula super huge (same as AFC).

NN (neural)

Encoding of always_[1.0, 37.0] makes the LTL formula too large (same as AFC).

CC (Chasing Cars)

FalCAuN can falsify CC1, CC2, CC3, and CC4. However, CC5 and CCx are infeasible because the STL formulas are encoded to huge LTL formulas (same reason as AFC).

F16 (f16-gcas)

FalCAuN cannot handle F16 benchmark because it is not a pure Simulink model but requires quite a lot of wrapper in MATLAB, which is currently not supported.

SB (Synthetic Benchmark)

"Instance 1" is not available for SB benchmarks. FalCAuN does not support piecewise constant inputs.

About

Scripts for ARCH-COMP falsification track with FalCAuN

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •