Technical Evaluation

We provide a set of experiments for the technical evaluation of verigym.

• VeriGym vs. Gymnasium: how fast is discretization?: Compares how fast VeriGym and Gymnasium discretize observations, depending on the number of dimensions and the data type.

• Technical Evaluation: How does memory consumption of VeriGym’s datastructures for explicit models compare to that of other tools?: Compares the memory use of VeriGym’s explicit model data structures with stormpy and dense numpy arrays on PRISM benchmarks.

• Technical evaluation: runtime profiling: Breaks down how long each step of learning an abstraction takes, and how this grows with the number of bins and the exploration budget.