summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
-rw-r--r--.gitignore1
-rw-r--r--python-benchexec.spec502
-rw-r--r--sources1
3 files changed, 504 insertions, 0 deletions
diff --git a/.gitignore b/.gitignore
index e69de29..58a1924 100644
--- a/.gitignore
+++ b/.gitignore
@@ -0,0 +1 @@
+/BenchExec-3.16.tar.gz
diff --git a/python-benchexec.spec b/python-benchexec.spec
new file mode 100644
index 0000000..a2352c0
--- /dev/null
+++ b/python-benchexec.spec
@@ -0,0 +1,502 @@
+%global _empty_manifest_terminate_build 0
+Name: python-BenchExec
+Version: 3.16
+Release: 1
+Summary: A Framework for Reliable Benchmarking and Resource Measurement.
+License: Apache-2.0 AND BSD-3-Clause AND CC-BY-4.0 AND MIT AND ISC AND LicenseRef-BSD-3-Clause-CMU
+URL: https://github.com/sosy-lab/benchexec/
+Source0: https://mirrors.nju.edu.cn/pypi/web/packages/08/04/880d0adb81efd39f3a838640b1b2a81924730e76783ce9e4300d6573ce16/BenchExec-3.16.tar.gz
+BuildArch: noarch
+
+Requires: python3-PyYAML
+
+%description
+<!--
+This file is part of BenchExec, a framework for reliable benchmarking:
+https://github.com/sosy-lab/benchexec
+
+SPDX-FileCopyrightText: 2007-2020 Dirk Beyer <https://www.sosy-lab.org>
+
+SPDX-License-Identifier: Apache-2.0
+-->
+
+# BenchExec
+## A Framework for Reliable Benchmarking and Resource Measurement
+
+[![Build Status](https://gitlab.com/sosy-lab/software/benchexec/badges/main/pipeline.svg)](https://gitlab.com/sosy-lab/software/benchexec/pipelines)
+[![Apache 2.0 License](https://img.shields.io/badge/license-Apache--2-brightgreen.svg)](https://www.apache.org/licenses/LICENSE-2.0)
+[![PyPI version](https://img.shields.io/pypi/v/BenchExec.svg)](https://pypi.python.org/pypi/BenchExec)
+[![DOI](https://zenodo.org/badge/30758422.svg)](https://zenodo.org/badge/latestdoi/30758422)
+
+
+**News**:
+- Linux kernel 5.11 finally [makes it possible](https://github.com/sosy-lab/benchexec/blob/main/doc/INSTALL.md#kernel-requirements) to use all BenchExec features on other distributions than Ubuntu!
+- We now provide an [Ubuntu PPA](https://launchpad.net/~sosy-lab/+archive/ubuntu/benchmarking) that makes installing and upgrading BenchExec easier ([docs](https://github.com/sosy-lab/benchexec/blob/main/doc/INSTALL.md#debianubuntu)).
+- An extended version of our paper on BenchExec and its background was published as open access in the journal STTT,
+ you can read [Reliable Benchmarking: Requirements and Solutions](https://doi.org/10.1007/s10009-017-0469-y) online.
+ We also provide a set of [overview slides](https://www.sosy-lab.org/research/prs/Latest_ReliableBenchmarking.pdf).
+
+BenchExec provides three major features:
+
+- execution of arbitrary commands with precise and reliable measurement
+ and limitation of resource usage (e.g., CPU time and memory),
+ and isolation against other running processes
+- an easy way to define benchmarks with specific tool configurations
+ and resource limits,
+ and automatically executing them on large sets of input files
+- generation of interactive tables and plots for the results
+
+Contrary to other benchmarking frameworks,
+it is able to reliably measure and limit resource usage
+of the benchmarked tool even if it spawns subprocesses.
+In order to achieve this,
+it uses the [cgroups feature](https://www.kernel.org/doc/Documentation/cgroup-v1/cgroups.txt)
+of the Linux kernel to correctly handle groups of processes.
+For proper isolation of the benchmarks, it uses (if available)
+Linux [user namespaces](http://man7.org/linux/man-pages/man7/namespaces.7.html)
+and an [overlay filesystem](https://www.kernel.org/doc/Documentation/filesystems/overlayfs.txt)
+to create a [container](https://github.com/sosy-lab/benchexec/blob/main/doc/container.md)
+that restricts interference of the executed tool with the benchmarking host.
+BenchExec is intended for benchmarking non-interactive tools on Linux systems.
+It measures CPU time, wall time, and memory usage of a tool,
+and allows to specify limits for these resources.
+It also allows to limit the CPU cores and (on NUMA systems) memory regions,
+and the container mode allows to restrict filesystem and network access.
+In addition to measuring resource usage,
+BenchExec can verify that the result of the tool was as expected,
+and extract further statistical data from the output.
+Results from multiple runs can be combined into CSV and interactive HTML tables,
+of which the latter provide scatter and quantile plots
+(have a look at our [demo table](https://sosy-lab.github.io/benchexec/example-table/svcomp-simple-cbmc-cpachecker.table.html)).
+
+BenchExec works only on Linux and needs a one-time setup of cgroups by the machine's administrator.
+The actual benchmarking can be done by any user and does not need root access.
+
+BenchExec was originally developed for use with the software verification framework
+[CPAchecker](https://cpachecker.sosy-lab.org)
+and is now developed as an independent project
+at the [Software Systems Lab](https://www.sosy-lab.org)
+of the [Ludwig-Maximilians-Universität München (LMU Munich)](https://www.uni-muenchen.de).
+
+### Links
+
+- [Documentation](https://github.com/sosy-lab/benchexec/tree/main/doc/INDEX.md)
+- [Demo](https://sosy-lab.github.io/benchexec/example-table/svcomp-simple-cbmc-cpachecker.table.html) of a result table
+- [Downloads](https://github.com/sosy-lab/benchexec/releases)
+- [Changelog](https://github.com/sosy-lab/benchexec/tree/main/CHANGELOG.md)
+- [BenchExec GitHub Repository](https://github.com/sosy-lab/benchexec),
+ use this for [reporting issues and asking questions](https://github.com/sosy-lab/benchexec/issues)
+- [BenchExec at PyPI](https://pypi.python.org/pypi/BenchExec)
+- [BenchExec at Zenodo](https://doi.org/10.5281/zenodo.1163552): Each release gets a DOI such that you can reference it from your publications and artifacts.
+
+### Literature
+
+- [Reliable Benchmarking: Requirements and Solutions](https://doi.org/10.1007/s10009-017-0469-y), by D. Beyer, S. Löwe, and P. Wendler. International Journal on Software Tools for Technology Transfer (STTT), 21(1):1-29, 2019. [doi:10.1007/s10009-017-0469-y](https://doi.org/10.1007/s10009-017-0469-y). Journal paper about BenchExec (open access, also with a [supplementary webpage](https://www.sosy-lab.org/research/benchmarking/) and [overview slides](https://www.sosy-lab.org/research/prs/Latest_ReliableBenchmarking.pdf))
+- [CPU Energy Meter: A Tool for Energy-Aware Algorithms Engineering](https://doi.org/10.1007/978-3-030-45237-7_8), by D. Beyer and P. Wendler. In Proc. TACAS 2020, part 2, LNCS 12079, pages 126-133, 2020. Springer. [doi:10.1007/978-3-030-45237-7_8](https://doi.org/10.1007/978-3-030-45237-7_8)
+- [Benchmarking and Resource Measurement](https://doi.org/10.1007/978-3-319-23404-5_12), by D. Beyer, S. Löwe, and P. Wendler. In Proc. SPIN 2015, LNCS 9232, pages 160-178, 2015. Springer. [doi:10.1007/978-3-319-23404-5_12](https://doi.org/10.1007/978-3-319-23404-5_12)
+
+### License and Copyright
+
+BenchExec is licensed under the [Apache 2.0 License](https://www.apache.org/licenses/LICENSE-2.0),
+copyright [Dirk Beyer](https://www.sosy-lab.org/people/beyer/).
+Exceptions are some tool-info modules
+and third-party code that is bundled in the HTML tables,
+which are available under several other free licenses
+(cf. [folder `LICENSES`](https://github.com/sosy-lab/benchexec/tree/main/LICENSES)).
+
+### Authors
+Maintainer: [Philipp Wendler](https://www.philippwendler.de)
+
+Contributors:
+- [Aditya Arora](https://github.com/alohamora)
+- [Dirk Beyer](https://www.sosy-lab.org/people/beyer/)
+- [Laura Bschor](https://github.com/laurabschor)
+- [Thomas Bunk](https://github.com/TBunk)
+- [Montgomery Carter](https://github.com/MontyCarter)
+- [Andreas Donig](https://github.com/adonig)
+- [Karlheinz Friedberger](https://www.sosy-lab.org/people/friedberger)
+- Peter Häring
+- [Florian Heck](https://github.com/fheck)
+- [Hugo](https://github.com/hugovk)
+- [George Karpenkov](http://metaworld.me/)
+- [Mike Kazantsev](http://fraggod.net/)
+- [Michael Lachner](https://github.com/lachnerm)
+- [Thomas Lemberger](https://www.sosy-lab.org/people/lemberger/)
+- [Sebastian Ott](https://github.com/ottseb)
+- Stefan Löwe
+- [Stephan Lukasczyk](https://github.com/stephanlukasczyk)
+- [Alexander von Rhein](http://www.infosun.fim.uni-passau.de/se/people-rhein.php)
+- [Alexander Schremmer](https://www.xing.com/profile/Alexander_Schremmer)
+- [Dennis Simon](https://github.com/DennisSimon)
+- [Andreas Stahlbauer](http://stahlbauer.net/)
+- [Thomas Stieglmaier](https://stieglmaier.me/)
+- [Martin Yankov](https://github.com/marto97)
+- [Ilja Zakharov](https://github.com/IljaZakharov)
+- and [lots of more people who integrated tools into BenchExec](https://github.com/sosy-lab/benchexec/graphs/contributors)
+
+### Users of BenchExec
+
+BenchExec was successfully used for benchmarking in all instances
+of the international competitions on [Software Verification](https://sv-comp.sosy-lab.org)
+and [Software Testing](https://test-comp.sosy-lab.org)
+with a wide variety of benchmarked tools and hundreds of thousands benchmark runs.
+It is integrated into the cluster-based logic-solving service
+[StarExec](https://www.starexec.org/starexec/public/about.jsp) ([GitHub](https://github.com/StarExec/StarExec)).
+
+The developers of the following tools use BenchExec:
+
+- [CPAchecker](https://cpachecker.sosy-lab.org), also for regression testing
+- [Dartagnan](https://github.com/hernanponcedeleon/Dat3M)
+- [SMACK](https://github.com/smackers/smack)
+- [SMTInterpol](https://github.com/ultimate-pa/smtinterpol)
+- [Ultimate](https://github.com/ultimate-pa/ultimate)
+
+If you would like to be listed here, [contact us](https://github.com/sosy-lab/benchexec/issues/new).
+
+
+
+
+%package -n python3-BenchExec
+Summary: A Framework for Reliable Benchmarking and Resource Measurement.
+Provides: python-BenchExec
+BuildRequires: python3-devel
+BuildRequires: python3-setuptools
+BuildRequires: python3-pip
+%description -n python3-BenchExec
+<!--
+This file is part of BenchExec, a framework for reliable benchmarking:
+https://github.com/sosy-lab/benchexec
+
+SPDX-FileCopyrightText: 2007-2020 Dirk Beyer <https://www.sosy-lab.org>
+
+SPDX-License-Identifier: Apache-2.0
+-->
+
+# BenchExec
+## A Framework for Reliable Benchmarking and Resource Measurement
+
+[![Build Status](https://gitlab.com/sosy-lab/software/benchexec/badges/main/pipeline.svg)](https://gitlab.com/sosy-lab/software/benchexec/pipelines)
+[![Apache 2.0 License](https://img.shields.io/badge/license-Apache--2-brightgreen.svg)](https://www.apache.org/licenses/LICENSE-2.0)
+[![PyPI version](https://img.shields.io/pypi/v/BenchExec.svg)](https://pypi.python.org/pypi/BenchExec)
+[![DOI](https://zenodo.org/badge/30758422.svg)](https://zenodo.org/badge/latestdoi/30758422)
+
+
+**News**:
+- Linux kernel 5.11 finally [makes it possible](https://github.com/sosy-lab/benchexec/blob/main/doc/INSTALL.md#kernel-requirements) to use all BenchExec features on other distributions than Ubuntu!
+- We now provide an [Ubuntu PPA](https://launchpad.net/~sosy-lab/+archive/ubuntu/benchmarking) that makes installing and upgrading BenchExec easier ([docs](https://github.com/sosy-lab/benchexec/blob/main/doc/INSTALL.md#debianubuntu)).
+- An extended version of our paper on BenchExec and its background was published as open access in the journal STTT,
+ you can read [Reliable Benchmarking: Requirements and Solutions](https://doi.org/10.1007/s10009-017-0469-y) online.
+ We also provide a set of [overview slides](https://www.sosy-lab.org/research/prs/Latest_ReliableBenchmarking.pdf).
+
+BenchExec provides three major features:
+
+- execution of arbitrary commands with precise and reliable measurement
+ and limitation of resource usage (e.g., CPU time and memory),
+ and isolation against other running processes
+- an easy way to define benchmarks with specific tool configurations
+ and resource limits,
+ and automatically executing them on large sets of input files
+- generation of interactive tables and plots for the results
+
+Contrary to other benchmarking frameworks,
+it is able to reliably measure and limit resource usage
+of the benchmarked tool even if it spawns subprocesses.
+In order to achieve this,
+it uses the [cgroups feature](https://www.kernel.org/doc/Documentation/cgroup-v1/cgroups.txt)
+of the Linux kernel to correctly handle groups of processes.
+For proper isolation of the benchmarks, it uses (if available)
+Linux [user namespaces](http://man7.org/linux/man-pages/man7/namespaces.7.html)
+and an [overlay filesystem](https://www.kernel.org/doc/Documentation/filesystems/overlayfs.txt)
+to create a [container](https://github.com/sosy-lab/benchexec/blob/main/doc/container.md)
+that restricts interference of the executed tool with the benchmarking host.
+BenchExec is intended for benchmarking non-interactive tools on Linux systems.
+It measures CPU time, wall time, and memory usage of a tool,
+and allows to specify limits for these resources.
+It also allows to limit the CPU cores and (on NUMA systems) memory regions,
+and the container mode allows to restrict filesystem and network access.
+In addition to measuring resource usage,
+BenchExec can verify that the result of the tool was as expected,
+and extract further statistical data from the output.
+Results from multiple runs can be combined into CSV and interactive HTML tables,
+of which the latter provide scatter and quantile plots
+(have a look at our [demo table](https://sosy-lab.github.io/benchexec/example-table/svcomp-simple-cbmc-cpachecker.table.html)).
+
+BenchExec works only on Linux and needs a one-time setup of cgroups by the machine's administrator.
+The actual benchmarking can be done by any user and does not need root access.
+
+BenchExec was originally developed for use with the software verification framework
+[CPAchecker](https://cpachecker.sosy-lab.org)
+and is now developed as an independent project
+at the [Software Systems Lab](https://www.sosy-lab.org)
+of the [Ludwig-Maximilians-Universität München (LMU Munich)](https://www.uni-muenchen.de).
+
+### Links
+
+- [Documentation](https://github.com/sosy-lab/benchexec/tree/main/doc/INDEX.md)
+- [Demo](https://sosy-lab.github.io/benchexec/example-table/svcomp-simple-cbmc-cpachecker.table.html) of a result table
+- [Downloads](https://github.com/sosy-lab/benchexec/releases)
+- [Changelog](https://github.com/sosy-lab/benchexec/tree/main/CHANGELOG.md)
+- [BenchExec GitHub Repository](https://github.com/sosy-lab/benchexec),
+ use this for [reporting issues and asking questions](https://github.com/sosy-lab/benchexec/issues)
+- [BenchExec at PyPI](https://pypi.python.org/pypi/BenchExec)
+- [BenchExec at Zenodo](https://doi.org/10.5281/zenodo.1163552): Each release gets a DOI such that you can reference it from your publications and artifacts.
+
+### Literature
+
+- [Reliable Benchmarking: Requirements and Solutions](https://doi.org/10.1007/s10009-017-0469-y), by D. Beyer, S. Löwe, and P. Wendler. International Journal on Software Tools for Technology Transfer (STTT), 21(1):1-29, 2019. [doi:10.1007/s10009-017-0469-y](https://doi.org/10.1007/s10009-017-0469-y). Journal paper about BenchExec (open access, also with a [supplementary webpage](https://www.sosy-lab.org/research/benchmarking/) and [overview slides](https://www.sosy-lab.org/research/prs/Latest_ReliableBenchmarking.pdf))
+- [CPU Energy Meter: A Tool for Energy-Aware Algorithms Engineering](https://doi.org/10.1007/978-3-030-45237-7_8), by D. Beyer and P. Wendler. In Proc. TACAS 2020, part 2, LNCS 12079, pages 126-133, 2020. Springer. [doi:10.1007/978-3-030-45237-7_8](https://doi.org/10.1007/978-3-030-45237-7_8)
+- [Benchmarking and Resource Measurement](https://doi.org/10.1007/978-3-319-23404-5_12), by D. Beyer, S. Löwe, and P. Wendler. In Proc. SPIN 2015, LNCS 9232, pages 160-178, 2015. Springer. [doi:10.1007/978-3-319-23404-5_12](https://doi.org/10.1007/978-3-319-23404-5_12)
+
+### License and Copyright
+
+BenchExec is licensed under the [Apache 2.0 License](https://www.apache.org/licenses/LICENSE-2.0),
+copyright [Dirk Beyer](https://www.sosy-lab.org/people/beyer/).
+Exceptions are some tool-info modules
+and third-party code that is bundled in the HTML tables,
+which are available under several other free licenses
+(cf. [folder `LICENSES`](https://github.com/sosy-lab/benchexec/tree/main/LICENSES)).
+
+### Authors
+Maintainer: [Philipp Wendler](https://www.philippwendler.de)
+
+Contributors:
+- [Aditya Arora](https://github.com/alohamora)
+- [Dirk Beyer](https://www.sosy-lab.org/people/beyer/)
+- [Laura Bschor](https://github.com/laurabschor)
+- [Thomas Bunk](https://github.com/TBunk)
+- [Montgomery Carter](https://github.com/MontyCarter)
+- [Andreas Donig](https://github.com/adonig)
+- [Karlheinz Friedberger](https://www.sosy-lab.org/people/friedberger)
+- Peter Häring
+- [Florian Heck](https://github.com/fheck)
+- [Hugo](https://github.com/hugovk)
+- [George Karpenkov](http://metaworld.me/)
+- [Mike Kazantsev](http://fraggod.net/)
+- [Michael Lachner](https://github.com/lachnerm)
+- [Thomas Lemberger](https://www.sosy-lab.org/people/lemberger/)
+- [Sebastian Ott](https://github.com/ottseb)
+- Stefan Löwe
+- [Stephan Lukasczyk](https://github.com/stephanlukasczyk)
+- [Alexander von Rhein](http://www.infosun.fim.uni-passau.de/se/people-rhein.php)
+- [Alexander Schremmer](https://www.xing.com/profile/Alexander_Schremmer)
+- [Dennis Simon](https://github.com/DennisSimon)
+- [Andreas Stahlbauer](http://stahlbauer.net/)
+- [Thomas Stieglmaier](https://stieglmaier.me/)
+- [Martin Yankov](https://github.com/marto97)
+- [Ilja Zakharov](https://github.com/IljaZakharov)
+- and [lots of more people who integrated tools into BenchExec](https://github.com/sosy-lab/benchexec/graphs/contributors)
+
+### Users of BenchExec
+
+BenchExec was successfully used for benchmarking in all instances
+of the international competitions on [Software Verification](https://sv-comp.sosy-lab.org)
+and [Software Testing](https://test-comp.sosy-lab.org)
+with a wide variety of benchmarked tools and hundreds of thousands benchmark runs.
+It is integrated into the cluster-based logic-solving service
+[StarExec](https://www.starexec.org/starexec/public/about.jsp) ([GitHub](https://github.com/StarExec/StarExec)).
+
+The developers of the following tools use BenchExec:
+
+- [CPAchecker](https://cpachecker.sosy-lab.org), also for regression testing
+- [Dartagnan](https://github.com/hernanponcedeleon/Dat3M)
+- [SMACK](https://github.com/smackers/smack)
+- [SMTInterpol](https://github.com/ultimate-pa/smtinterpol)
+- [Ultimate](https://github.com/ultimate-pa/ultimate)
+
+If you would like to be listed here, [contact us](https://github.com/sosy-lab/benchexec/issues/new).
+
+
+
+
+%package help
+Summary: Development documents and examples for BenchExec
+Provides: python3-BenchExec-doc
+%description help
+<!--
+This file is part of BenchExec, a framework for reliable benchmarking:
+https://github.com/sosy-lab/benchexec
+
+SPDX-FileCopyrightText: 2007-2020 Dirk Beyer <https://www.sosy-lab.org>
+
+SPDX-License-Identifier: Apache-2.0
+-->
+
+# BenchExec
+## A Framework for Reliable Benchmarking and Resource Measurement
+
+[![Build Status](https://gitlab.com/sosy-lab/software/benchexec/badges/main/pipeline.svg)](https://gitlab.com/sosy-lab/software/benchexec/pipelines)
+[![Apache 2.0 License](https://img.shields.io/badge/license-Apache--2-brightgreen.svg)](https://www.apache.org/licenses/LICENSE-2.0)
+[![PyPI version](https://img.shields.io/pypi/v/BenchExec.svg)](https://pypi.python.org/pypi/BenchExec)
+[![DOI](https://zenodo.org/badge/30758422.svg)](https://zenodo.org/badge/latestdoi/30758422)
+
+
+**News**:
+- Linux kernel 5.11 finally [makes it possible](https://github.com/sosy-lab/benchexec/blob/main/doc/INSTALL.md#kernel-requirements) to use all BenchExec features on other distributions than Ubuntu!
+- We now provide an [Ubuntu PPA](https://launchpad.net/~sosy-lab/+archive/ubuntu/benchmarking) that makes installing and upgrading BenchExec easier ([docs](https://github.com/sosy-lab/benchexec/blob/main/doc/INSTALL.md#debianubuntu)).
+- An extended version of our paper on BenchExec and its background was published as open access in the journal STTT,
+ you can read [Reliable Benchmarking: Requirements and Solutions](https://doi.org/10.1007/s10009-017-0469-y) online.
+ We also provide a set of [overview slides](https://www.sosy-lab.org/research/prs/Latest_ReliableBenchmarking.pdf).
+
+BenchExec provides three major features:
+
+- execution of arbitrary commands with precise and reliable measurement
+ and limitation of resource usage (e.g., CPU time and memory),
+ and isolation against other running processes
+- an easy way to define benchmarks with specific tool configurations
+ and resource limits,
+ and automatically executing them on large sets of input files
+- generation of interactive tables and plots for the results
+
+Contrary to other benchmarking frameworks,
+it is able to reliably measure and limit resource usage
+of the benchmarked tool even if it spawns subprocesses.
+In order to achieve this,
+it uses the [cgroups feature](https://www.kernel.org/doc/Documentation/cgroup-v1/cgroups.txt)
+of the Linux kernel to correctly handle groups of processes.
+For proper isolation of the benchmarks, it uses (if available)
+Linux [user namespaces](http://man7.org/linux/man-pages/man7/namespaces.7.html)
+and an [overlay filesystem](https://www.kernel.org/doc/Documentation/filesystems/overlayfs.txt)
+to create a [container](https://github.com/sosy-lab/benchexec/blob/main/doc/container.md)
+that restricts interference of the executed tool with the benchmarking host.
+BenchExec is intended for benchmarking non-interactive tools on Linux systems.
+It measures CPU time, wall time, and memory usage of a tool,
+and allows to specify limits for these resources.
+It also allows to limit the CPU cores and (on NUMA systems) memory regions,
+and the container mode allows to restrict filesystem and network access.
+In addition to measuring resource usage,
+BenchExec can verify that the result of the tool was as expected,
+and extract further statistical data from the output.
+Results from multiple runs can be combined into CSV and interactive HTML tables,
+of which the latter provide scatter and quantile plots
+(have a look at our [demo table](https://sosy-lab.github.io/benchexec/example-table/svcomp-simple-cbmc-cpachecker.table.html)).
+
+BenchExec works only on Linux and needs a one-time setup of cgroups by the machine's administrator.
+The actual benchmarking can be done by any user and does not need root access.
+
+BenchExec was originally developed for use with the software verification framework
+[CPAchecker](https://cpachecker.sosy-lab.org)
+and is now developed as an independent project
+at the [Software Systems Lab](https://www.sosy-lab.org)
+of the [Ludwig-Maximilians-Universität München (LMU Munich)](https://www.uni-muenchen.de).
+
+### Links
+
+- [Documentation](https://github.com/sosy-lab/benchexec/tree/main/doc/INDEX.md)
+- [Demo](https://sosy-lab.github.io/benchexec/example-table/svcomp-simple-cbmc-cpachecker.table.html) of a result table
+- [Downloads](https://github.com/sosy-lab/benchexec/releases)
+- [Changelog](https://github.com/sosy-lab/benchexec/tree/main/CHANGELOG.md)
+- [BenchExec GitHub Repository](https://github.com/sosy-lab/benchexec),
+ use this for [reporting issues and asking questions](https://github.com/sosy-lab/benchexec/issues)
+- [BenchExec at PyPI](https://pypi.python.org/pypi/BenchExec)
+- [BenchExec at Zenodo](https://doi.org/10.5281/zenodo.1163552): Each release gets a DOI such that you can reference it from your publications and artifacts.
+
+### Literature
+
+- [Reliable Benchmarking: Requirements and Solutions](https://doi.org/10.1007/s10009-017-0469-y), by D. Beyer, S. Löwe, and P. Wendler. International Journal on Software Tools for Technology Transfer (STTT), 21(1):1-29, 2019. [doi:10.1007/s10009-017-0469-y](https://doi.org/10.1007/s10009-017-0469-y). Journal paper about BenchExec (open access, also with a [supplementary webpage](https://www.sosy-lab.org/research/benchmarking/) and [overview slides](https://www.sosy-lab.org/research/prs/Latest_ReliableBenchmarking.pdf))
+- [CPU Energy Meter: A Tool for Energy-Aware Algorithms Engineering](https://doi.org/10.1007/978-3-030-45237-7_8), by D. Beyer and P. Wendler. In Proc. TACAS 2020, part 2, LNCS 12079, pages 126-133, 2020. Springer. [doi:10.1007/978-3-030-45237-7_8](https://doi.org/10.1007/978-3-030-45237-7_8)
+- [Benchmarking and Resource Measurement](https://doi.org/10.1007/978-3-319-23404-5_12), by D. Beyer, S. Löwe, and P. Wendler. In Proc. SPIN 2015, LNCS 9232, pages 160-178, 2015. Springer. [doi:10.1007/978-3-319-23404-5_12](https://doi.org/10.1007/978-3-319-23404-5_12)
+
+### License and Copyright
+
+BenchExec is licensed under the [Apache 2.0 License](https://www.apache.org/licenses/LICENSE-2.0),
+copyright [Dirk Beyer](https://www.sosy-lab.org/people/beyer/).
+Exceptions are some tool-info modules
+and third-party code that is bundled in the HTML tables,
+which are available under several other free licenses
+(cf. [folder `LICENSES`](https://github.com/sosy-lab/benchexec/tree/main/LICENSES)).
+
+### Authors
+Maintainer: [Philipp Wendler](https://www.philippwendler.de)
+
+Contributors:
+- [Aditya Arora](https://github.com/alohamora)
+- [Dirk Beyer](https://www.sosy-lab.org/people/beyer/)
+- [Laura Bschor](https://github.com/laurabschor)
+- [Thomas Bunk](https://github.com/TBunk)
+- [Montgomery Carter](https://github.com/MontyCarter)
+- [Andreas Donig](https://github.com/adonig)
+- [Karlheinz Friedberger](https://www.sosy-lab.org/people/friedberger)
+- Peter Häring
+- [Florian Heck](https://github.com/fheck)
+- [Hugo](https://github.com/hugovk)
+- [George Karpenkov](http://metaworld.me/)
+- [Mike Kazantsev](http://fraggod.net/)
+- [Michael Lachner](https://github.com/lachnerm)
+- [Thomas Lemberger](https://www.sosy-lab.org/people/lemberger/)
+- [Sebastian Ott](https://github.com/ottseb)
+- Stefan Löwe
+- [Stephan Lukasczyk](https://github.com/stephanlukasczyk)
+- [Alexander von Rhein](http://www.infosun.fim.uni-passau.de/se/people-rhein.php)
+- [Alexander Schremmer](https://www.xing.com/profile/Alexander_Schremmer)
+- [Dennis Simon](https://github.com/DennisSimon)
+- [Andreas Stahlbauer](http://stahlbauer.net/)
+- [Thomas Stieglmaier](https://stieglmaier.me/)
+- [Martin Yankov](https://github.com/marto97)
+- [Ilja Zakharov](https://github.com/IljaZakharov)
+- and [lots of more people who integrated tools into BenchExec](https://github.com/sosy-lab/benchexec/graphs/contributors)
+
+### Users of BenchExec
+
+BenchExec was successfully used for benchmarking in all instances
+of the international competitions on [Software Verification](https://sv-comp.sosy-lab.org)
+and [Software Testing](https://test-comp.sosy-lab.org)
+with a wide variety of benchmarked tools and hundreds of thousands benchmark runs.
+It is integrated into the cluster-based logic-solving service
+[StarExec](https://www.starexec.org/starexec/public/about.jsp) ([GitHub](https://github.com/StarExec/StarExec)).
+
+The developers of the following tools use BenchExec:
+
+- [CPAchecker](https://cpachecker.sosy-lab.org), also for regression testing
+- [Dartagnan](https://github.com/hernanponcedeleon/Dat3M)
+- [SMACK](https://github.com/smackers/smack)
+- [SMTInterpol](https://github.com/ultimate-pa/smtinterpol)
+- [Ultimate](https://github.com/ultimate-pa/ultimate)
+
+If you would like to be listed here, [contact us](https://github.com/sosy-lab/benchexec/issues/new).
+
+
+
+
+%prep
+%autosetup -n BenchExec-3.16
+
+%build
+%py3_build
+
+%install
+%py3_install
+install -d -m755 %{buildroot}/%{_pkgdocdir}
+if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi
+if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi
+if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi
+if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi
+pushd %{buildroot}
+if [ -d usr/lib ]; then
+ find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst
+fi
+if [ -d usr/lib64 ]; then
+ find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst
+fi
+if [ -d usr/bin ]; then
+ find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst
+fi
+if [ -d usr/sbin ]; then
+ find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst
+fi
+touch doclist.lst
+if [ -d usr/share/man ]; then
+ find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst
+fi
+popd
+mv %{buildroot}/filelist.lst .
+mv %{buildroot}/doclist.lst .
+
+%files -n python3-BenchExec -f filelist.lst
+%dir %{python3_sitelib}/*
+
+%files help -f doclist.lst
+%{_docdir}/*
+
+%changelog
+* Tue Apr 11 2023 Python_Bot <Python_Bot@openeuler.org> - 3.16-1
+- Package Spec generated
diff --git a/sources b/sources
new file mode 100644
index 0000000..aec7e7e
--- /dev/null
+++ b/sources
@@ -0,0 +1 @@
+566304bb7ea0b29393c0196142fa5ea3 BenchExec-3.16.tar.gz