Available
Code and/or data available in a stable, public repository.
Requirements
- Available in a stable repository (GitHub, GitLab, ...).
- A README.md with the minimum requirements present in the repository.
Artifact Evaluation
Quality badges
Each artifact can earn up to four badges, assigned independently by the review committee according to the requirements met.
Functional
The artifact can be executed and the reviewer observes its functionality.
Requirements
- List of dependencies and their versions.
- Description of the execution environment.
- Installation and execution instructions.
- A minimal execution example.
Sustainable
Modular, organized, intelligible, and easy-to-understand code.
Requirements
- Minimal code documentation (files, functions, ...).
- Minimal code readability.
- Lets evaluators identify the paper's main claims within the artifact.
Reproducible
The paper's main claims can be reproduced by the reviewer.
Requirements
- Instructions to run the main claims (figures/tables).
- A description of how the experiments were run.
- Scripts that automate reproduction are suggested (VMs, containers).