Reproducing StarfishDB's Experiments

Reproducing StarfishDB's Experiments
Our team recently received exciting news from the ACM SIGMOD 2024 reproducibility committee. Independent researchers have successfully reproduced the experiments from our paper "StarfishDB: A Query Execution Engine for Relational Probabilistic Programming," confirming our findings about this new approach to probabilistic databases.

Our system earned all three reproducibility badges offered by SIGMOD: Available, Functional, and Reproducible. These badges recognize that our artifacts are publicly accessible, can be successfully built and executed, and that our experimental results could be independently reproduced.

Assessment Process

The reproducibility assessment was conducted using our provided GitHub repository and experimental framework. The evaluators ran experiments on datasets including NYTIMES and PUBMED, testing our system's performance in implementing probabilistic models, support for recursion, and computational efficiency.

Documentation and Resources

For researchers interested in our work, the following resources are available:

Based on feedback received during the assessment, we have implemented several improvements to our reproducibility package, including enhanced data verification mechanisms, automated recovery procedures, and more comprehensive documentation.

We thank the SIGMOD reproducibility committee for their thorough evaluation of our work.