BugDoc: Algorithms to Debug Computational Processes

11Citations
Citations of this article
27Readers
Mendeley users who have this article in their library.

Abstract

Data analysis for scientific experiments and enterprises, large-scale simulations, and machine learning tasks all entail the use of complex computational pipelines to reach quantitative and qualitative conclusions. If some of the activities in a pipeline produce erroneous outputs, the pipeline may fail to execute or produce incorrect results. Inferring the root cause(s) of such failures is challenging, usually requiring time and much human thought, while still being error-prone. We propose a new approach that makes use of iteration and provenance to automatically infer the root causes and derive succinct explanations of failures. Through a detailed experimental evaluation, we assess the cost, precision, and recall of our approach compared to the state of the art. Our experimental data and processing software is available for use, reproducibility, and enhancement.

Author supplied keywords

Cite

CITATION STYLE

APA

Lourenço, R., Freire, J., & Shasha, D. (2020). BugDoc: Algorithms to Debug Computational Processes. In Proceedings of the ACM SIGMOD International Conference on Management of Data (pp. 463–478). Association for Computing Machinery. https://doi.org/10.1145/3318464.3389763

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free