Efficient Query Re-optimization with Judicious Subquery Selections

  • Zhao J
  • Zhang H
  • Gao Y
N/ACitations
Citations of this article
9Readers
Mendeley users who have this article in their library.

Abstract

Query re-optimization is an adaptive query processing technique that re-invokes the optimizer at certain points in query execution. The goal is to dynamically correct the cardinality estimation errors using the statistics collected at runtime to adjust the query plan to improve the overall performance. We identify a key weakness in existing re-optimization algorithms: their subquery division and re-optimization trigger strategies rely heavily on the optimizer's initial plan, which can be far away from optimal. We, therefore, propose QuerySplit, a novel re-optimization algorithm that skips the potentially misleading global plan and instead generates subqueries directly from the logical plan as the basic re-optimization units. By developing a cost function that prioritizes the execution of less "damaging" subqueries, QuerySplit successfully postpones (sometimes avoids) the execution of complex large joins to maximize their probability of having smaller input sizes. We implemented QuerySplit in PostgreSQL and compared our solution against four state-of-the-art re-optimization algorithms using the Join Order Benchmark. Our experiments show that QuerySplit reduces the benchmark execution time by 35% compared to the second-best alternative. The performance gap between QuerySplit and an optimal optimizer is within 4%.

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Zhao, J., Zhang, H., & Gao, Y. (2023). Efficient Query Re-optimization with Judicious Subquery Selections. Proceedings of the ACM on Management of Data, 1(2), 1–26. https://doi.org/10.1145/3589330

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 3

50%

Lecturer / Post doc 2

33%

Researcher 1

17%

Readers' Discipline

Tooltip

Computer Science 5

83%

Engineering 1

17%

Save time finding and organizing research with Mendeley

Sign up for free