Data warehouse ETL+Q auto-scale framework

  • Martins P
  • Abbasi M
  • Furtado P
N/ACitations
Citations of this article
5Readers
Mendeley users who have this article in their library.

Abstract

Abstract:In this paper, we investigate the problem of providing scalability (out and in) to extraction transformation load (ETL) and querying (Q) (ETL+Q) process of data warehouses. In general, data loading, transformation and integration are heavy tasks that are performed only periodically, instead of row by row. Parallel architectures and mechanisms are able to optimise the ETL process by speeding-up each part of the pipeline process as more performance is needed. We propose parallelisation solutions, called AScale, for each part of the ETL+Q, that is, an approach that enables the automatic scalability and freshness of any data warehouse and ETL+Q process. Our results show that the proposed system algorithms can handle scalablity to provide the desired processing speed.Keywords: scalability; freshness; high-rate; performance; parallel processing; distributed systems; database; load-balance; extraction transformation load; ETL; algorithm.Reference to this paper should be made as follows: Martins, P., Abbasi, M. and Furtado, P. (2016) 'Data warehouse ETL+Q auto-scale framework', Int.

Cite

CITATION STYLE

APA

Martins, P., Abbasi, M., & Furtado, P. (2016). Data warehouse ETL+Q auto-scale framework. International Journal of Business Intelligence and Systems Engineering, 1(1), 49. https://doi.org/10.1504/ijbise.2016.081592

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free