The challenges of data quality and data quality assessment in the big data era

184Citations
Citations of this article
743Readers
Mendeley users who have this article in their library.

Abstract

High-quality data are the precondition for analyzing and using big data and for guaranteeing the value of the data. Currently, comprehensive analysis and research of quality standards and quality assessment methods for big data are lacking. First, this paper summarizes reviews of data quality research. Second, this paper analyzes the data characteristics of the big data environment, presents quality challenges faced by big data, and formulates a hierarchical data quality framework from the perspective of data users. This framework consists of big data quality dimensions, quality characteristics, and quality indexes. Finally, on the basis of this framework, this paper constructs a dynamic assessment process for data quality. This process has good expansibility and adaptability and can meet the needs of big data quality assessment. The research results enrich the theoretical scope of big data and lay a solid foundation for the future by establishing an assessment model and studying evaluation algorithms.

Cite

CITATION STYLE

APA

Cai, L., & Zhu, Y. (2015). The challenges of data quality and data quality assessment in the big data era. In Data Science Journal (Vol. 14). Committee on Data for Science and Technology. https://doi.org/10.5334/dsj-2015-002

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free