Rucio, the next-generation Data Management system in ATLAS

6Citations
Citations of this article
9Readers
Mendeley users who have this article in their library.

Abstract

Rucio is the next-generation of Distributed Data Management (DDM) system benefiting from recent advances in cloud and "Big Data" computing to address HEP experiments scaling requirements. Rucio is an evolution of the ATLAS DDM system Don Quixote 2 (DQ2), which has demonstrated very large scale data management capabilities with more than 160 petabytes spread worldwide across 130 sites, and accesses from 1,000 active users. However, DQ2 is reaching its limits in terms of scalability, requiring a large number of support staff to operate and being hard to extend with new technologies. Rucio addresses these issues by relying on new technologies to ensure system scalability, cover new user requirements and employ new automation framework to reduce operational overheads. This paper shows the key concepts of Rucio, details the Rucio design, and the technology it employs, the tests that were conducted to validate it and finally describes the migration steps that were conducted to move from DQ2 to Rucio.

Cite

CITATION STYLE

APA

Serfon, C., Barisits, M., Beermann, T., Garonne, V., Goossens, L., Lassnig, M., … Vigne, R. (2016). Rucio, the next-generation Data Management system in ATLAS. Nuclear and Particle Physics Proceedings, 273275, 969–975. https://doi.org/10.1016/j.nuclphysbps.2015.09.151

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free