Explanipedia

Advancing Large-Scale Scientific Collaborations with Rucio Open

Hugo González Labrador, M-S. Barisits · 2025

This article provides an overview of the data deluge observed and projected in the next decade in high-energy physics and related sciences, and how Rucio, a mature and modular scientific data management platform used by various scientific …

Extending Rucio with modern cloud storage support Open

M-S. Barisits, R. M. Barnsley, Fernando Harald Barreiro Megino, J. Elmsheuser, M. Lassnig , et al. · 2024

Rucio is a software framework designed to facilitate scientific collaborations in efficiently organising, managing, and accessing extensive volumes of data through customizable policies. The framework enables data distribution across globa…

Common Software Activities in Data Organisation, Management, and Access (DOMA) Open

Marian Babik, M-S. Barisits, Andrea Ceccanti, Michael Davis, Alastair Dewhurst , et al. · 2022

This document represents the Data Organisation, Management and Access (“DOMA”) contribution to the HL-LHC Computing Review Stage 2: Common Software Activities. The document describes the four main areas requested in the charge. It is struc…

Experience with Rucio in the wider HEP community Open

M-S. Barisits, C. Serfon, T Beermann, D Cameron, J.A James Clark , et al. · 2021

\nManaging the data of scientific projects is an increasingly complicated challenge, which was historically met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments ma…

Experience with Rucio in the wider HEP community Open

M-S. Barisits, T. A. Beermann, D. Cameron, J. A. Clark, R. Di Maria , et al. · 2021

Managing the data of scientific projects is an increasingly complicated challenge, which was historically met by developing experiment-specific solutions. However, the ever-growing data rates and requirements of even small experiments make…

Forecasting network throughput of remote data access in computing grids Open

Volodimir Begy, M-S. Barisits, M. Lassnig, Erich Schikuta · 2020

ATLAS Data Carousel Open

M-S. Barisits, M. Borodin, A. Di Girolamo, J. Elmsheuser, D. Golubkov , et al. · 2020

The ATLAS experiment at CERN’s LHC stores detector and simulation data in raw and derived data formats across more than 150 Grid sites world-wide, currently in total about 200PB on disk and 250PB on tape. Data have different access charact…

Rucio beyond ATLAS: experiences from Belle II, CMS, DUNE, EISCAT3D, LIGO/VIRGO, SKA, XENON Open

M. Lassnig, M-S. Barisits, P. Laycock, C. Serfon, Eric Wayne Vaandering , et al. · 2020

For many scientific projects, data management is an increasingly complicated challenge. The number of data-intensive instruments generating unprecedented volumes of data is growing and their accompanying workflows are becoming more complex…

Author Index Open

Elias el Khaldi Ahanach, Ruth Ahnert, Álvarez Cid-Fuentes, Icaro Alzuru, Pierre Andrieu , et al. · 2019

Simulating Data Access Profiles of Computational Jobs in Data Grids Open

Volodimir Begy, Joeri Hermans, M-S. Barisits, M. Lassnig, Erich Schikuta · 2019

The data access patterns of applications running in computing grids are changing due to the recent proliferation of high speed local and wide area networks. The data-intensive jobs are no longer strictly required to run at the computing si…

A roadmap for HEP software and computing R&D for the 2020s Open

J. Albrecht, A. A. Alves, G. Amádio, Giuseppe Andronico, Nguyen Anh-Ky , et al. · 2019

Evolution of the open-source data management system Ru-cio for LHC Run-3 and beyond ATLAS Open

M-S. Barisits, T. A. Beermann, Joaquin Bogado, V. Garonne, T. Javůrek , et al. · 2019

Rucio, the distributed data management system of the ATLAS experiment already manages more than 400 Petabytes of physics data on the grid. Rucio was incrementally improved throughout LHC Run-2 and is currently being prepared for the HL-LHC…

Simulating Data Access Profiles of Computational Jobs in Data Grids Open

Volodimir Begy, Joeri Hermans, M-S. Barisits, M. Lassnig, Erich Schikuta · 2019

peer reviewed

The Data Ocean Project Open

M-S. Barisits, F. Barreiro, T. A. Beermann, Karan Bhatia, K. De , et al. · 2019

Transparent use of commercial cloud resources for scientific experiments is a hard problem. In this article, we describe the first steps of the Data Ocean R&D collaboration between the high-energy physics experiment ATLAS together with Goo…

Remote data access in computational jobs on the ATLAS data grid Open

Volodimir Begy, M-S. Barisits, M. Lassnig, Erich Schikuta · 2019

This work describes the technique of remote data access from computational jobs on the ATLAS data grid. In comparison to traditional data movement and stage-in approaches it is well suited for data transfers which are asynchronous with res…

The ATLAS Data Management System Rucio: Supporting LHC Run-2 and beyond Open

M-S. Barisits, T. A. Beermann, V. Garonne, T. Javůrek, M. Lassnig , et al. · 2018

With this contribution we present some recent developments made to Rucio, the data management system of the High-Energy Physics Experiment ATLAS. Already managing 300 Petabytes of both official and user data, Rucio has seen incremental imp…

slaclab/containers Open

T. A. Beermann, M. Lassnig, Eric Vaandering, Benedikt Ziemons, B. R. White , et al. · 2018

Containers for Rucio.

Automatic rebalancing of data in ATLAS distributed data management Open

M-S. Barisits, C. Serfon, V. Garonne, M. Lassnig, T. A. Beermann , et al. · 2017

The ATLAS Distributed Data Management system stores more than 220PB of physics data across more than 130 sites globally. Rucio, the next generation data management system of the ATLAS collaboration, has now been successfully operated for t…

Experiences with the new ATLAS Distributed Data Management System Open

V. Garonne, M-S. Barisits, T. A. Beermann, M. Lassnig, C. Serfon , et al. · 2017

The ATLAS Distributed Data Management (DDM) system has evolved drastically in the last two years with the Rucio software fully replacing the previous system before the start of LHC Run-2. The ATLAS DDM system manages now more than 250 peta…

C3PO - A Dynamic Data Placement Agent for ATLAS Distributed Data Management Open

T. A. Beermann, M. Lassnig, M-S. Barisits, C. Serfon, V. Garonne · 2017

This paper introduces a new dynamic data placement agent for the ATLAS distributed data management system. This agent is designed to pre-place potentially popular data to make it more widely available. It therefore incorporates information…

Hybrid simulation models for data-intensive systems Open

M-S. Barisits · 2017

Data-intensive systems are used to access and store massive amounts of data by combining the storage resources of multiple data-centers, usually deployed all over the world, in one system. This enables users to utilize these massive storag…

Rucio, the next-generation Data Management system in ATLAS Open

C. Serfon, M-S. Barisits, T. A. Beermann, V. Garonne, L. Goossens , et al. · 2016

Scalable and fail-safe deployment of the ATLAS Distributed Data Management system Rucio Open

M. Lassnig, R. Vigne, T. A. Beermann, M-S. Barisits, V. Garonne , et al. · 2015

This contribution details the deployment of Rucio, the ATLAS Distributed Data Management system. The main complication is that Rucio interacts with a wide variety of external services, and connects globally distributed data centres under d…

Resource control in ATLAS distributed data management: Rucio Accounting and Quotas Open

M-S. Barisits, C. Serfon, V. Garonne, M. Lassnig, T. A. Beermann , et al. · 2015

The ATLAS Distributed Data Management system manages more than 160PB of physics data across more than 130 sites globally. Rucio, the next generation Distributed Data Management system of the ATLAS experiment, replaced DQ2 in December 2014 …

Monitoring and controlling ATLAS data management: The Rucio web user interface Open

M. Lassnig, T. A. Beermann, R. Vigne, M-S. Barisits, V. Garonne , et al. · 2015

The monitoring and controlling interfaces of the previous data management system DQ2 followed the evolutionary requirements and needs of the ATLAS collaboration. The new data management system, Rucio, has put in place a redesigned web-base…

M-S. Barisits YOU? Author Swipe