Data Organization, Management and Access (DOMA)

The HL-LHC era will provide enormous challenges in the area of Data Organization, Management and Access (DOMA). The LHC will provide a significantly increased number of events and increased event complexity, both of which will drive much larger data sizes - with no changes in how the LHC community functions, the total increase in data volume may be a factor of 30.

Given the LHC experiments are, combined, managing nearly an exabyte of data, such a significant increase in volume is unmanageable. New mechanisms and techniques are necessary to more efficiently manage storage resources; the DOMA area in IRIS-HEP is working on the R&D necessary to affect such change.

It is not only data volumes that are potentially disruptive to the HL-LHC physics program; the extraordinarily large number of events (potentially 150 billion similated and recorded events per year per experiment) presents a challenge in data management for users. Along with the analysis systems team within IRIS, DOMA is working on improved techniques for delivering events to users.

Contact us: doma-team@iris-hep.org

DOMA Projects


Card image cap

Caching Analysis Data

Cached-based placement of analysis datasets.
More information
Card image cap

Intelligent Data Delivery Service

Delivering Data. Better.
More information
Card image cap

Modeling Data Worfklows

Modeling HL-LHC Data flows
More information
Card image cap

ServiceX

Delivering columnar data on demand
More information
Card image cap

SkyhookDM

Programmable Storage for Databases and Datasets
More information
Card image cap

Third Party Copy

Envisioning a new way to move LHC data
More information

DOMA Presentations

[expand]

[/expand]

DOMA Publications

Join us

We collaborate with groups around the world on code, data, and more. See our project pages for more.