Data Organization, Management and Access (DOMA)
The HL-LHC era will provide enormous challenges in the area of Data Organization, Management and Access (DOMA). The LHC will provide a significantly increased number of events and increased event complexity, both of which will drive much larger data sizes - with no changes in how the LHC community functions, the total increase in data volume may be a factor of 30.
Given the LHC experiments are, combined, managing nearly an exabyte of data, such a significant increase in volume is unmanageable. New mechanisms and techniques are necessary to more efficiently manage storage resources; the DOMA area in IRIS-HEP is working on the R&D necessary to affect such change.
It is not only data volumes that are potentially disruptive to the HL-LHC physics program; the extraordinarily large number of events (potentially 150 billion similated and recorded events per year per experiment) presents a challenge in data management for users. Along with the analysis systems team within IRIS, DOMA is working on improved techniques for delivering events to users.
Contact us: firstname.lastname@example.org
- 20 Mar 2019 - Data Access in DOMA, Frank Wuerthwein (University of California, San Diego), HOW2019 (Joint HSF/OSG/WLCG Workshop)
- 20 Mar 2019 - Data Access at HPC: ATLAS/CMS Perspective, Frank Wuerthwein (University of California, San Diego), HOW2019 (Joint HSF/OSG/WLCG Workshop)
- 20 Mar 2019 - WLCG DOMA TPC Updates, Brian Bockelman (Morgridge Institute), 2019 Joint HSF/OSG/WLCG Workshop (HOW2019)
- 06 Mar 2019 - Scientific Data Lifecycle: Perspectives from an LHC Physicist, Shawn McKee (University of Michigan-Ann Arbor), MAGIC Meeting
- 26 Feb 2019 - Skyhook: programmable storage for databases, Jeff LeFevre (University of California, Santa Cruz), Vault'19
- 06 Feb 2019 - IRIS-HEP DOMA, Brian Bockelman (Morgridge Institute), IRIS-HEP Steering Board Meeting
- 02 Oct 2018 - Current production use of caching for CMS in Southern California, Edgar Fajardo (University of California, San Diego), DOMA / ACCESS Meeting
- 16 Nov 2017 - SkyhookDB - Leveraging object storage toward database elasticity in the cloud, Jeff LeFevre (University of California, Santa Cruz), DOMA Workshop 2017 (Flatiron Institute)
We collaborate with groups around the world on code, data, and more. See our project pages for more.