The Scikit-HEP project is a community-driven and community-oriented project with the aim of providing Particle Physics at large with a Python package containing core and common tools. The project started in Autumn 2016 and is under active development.
For what concerns the project grand structure, it should be seen as a toolset rather than a toolkit. It is not just about providing common tools for the community. It is also about improving on discoverability of utility packages and projects.
Scikit-HEP should be seen as a toolset of Python packages. The project defines a set of five pillars, which are seen to embrace all major topics involved in a physicist’s work. These are:
- Datasets: data in various sources, such as ROOT, NumPy/Pandas, databases, wrapped in a common interface.
- Aggregations: e.g. histograms that summarize or project a dataset.
- Modeling: data models and fitting utilities.
- Simulation: wrappers for Monte Carlo engines and other generators of simulated data.
- Visualization: interface to graphics engines, from ROOT and Matplotlib to even beyond.
Team
Presentations
- 21 Oct 2024 - "HEP-Help: a first-stop helpline for particle physics software", Jim Pivarski, CHEP 2024
- 18 Jul 2024 - "Columnar analysis and Awkward", Jim Pivarski, US ATLAS / IRIS-HEP Analysis Software Training Event 2024
- 20 Jun 2024 - "Columnar analysis and Awkward", Jim Pivarski, USCMS/IRIS-HEP Analysis Software Training
- 24 May 2024 - "Scientific Python with GPUs", Ianna Osborne, HSF-India HEP Software Workshop at the University of Delhi
- 22 May 2024 - "Scientific Python", Jim Pivarski, HSF-India HEP Software Workshop at the University of Delhi
- 11 Mar 2024 - "Awkward Family (poster)", Jim Pivarski, ACAT 2024
- 18 Dec 2023 - "Python tutorials", Jim Pivarski, HSF-India HEP Software Workshop at NISER - Bhubaneswar
- 9 May 2023 - "Analysis of physics analysis", Jim Pivarski, CHEP 2023
- 5 May 2023 - "Scientific Python", Jim Pivarski, HSF-India Training event at TIFR
- 28 Sep 2022 - "Status of Analysis - The Python Perspective", Jim Pivarski, Future Trends in Nuclear Physics Computing
- 15 Sep 2022 - "End-to-end physics analysis with Open Data: the Analysis Grand Challenge", Alexander Held, PyHEP 2022 (virtual) Workshop
- 8 Sep 2022 - "Adoption of Python and modern software practices in high energy physics", Jim Pivarski, CHESS Group Meeting
- 3 Aug 2022 - "Columnar data analysis (tutorial)", Jim Pivarski, Fourth Computational and Data Science for High Energy Physics (CoDaS-HEP) School
- 15 Jul 2022 - "Building binary extensions with pybind11, scikit build, and cibuildwheel" , Henry Schreiner, SciPy 2022
- 14 Jul 2022 - "Awkward Packaging: building Scikit-HEP" , Henry Schreiner, SciPy 2022
- 23 May 2022 - "Analysis user experience with the Python HEP ecosystem", Jim Pivarski, Analysis Ecosystems Workshop II
- 13 Sep 2021 - "Uproot/Awkward Array tutorial for STAR", Jim Pivarski, STAR Junior's meeting
- 6 Jul 2021 - "Uproot/Awkward Array tutorial", Jim Pivarski, PyHEP 2021
- 14 Jun 2021 - "Uproot Awkward Columnar HATS", Jim Pivarski, Hands-on Advanced Tutorial Sessions at the LPC
- 4 May 2021 - "Pythonic Data Science", Jim Pivarski, HL-LHC Analysis Mini-Workshop
- 20 Nov 2020 - "Survey and status of Pythonic HEP analysis tools", Jim Pivarski, CMS Physics Workshop on Analysis Tools and Techniques
- 26 Oct 2020 - "Access & Manipulation of Complex Data Structures: Uproot & Awkward Array", Jim Pivarski, Future Analysis Systems and Facilities
- 1 Oct 2020 - "Future of User Analysis", Jim Pivarski, LHCb Computing Workshop
- 11 Aug 2020 - "Measuring Python adoption by CMS physicists using GitHub API", Jim Pivarski, Snowmass Computational Frontier Workshop 2020
- 15 Jul 2020 - "Uproot and Awkward Array tutorial", Jim Pivarski, PyHEP 2020
- 8 Jun 2020 - "Uproot Awkward columnar HATS", Jim Pivarski, LPC HATS: Hands-on Training for CMS
- 8 Apr 2020 - "Uproot and Awkward Array tutorials for the Electron Ion Collider", Jim Pivarski, Electron Ion Collider User's meeting
- 27 Feb 2020 - "Awkward Arrays for Analysis Systems", Jim Pivarski, IRIS-HEP Review
- 17 Oct 2019 - "Awkward 1.0", Jim Pivarski, PyHEP Workshop
- 29 Jul 2019 - "IRIS-HEP Tutorial: Fast columnar data analysis with data science tools", Jim Pivarski, Division of Particles and Fields (DPF) of the American Physical Society (APS)
- 19 Jun 2019 - "Update on awkward-array, uproot, and related projects", Jim Pivarski, Analysis Systems Topical Workshop
- 18 Jun 2019 - "Uproot: accessing ROOT data in the scientific Python ecosystem", Jim Pivarski, 3rd CMS Machine Learning Workshop
- 10 Jun 2019 - "NumPy, Pandas, PyROOT, and Uproot", Jim Pivarski, U.S. ATLAS Software Training at Argonne National Lab
- 29 May 2019 - "Columnar Analysis Tools HATS", Jim Pivarski, LPC HATS: Hands-on Training for CMS
- 28 May 2019 - "Scientific Python and Uproot HATS", Jim Pivarski, LPC HATS: Hands-on Training for CMS
- 15 Apr 2019 - "Aghast", Jim Pivarski, IRIS-HEP Topical Meetings
- 1 Apr 2019 - "PyROOT, uproot, and awkward-arrays", Jim Pivarski, Software Carpentry at Fermilab
Publications
- How the Scientific Python ecosystem helps answer fundamental questions of the Universe, Matthew Feickert, Nikolai Hartmann, Lukas Heinrich, Alexander Held, Vangelis Kourlitis, Nils Krumnack, Giordon Stark, Matthias Vigl, Gordon Watts, SciPy 2024 (10 Jul 2024).
- Awkward Packaging: building Scikit-HEP, Henry Schreiner, Jim Pivarski, Eduardo Rodrigues, SciPy 2022 (14 Jul 2022).
- An array-oriented Python interface for FastJet, A. Roy, J. Pivarski and C. Freer, J.Phys.Conf.Ser. 2438 012011 (2023) (08 Feb 2022) [1 citation] [NSF PAR].
- HL-LHC Computing Review Stage 2: Common Software Projects: Data Science Tools for Analysis, J. Pivarski, E. Rodrigues, K. Pedro, O. Shadura, B. Krikler and G. Stewart, arXiv 2202.02194 (04 Feb 2022) [4 citations].