IRIS-HEP Fellow: Rahul Agrawal
Fellowship dates: Jun – Sep, 2021
Home Institution: Indian Institute of Technology, Kharagpur (IIT KGP)
Project: Facilitate continuous benchmarking/regression testing for the critical components of SkyhookDMSkyhookDM, a performance-critical distributed storage system developed by embedding Apache Arrow, is a computational storage system. Small changes in the source code's performance-critical parts will often result in significant performance changes. It's essential to keep track of these performance changes so that the project can become more performant over time and avoid silent performance deterioration. To overcome these challenges, the Google benchmark framework can be used to create benchmarks (very similar to unit tests) for all the performance-critical parts of the source code. These benchmarks can be added as a separate job in the CI/CD pipeline, which will get triggered when any particular events like commit/push happen. A web dashboard can also be integrated to monitor the performance results of the CI tests.
More information: My project proposal
Jeff LeFevre (UC Santa Cruz)
Jayjeet Chakraborty (NIT, Durgapur)
- 25 Oct 2021 - "Facilitate continuous benchmarking/regression testing for the critical components of SkyhookDM", Rahul Agrawal, IRIS-HEP Topical Meetings Recording: Facilitate continuous benchmarking/regression testing for the critical components of SkyhookDM