Many beamlines have the need to check the quality of data during or shortly after acquisition to ensure the data is good enough for analysis and interpretation. To address this the APS is developing a data quality verifier toolbox to serve as a framework for monitoring data and applying quality checks before, during, and after data acquisition. The toolbox monitors data files and compares files against predefined schemas that specify the expected output, applies check to streaming, over the wire, data form the Area Detector software package, performs online and offline computation of statistical methods, such as mean, standard deviation, delta mean, etc., and verifies that EPICS PVs are within expected ranges. This software saves beam time by alerting users when results are out of expected ranges. It is deployed for use at 1-ID, 2-BM, and 32-ID. This software will continue to be adapted to new uses and deployed are more beamlines in the coming years.

https://github.com/bfrosik/data-quality

http://data-quality.readthedocs.io/

The Data Quality Verification Toolbox is developed by Barbara Frosik in the XSD Scientific Software Engineering & Data Management group working with Assistant Computational Scientist Doga Gursoy of the XSD Computational X-ray Science group and beamline scientists from the XSD Imaging and XSD Material Physics & Engineering groups with funding from DE-AC02-06CH11357.

Argonne National Laboratory is supported by the Office of Science of the U.S. Department of Energy. The Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov.