ASPCS
 
Back to Volume
Paper: Recording the History of Herschel\footnotemark Data Processing in the Data Products
Volume: 442, Astronomical Data Analysis Software and Systems XX (ADASSXX)
Page: 371
Authors: de Jong, J. A.; Huygen, R.; Bakker, J.; Wieprecht, E.; Vavrek, R.; Wetzstein, M.; Schreiber, J.; Sturm, E.; Ott, S.
Abstract: We present how the history is recorded during data processing with the Herschel Common Science System (HCSS), and how users can inspect this in the Herschel Interactive Processing Environment (HIPE). The Herschel DP software records after the execution of each (pipeline) task all information needed to redo the task. This includes the name of the task, the used software version, input parameter names and their values. In case an input parameter is a product, the complete history of that product and if available a human readable identifier (such as a calibration filename) is recorded. Also, the final product contains the complete chain of tasks needed to reproduce that product from the raw data. The history information is stored in two binary tables when the product is saved as a FITS file. Users can inspect this dataset with a dedicated viewer in HIPE, or get it as a Python script to redo the reduction with optional changes to the parameters.
Back to Volume