Back to Volume
Paper: Data Processing in Subaru Strategic Survey Program with Hyper Suprime-Cam
Volume: 527, Astronomical Data Analysis Software and Systems XXIX
Page: 697
Authors: Furusawa, H.; Koike, M.; Mineo, S.; Yamada, Y.; Ikeda, H.; Takita, S.; Okura, Y.; Tanaka, M.; Takata, T.
Abstract: The Subaru Strategic Program (SSP) with Hyper Suprime-Cam (HSC) is an ongoing wide-field imaging survey project at Subaru Telescope. The project aims at providing well-calibrated science-ready data products to the astronomical community. Data processing involves a quick quality assurance at the observing site (onsite QA), and full production run conducted in Japan. The onsite QA system extracts raw data quality being ingested to a QA database. We refer to this database to determine exposures to be combined into the final products. The full production work happens once or twice a year, generating over 500TB data sets in each of data releases. These products are transferred to the science data archive site for external access, that include the two public data releases. The data processing pipelines are run across on-premise PC clusters equipped with fast file systems, so that the whole procedure could be done within a ~2 months time scale. We have also been actively updating the pipeline software to improve the products.
Back to Volume