ASPCS
 
Back to Volume
Paper: The Ground-based O/IR Data Preservation Challenge at NOAO: Scaling up from Terabytes to Petabytes
Volume: 394, Astronomical Data Analysis Software and Systems (ADASS) XVII
Page: 446
Authors: Smith, R.C.; the Data Products Team
Abstract: Large optical and IR mosaic cameras are becoming commonplace at ground-based O/IR telescope facilities. While the data flowing from these cameras pose a data reduction and analysis challenge for the PIs to extract their initial science, the large data volumes also imply significant data preservation challenges for the archive centers which are hoping to hold both the raw data and reduced data products. NOAOs current suite of two MOSAIC cameras, recently augmented by a wide-field IR imager called NEWFIRM, are already dominating our data storage and preservation resources. With the arrival of the One Degree Imager (ODI) and the Dark Energy Camera (DECam), the challenge quickly becomes one of petabyte scale. We describe our current development, testing, and operational program and our plans to scale to these data volumes.
Back to Volume