|
|
Paper: |
Data Management Challenges in Gaia |
Volume: |
495, Astronomical Data Analysis Software and Systems XXIV (ADASS XXIV) |
Page: |
47 |
Authors: |
Hernandez, J.; Hutton, A. |
Abstract: |
Gaia was launched this past December from French Guiana. After the Payload was switched on in January, Gaia started observing the sky and has been sending us its observations. On a regular day Gaia sends down to earth 30 million observations. The raw data gets processed daily at ESAC and then different sets get sent to 5 other data processing centers. Ensuring the correct processing and tracking of all the data through the processing pipelines represents a formidable challenge and requires new ways of doing the data management. The processing of the data will be iterative and will last more than 5 years, each data processing center will perform one part of the data reduction. We outline how we manage the data flow between the different pipelines running in each center. |
|
|
|
|