| |
 |
| Paper: |
Archive-2.0: Metadata and Data Synchronization Between MAST,
CADC, and ESAC |
| Volume: |
523, Astronomical Data Analysis Software and Systems XXVIII |
| Page: |
425 |
| Authors: |
Dowler, P.; Arevalo, M.; Damian, A.; Duran, J.; Durand, D.; Gaudet, S.; Hargis, J.; Major, B.; McLean, B.; Oberdorf, O.; Rodriguez, D. R. |
| Abstract: |
The Canadian Astronomy Data Centre (CADC) and the European Space Astronomy Centre (ESAC) maintain mirrors of and provide user access to the HST data collection. A new mirroring approach was needed to improve consistency and support future missions like JWST. The Common Archive Observation Model (CAOM) is used as the core model for all data holdings at the CADC and the Mikulski Archive for Space Telescopes (MAST) and was extended to support a metadata and data synchronization system.
The metadata synchronization process relies on a simple RESTful web service operated by the metadata source (MAST) and a metadata harvesting tool run by the mirror centers (CADC and ESAC). The data synchronization process uses CAOM metadata to discover and retrieve files from the source (MAST) to the mirror sites. Through the use a backend plugins, the CADC and ESAC have extended the file synchronization tool to interface with their respective site-specific storage systems.
Using the common metadata model, services and tools as a base, partners can augment their own system with additional information specifically intended to provide added value features. ESAC provides information about publications in their instance of the Archive and both CADC and ESAC provide additional IVOA services for users. |
|
|
|
|
|
