|
|
Paper: |
Aggregating Metadata from Multiple Archives: a Non-VO Approach |
Volume: |
495, Astronomical Data Analysis Software and Systems XXIV (ADASS XXIV) |
Page: |
413 |
Authors: |
Gwyn, S. D. J. |
Abstract: |
The Solar System Object Image Search (SSOIS) tool at the Canadian
Astronomy Data Centre allows users to search for images of moving
objects taken with a large number of ground-based and space-based
telescopes. (Gwyn et al. 2012). The ever-growing list of
telescopes includes HST, Subaru, CFHT, Gemini, SDSS, AAT, NEAT, NOAO,
WISE and the ING and ESO telescopes. The first step in constructing
SSOIS is to agregate the metadata from the various archives. An
effective search requires the RA, Dec, and time of the exposure, and
the field of view of the instrument. The archives are extremely
hetergeneous; in some cases the interface dates back to the
1990s. After scraping these archives, four lessons have been learned:
1) The more primitive the archive, the easier it is to scrape. 2)
Simple Image Access Protocol (SIAP) is not an effective means of
scraping archives. 3) When scraping an archive with multiple queries,
the queries should be done by time rather by than sky position. 4)
Retrieving the metadata is relatively easy, the hard work is in the
quality control and understanding each telescope/instrument. |
|
|
|
|