|
|
Paper: |
Big Data Challenges in the Blanco DECam Bulge Survey |
Volume: |
512, Astronomical Data Analysis Software and Systems XXV |
Page: |
189 |
Authors: |
Young, M.; Michael, S. |
Abstract: |
As part of a multi-year effort to survey 200 square degrees of the Southern Milky Way Bulge in SDSS
ugrizY utilizing the Dark Energy Camera (DECam) on the Blanco 4m telescope, the Blanco DECam Bulge
Survey (BDBS) has taken >350k source frames. Utilizing a distributed architecture executing dophot, we have
extracted ∼15 billion source detections from these frames. With one of the primary goals of the survey
being the creation of a catalog as a community resource, we have explored a number of ways to facilitate the
querying and dissemination of this dataset. Here we present initial efforts with the open-source Hadoop
ecosystem, a widely utilized approach to Big Data problems. Running on commodity hardware, we will
demonstrate how out of the box solutions have addressed many of the concerns facing scientists in a future
dominated by Big Data. |
|
|
|
|