Back to Volume
Paper: Big Data Challenges in the Blanco DECam Bulge Survey
Volume: 512, Astronomical Data Analysis Software and Systems XXV
Page: 189
Authors: Young, M.; Michael, S.
Abstract: As part of a multi-year effort to survey 200 square degrees of the Southern Milky Way Bulge in SDSS ugrizY utilizing the Dark Energy Camera (DECam) on the Blanco 4m telescope, the Blanco DECam Bulge Survey (BDBS) has taken >350k source frames. Utilizing a distributed architecture executing dophot, we have extracted ∼15 billion source detections from these frames. With one of the primary goals of the survey being the creation of a catalog as a community resource, we have explored a number of ways to facilitate the querying and dissemination of this dataset. Here we present initial efforts with the open-source Hadoop ecosystem, a widely utilized approach to Big Data problems. Running on commodity hardware, we will demonstrate how out of the box solutions have addressed many of the concerns facing scientists in a future dominated by Big Data.
Back to Volume