| |
 |
| Paper: |
ASKAPsoft Pipeline Gets Ready for the Pilot Surveys |
| Volume: |
527, Astronomical Data Analysis Software and Systems XXIX |
| Page: |
591 |
| Authors: |
Wieringa, M.; Ord, S.; Raja, W. |
| Abstract: |
The ASKAP (Australian Square Kilometre Array Pathfinder) telescope is in its final commissioning and testing phase. We have now begun the Pilot Surveys to test readiness of the pipelines for the start of the full surveys in 2020.
The data processing for ASKAP is done on the dedicated Galaxy supercomputer at the Pawsey Centre in Perth using the MPI–based ASKAPsoft package. Semi–automated processing by operators is performed using processing pipelines built on top of the basic flagging, calibration and imaging tasks. Over the last two years the individual tasks, the pipelines and the data access patterns have been optimised to try and cope with the rapidly increasing data volumes (currently up to 40 TB per 10h spectral line observation) in as close to real time as we can manage. Unless we can process the full spectral line datasets into science ready archive data in near real time, spectral line survey progress will be limited by available disk space and processing backlogs. We will describe the path to the current performance of the pipelines for the pilot surveys and discuss our plans for further performance improvements. |
|
|
|
|
|
