ASPCS
 
Back to Volume
Paper: Efficient Remote Interactive Pipelines Using CASA and Jupyter
Volume: 527, Astronomical Data Analysis Software and Systems XXIX
Page: 579
Authors: Keimpema, A.; Kettenis, M.; Small, D.; Dijkema, T. J.; Szomoru, A.
Abstract: In this paper we describe the Jupyter kernel which we have created for CASA, the most commonly used data reduction package for radio astronomical data. Jupyter notebooks offer great potential for remote data reduction, allowing users to interactively perform data reduction inside a web browser. The Jupyter kernel allows CASA tasks to be executed from within a Jupyter notebook and includes function wrappers which embed results from CASA tasks into the notebook. Generally, when running a pipeline in an iterative fashion, at each iteration only a subset of pipeline steps needs to be (re–)executed. We have implemented a binding to a minimal re–computation framework which automates the process of determining which pipeline steps need to be re–executed, greatly increasing efficiency. We have made all source code available in a public Git repository, and for ease of deployment both Singularity and Docker images have also been made available. To demonstrate the effectiveness of our Jupyter kernel for CASA we have made a public demonstration service available at http://jupyter.jive.eu in which users can perform a full CASA data reduction inside a Jupyter notebook.
Back to Volume