|
|
Paper: |
Efficient Remote Interactive Pipelines Using CASA and Jupyter |
Volume: |
527, Astronomical Data Analysis Software and Systems XXIX |
Page: |
579 |
Authors: |
Keimpema, A.; Kettenis, M.; Small, D.; Dijkema, T. J.; Szomoru, A. |
Abstract: |
In this paper we describe the Jupyter kernel which we have created for CASA, the most commonly used data reduction
package for radio astronomical data. Jupyter notebooks offer great potential for remote data reduction, allowing
users to interactively perform data reduction inside a web browser. The Jupyter kernel allows CASA tasks to be executed
from within a Jupyter notebook and includes function wrappers which embed results from CASA tasks into the notebook. Generally, when running a pipeline in an iterative fashion, at each iteration only a subset of pipeline steps
needs to be (re–)executed. We have implemented a binding to a minimal re–computation framework which automates
the process of determining which pipeline steps need to be re–executed, greatly increasing efficiency. We have made all source code available in a public Git repository, and for ease of deployment both Singularity and
Docker images have also been made available. To demonstrate the effectiveness of our Jupyter kernel for CASA we have
made a public demonstration service available at http://jupyter.jive.eu in which users can perform a full
CASA data reduction inside a Jupyter notebook. |
|
|
|
|