| |
 |
| Paper: |
Prototyping Access From Visualisation Tools to SKA Science Images and Cubes Stored in a Rucio Data Lake Through IVOA Discovery and Access Services |
| Volume: |
541, ADASS XXXIII |
| Page: |
72 |
| Authors: |
François Bonnarel; Jesús Salgado; Mark Allen; Rob Barnsley; Matthieu Baumann; Thomas Boch; Caroline Bot; Robert Butora; James Collinson; Pierre Fernique; Vincenzo Galluzzi; Rohini Joshi; Andrea Lorenzani; Marco Molinaro; Manuel Parra-Royón; Jesús Sánchez-Castañeda; Susana Sánchez-Expósito; Eva Sciacca; Giuseppe Tudisco; Fabio Vitello; Alessandra Zanichelli |
| DOI: |
10.26624/XPTJ8476 |
| Abstract: |
SKA is the major low frequency radioastronomy project of the future
with several major scientific applications: it will upgrade the amount of available science data by several orders of magnitudes reaching eventually more than 700 petabytes
of storage per year. The SKA Observatory will proceed to the initial data processing to
deliver observatory data products while the SKA Regional Center Network (SRCNet)
will provide storage for those and processing capabilities to deliver and store advanced
data products for the user community. Within the scope of the SRCNet, Orange (visualisation), Magenta (data management) and Coral (node implementation) teams have
prototyped the discovery access and visualisation of science data. Our visualisation
tools VisIVO and Aladin discover, access and visualize test science data produced by
SKA precursors and pathfinders stored in the Rucio (Barisits et al. 2019) Data Lake.
Science metadata functionality has been implemented by the Magenta team to the Rucio Data Lake prototype to demonstrate a means of enabling IVOA-compliant data discovery and server-side processing. VisIVO, Aladin Desktop and Aladin Lite are able
to query the Discovery service built on ObsCore (Louys et al. 2017) and SCS (Plante
et al. 2008) IVOA protocols. This allows them to load DataLink (Dowler et al. 2015)
responses providing links towards a SODA (Bonnarel et al. 2017) cutout service developed by the Orange team able to extract sub-cubes or images directly from the datasets
stored in the Rucio Data Lake. The Rucio Storage Element and SODA developments
have been deployed and configured on the Spanish SRC node, providing computing and
storage resources, managed by the Coral Team members. This prototype paves the way
to collaborative development in the SRCNet and shows the possible integration of VO
services and visualisation tools in Data Lakes and science platforms. |
|
|
|
|
|
