| |
 |
| Paper: |
SKA Regional Centres Architecture: One Data Lake, Multiple Nodes |
| Volume: |
541, ADASS XXXIII |
| Page: |
64 |
| Authors: |
Jesús Salgado; James Collinson; Rosie Bolton; Andreas Wicenec; Sharon Goliath; Rohini Joshi; John Swinbank; Brendan Webster; Raymond Oonk; Keith Grainge; Susana Sánchez-Expósito; Manuel Parra-Royón; Thomas Dack; Martin Hardcastle; Domingos Barbosa; Pablo Llopis-Sanmillán; Sébastien Fabbro; Robert Beswick; Jean-Pierre Vilotte; Shari Breen; Jeremy Yates; Yan Grange; Séverin Gaudet; Tao An; Andrea Possenti; Laura Darriba; Victor Holanda; Mariangeles Mendoza; Vicenzo Galluzzi; Thomas Svedberg; Karen Lee-Waddell; Dejan Vitlacil; Vishambhar Nath Pandey; Takuya Akahori; Louise Chisholm; Maya Horton; Robert Watson |
| DOI: |
10.26624/KRTF7289 |
| Abstract: |
The construction phase of the world’s largest radio telescope, the SKA,
is already underway. To address the anticipated vast amount of data, an international
network of SKA Regional Centres (SRC), known as SRCNet, is being defined and developed. These SRCs will receive and manage hundreds of petabytes of data from the
SKA Observatory (SKAO), offering the necessary infrastructure, tools, and user support for scientific endeavors with SKA data. The SRC community and SKAO have
collaborated on a challenge to design a globally distributed SRCNet system, enabling
scientists worldwide to easily access the globally distributed data and compute infrastructure. This system also provides remote data analysis tools using the Software as
a Service (SaaS) approach. The flow of SKA data from generation to the SRCs, and
subsequent data exploitation, represents the most significant challenge in astronomical
data handling of this era. In this presentation, we showcase some of the techniques
employed by SRCNet to minimize data access latency and ensure optimal performance
during scientific analysis. |
|
|
|
|
|
