| |
 |
| Paper: |
SKA Regional Centres Architecture: One Data Lake, Multiple Nodes |
| Volume: |
541, ADASS XXXIII |
| Page: |
64 |
| Authors: |
Salgado, Jesús; Collinson, James; Bolton, Rosie; Wicenec, Andreas; Goliath, Sharon; Joshi, Rohini; Swinbank, John; Webster, Brendan; Oonk, Raymond; Grainge, Keith; Sánchez-Expósito, Susana; Parra-Royón, Manuel; Dack, Thomas; Hardcastle, Martin; Barbosa, Domingos; Llopis-Sanmillán, Pablo; Fabbro, Sébastien; Beswick, Robert; Vilotte, Jean-Pierre; Breen, Shari; Yates, Jeremy; Grange, Yan; Gaudet, Séverin; An, Tao; Possenti, Andrea; Darriba, Laura; Holanda, Victor; Mendoza, Mariangeles; Galluzzi, Vicenzo; Svedberg, Thomas; Lee-Waddell, Karen; Vitlacil, Dejan; Pandey, Vishambhar Nath; Akahori, Takuya; Chisholm, Louise; Horton, Maya; Watson, Robert |
| DOI: |
10.26624/KRTF7289 |
| Abstract: |
The construction phase of the world’s largest radio telescope, the SKA,
is already underway. To address the anticipated vast amount of data, an international
network of SKA Regional Centres (SRC), known as SRCNet, is being defined and developed. These SRCs will receive and manage hundreds of petabytes of data from the
SKA Observatory (SKAO), offering the necessary infrastructure, tools, and user support for scientific endeavors with SKA data. The SRC community and SKAO have
collaborated on a challenge to design a globally distributed SRCNet system, enabling
scientists worldwide to easily access the globally distributed data and compute infrastructure. This system also provides remote data analysis tools using the Software as
a Service (SaaS) approach. The flow of SKA data from generation to the SRCs, and
subsequent data exploitation, represents the most significant challenge in astronomical
data handling of this era. In this presentation, we showcase some of the techniques
employed by SRCNet to minimize data access latency and ensure optimal performance
during scientific analysis. |
|
|
|
|
|
