| |
 |
| Paper: |
Pangeo Data Analysis Platform and Astronomical Use Cases |
| Volume: |
532, ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXX |
| Page: |
601 |
| Authors: |
Eynard-Bontemps, G.; Odaka, T. E.; Banihirwe, A.; Paul, K.; Abernathey, R. |
| Abstract: |
Pangeo is first a scientific community, but also a Python software ecosystem and a platform that can be deployed on many infrastructures. Its goal is to provide means to make scientific research and software development easier on big datasets (from TBs to PBs) coming from simulations ran on HPC clusters (climatic model) or from sensors like observation satellites. This paper explains what is Pangeo and describes the associated software ecosystem (Jupyter, Dask, Xarray, Zarr). It then presents how a Pangeo platform is deployed at CNES Computing Center. Finally, it describes some examples of its use in geosciences and in astronomy highlighting the benefits it can provide and the challenges that remain. |
|
|
|
|
|
