|
|
Paper: |
HST/JWST Data Processing Performance Under HTCondor/OWL |
Volume: |
521, Astronomical Data Analysis Software and Systems XXVI |
Page: |
624 |
Authors: |
Swam, M.; Romelfanger, M. |
Abstract: |
The workflow management system in use by the science data processing pipelines
for the Hubble Space Telescope (HST) and the James Webb Space Telescope (JWST)
is called HTCondor/OWL, and consists of the widely-used HTCondor batch
processing software, and the Open Workflow Layer (OWL), developed at the
Space Telescope Science Institute (STScI). This paper will describe early
performance results obtained under the new HTCondor/OWL system when processing
large subsets of the HST archive collection, and JWST ground test data.
Description of the computer hardware configurations and data, the performance
metrics gathered, and analysis of the overheads and efficiency measures for
the system will be presented, along with a summary of current issues and
future development plans. |
|
|
|
|