Next: HST Paper Products: A New Way to Look at HST Data
Up: Dataflow and Scheduling
Previous: The STScI NICMOS Calibration Pipeline
Table of Contents -- Index -- PS reprint -- PDF reprint
M. Dolensky, A. Micol, B. Pirenne and M. Rosa
Space Telescope - European Coordinating Facility,
Karl-Schwarzschild-Str. 2, D-85748 Garching, Germany
In addition, several other spacecraft parameters contained in the engineering data stream are required as inputs to new, enhanced calibration algorithms. An example is the estimation of the particle induced background count rate in the FOS digicons using actual HST magnetometer readings to scale geomagnetical shielding models. The production of the missing jitter files combined with the extraction of additional engineering parameters will greatly enhance the homogeneity and the scientific value of the entire archive.
We therefore started the generation of the missing jitter files. In this article we explain the various aspects of the task and we give an example of a project which will take advantage of the results.
In order to generate the missing jitter files a pipeline was set up (Figures 1 and 2).
The heart of the pipeline is the Observation Monitoring System (OMS). It correlates the time-tagged engineering telemetry with the Mission Schedule. The Mission Schedule is a list of all commands and events that drive HST activities. The engineering telemetry is stored in the Astrometry and Engineering Data Processing (AEDP) subset files.
Both the Mission Schedule and the AEDP subset files are retrieved from the Data Archive and Distribution System (DADS) at STScI.
In order to reprocess old AEDP subset files it is necessary to set up OMS according to the spacecraft configuration and telemetry format valid at that time. So, configuration files that change over time such as spacecraft characteristic files are retrieved from the Project Data Base PDB.
OMS runs on a VAX/VMS platform. ECF maintains and operates the pipeline remotely using the Space Telescope Operations Support Cluster (STOSC) at STScI, i.e., ECF and STScI are sharing resources.
The AEDP subset files are used in two ways:
Observation Logs contain a set of pointing and specialised engineering data (Leitherer et al. 1995; Lupie, Toth & Lallo 1997). The exact pointing of the telescope, also called jitter information (Figure 3), is a prerequisite for further archive services such as grouping, cosmic ray rejection and drizzling HST images (Micol 1998).
There is a semi-automatic procedure for the quality control of Observation Logs (Figure 3).
After an additional manual inspection at the ECF the logs finally end up in the archive and become available to the community.
ECF's archive interface includes a Java applet that allows the visualization of any two columns of an obs log as an X/Y plot.
The pipeline started working in October 97. The first goal is the generation of obs logs for the time period between the first Servicing Mission in Dec. 93 and Oct. 94. In Oct. 94 STScI started producing obs logs on a regular basis. The file format was changed in August 95. For homogeneity the next step is to compute jitter files for the time span until Aug. 95. Finally, the same pipeline could be adapted to get obs logs back to launch in 1990.
Setting up this pipeline was only possible with the invaluable help of the DP-, OPUS- and PDB-Teams at STScI. Special thanks to R. Perrine, P. Goldstein, P. Hyde, K. Steuerman and J. Sandoval who sorted out a lot of technical questions as well as DPT group head D. Swade and his deputy M.A. Rose, who arranged for a very productive environment during my visit at STScI. Many thanks also to D. Fraquelli and J. Scott of the OPUS group who showed me a lot of HST's operations and quality control mechanisms. For his collaboration in the early stages of the project many thanks to Joachim Paul of MPE.
Leitherer, C. et al. 1995, HST Data Handbook, STScI, 107
Lupie, O., Toth, B. & Lallo M. 1997, Observation Logs, STScI
Micol, A., Bristow, P., & Pirenne, B. 1998, this volume
Next: HST Paper Products: A New Way to Look at HST Data
Up: Dataflow and Scheduling
Previous: The STScI NICMOS Calibration Pipeline
Table of Contents -- Index -- PS reprint -- PDF reprint