next up previous
Next: Acknowledgements
Up: Interpretation of results
Previous: Limitations of the resource logging

Limitations of the data reduction script

 

The script ccdbig itself aims to emulate a typical data reduction sequence, under a few different circumstances as specified by the user, with particular attention to the most expensive (especially with regard to memory) parts of the process. It does not however work through all the possibilities one might require in treating large CCD frames, and there are certainly problems which might arise in a real data reduction sequence which would not show up from using this package.

The following are some of the fixed characteristics of the model data reduction sequence in ccdbig:

It ought to be fairly easy to adapt the script, so that if an application can be identified which is causing problems, a suitable invocation can be inserted into the ccdbig script and the modified package run to assess resource usage. Alternatively, a new script (not necessarily to do with CCDs) could be written using ccdbig as a template, which uses reslog to log resource usage.



next up previous
Next: Acknowledgements
Up: Interpretation of results
Previous: Limitations of the resource logging

CCDBIG: assessing CCDPACK resource usage for large data sets
Starlink System Note 69
Mark Taylor
6 July 1998
E-mail:ussc@star.rl.ac.uk