Learning from 25 years of the extensible N-Dimensional Data Format
Authors:
Preprint
Abstract
The extensible N-Dimensional Data Format (NDF) was designed and developed in the late 1980s to provide a data model suitable for use in a variety of astronomy data processing applications supported by the UK Starlink Project. Starlink applications were used extensively, primarily in the UK astronomical community, and form the basis of a number of advanced data reduction pipelines today. This paper provides an overview of the historical drivers for the development of NDF and the lessons learned from using a defined hierarchical data model for many years in data reduction software, data pipelines and in data acquisition systems.Keywords
All Related Versions
- Version 1, 2014-10-28, ArXiv
- Published version: Astronomy and Computing, 12, 146.
This publication has 22 references indexed in Scilit:
- Astronomical imagery: Considerations for a contemporary approach with JPEG2000Astronomy and Computing, 2015
- Observatory/data centre partnerships and the VO-centric archive: The JCMT Science Archive experienceAstronomy and Computing, 2015
- ORAC-DR: A generic data reduction pipeline infrastructureAstronomy and Computing, 2015
- Spectroscopic analysis in the virtual observatory environment with SPLAT-VOAstronomy and Computing, 2014
- The ORAC‐DR data reduction pipelineAstronomische Nachrichten, 2008
- The Anglo-Australian Observatory 2dF facilityMonthly Notices of the Royal Astronomical Society, 2002
- Starlink2000
- SCUBA: a common-user submillimetre camera operating on the James Clerk Maxwell TelescopeMonthly Notices of the Royal Astronomical Society, 1999
- IRIS: an Infrared Imager and Spectrometer for the Anglo-Australian TelescopePublications of the Astronomical Society of Australia, 1993
- The FIGARO Package for Astronomical Data Analysis1988