datapipe Documentation#
Version: 0.3.3rc2.dev2+gb8d0cddf4
datapipe is a pipeline subsystem of the Data Processing and Preservation
System (DPPS). It is responsible for processing raw data into science-ready
data products.
Components#
This package contains all of the tools and dependencies needed to run the data
processing pipeline workflows that can run on the DPPS Workload Management
System. Most of the functionality in datapipe is provided by the packages
listed below, which are developed and maintained by CTAO:
- ctapipe
provides the core framework for command-line tools, data models and formats for reading and writing event data products at data levels DL0-DL2, and algorithms and tools for processing events from simulations and observations.
- pyeventio
provides low-level access to simulation data, and enables ctapipe to read CTAO simulations via it’s
SimTelEventSource.- pyirf
provides low-level functionality for generating and manipulating IRFs and related metrics like sensitivity, as well as for optimizing gamma/hadron cuts. When installed, it enables the ctapipe IRF tools to work.
- ctapipe-io-zfits
A ctapipe plugin that provides access to CTAO DL0 data as a
ctapipe.io.EventSource
Development Guidelines#
Developers of the and related packages must follow the guidelines specified in the CTAO Developer Documentation, ; more details are given in the ctapipe developer guidelines