Workflows#
Array Calibration#
Telescope Cross Calibration#
Perform telescope cross calibration#
CommandLineTool: uc-120-2.3-telescope-cross-calibration.cwl
This tool implements UC-120-2.3. It performs array cross calibration. The –config input specifies the configuration file for the tool, and the optional –log-level input sets the logging verbosity. The output is used in atmospheric modeling workflows.
Inputs:ID |
Type |
Description |
|---|---|---|
cross_calibration_tool_input |
File |
|
configuration |
File |
|
log-level |
string? |
|
provenance_log_filename |
string |
file in which to write the local ctapipe-process provenance. |
output_filename |
string |
ID |
Type |
Description |
|---|---|---|
dl2_data |
File |
|
provenance_log |
File |
ctapipe format provenance log for this step. |
Atmospheric Calibration#
Compute 12-Month Average CO2 Background Concentration (12-MACOBAC)#
CommandLineTool: uc-120-1.2-calculate-macobac.cwl
This tool implements UC-120-1.2. It downloads CO2 concentration data from the Scripps Institution of Oceanography (measured at Mauna Loa Observatory, Hawaii) and computes the 12-month average CO2 background concentration (12-MACOBAC). The –config input specifies the configuration file for the tool, and the optional –log-level input sets the logging verbosity. The output is used in atmospheric modeling workflows.
Inputs:ID |
Type |
Description |
|---|---|---|
configuration |
File |
|
log-level |
string? |
|
provenance_log_filename |
string |
Name of the file in which to write the local provenance. |
ID |
Type |
Description |
|---|---|---|
macobac_table |
File |
|
provenance_log |
File |
Select Reference Atmospheric Model#
CommandLineTool: uc-120-1.3-select-reference-atmospheric-model.cwl
This tool implements UC-120.1.3. It selects a reference atmospheric model based on the provided configuration files. It generates an atmospheric profile and a Rayleigh extinction table as outputs. The –config input specifies the configuration files, and the optional –log-level input sets the logging verbosity. Credentials for accessing required resources (GDAS meteorological data) are provided via the credentials input.
Inputs:ID |
Type |
Description |
|---|---|---|
configuration |
{'type': 'array', 'items': 'File', 'inputBinding': {'prefix': '--config'}} |
|
credentials |
File |
|
log-level |
string? |
|
provenance_log_filename |
string |
Name of the file in which to write the local provenance. |
ID |
Type |
Description |
|---|---|---|
atmospheric_profile |
File |
|
rayleigh_extinction_table |
File |
|
provenance_log |
File |
Create Contemporary Atmospheric Model#
CommandLineTool: uc-120-1.7-create-contemporary-atmospheric-model.cwl
This tool implements UC-120-1.7. It creates a contemporary atmospheric model by combining the provided configuration files and a 12-month average CO2 background concentration (12-MACOBAC) table. It generates an atmospheric profile and a Rayleigh extinction table as outputs. The –config input specifies the configuration files, the –macobac12-table-path input provides the path to the 12-MACOBAC table, and the optional –log-level input sets the logging verbosity. Credentials for accessing required resources (GDAS or ECMWF meteorological data) are provided via the credentials input.
Inputs:ID |
Type |
Description |
|---|---|---|
configuration |
{'type': 'array', 'items': 'File', 'inputBinding': {'prefix': '--config'}} |
|
credentials |
File |
|
log-level |
string? |
|
provenance_log_filename |
string |
Name of the file in which to write the local provenance. |
macobac_table |
File |
ID |
Type |
Description |
|---|---|---|
atmospheric_profile |
File |
|
rayleigh_extinction_table |
File |
|
provenance_log |
File |
Telescope Calibration#
Optical Throughput Calibration with Muons#
Optical throughput measurements via muon ring analysis#
Workflow: uc-120-2.2-optical-throughput-calibration-with-muons.cwl
Upon receiving a new DL0 data product (from either Monte Carlo simulations or observations), DPPS triggers the CalibPipe (ctapipe-process) to process the data using ctapipe, extracting the signal charges and reconstructing muon parameters. The second step involves using the CalibPipe tool to estimate the telescope’s optical throughput using a predefined number of muon events.
Inputs:ID |
Type |
Description |
|---|---|---|
dl0_input_data |
File[] |
DL0 data/simulation with pre-tagged muon events for optical throughput measurements. |
output_filename |
string |
DL1/monitoring file name for the output data product containing the optical throughput table. |
process_config |
File[] |
Configuration file for Muon image process. |
merge_config |
File? |
Configuration file for merging ctapipe HDF5 files. |
throughput_muon_config |
File |
Configuration file for Muon optical throughput calibration |
log-level |
string? |
Log level for the process. Default is INFO. |
provenance_log_filename |
string |
Name of the file in which to write the local provenance. |
ID |
Type |
Description |
|---|---|---|
dl1_muon_throughput_data |
File |
Aggregated muon statistics (observation or simulation) for optical throughput estimation. |
provenance_log |
File |
Muon Throughput Calibration Tool#
CommandLineTool: calibpipe-throughput-muon-tool.cwl
The calibpipe-calculate-throughput-muon is a command line tool that calculates the optical throughput via muon rings analysis. It is part of the calibpipe software package and is used to process data from the Cherenkov Telescope Array Observatory (CTAO).
Inputs:ID |
Type |
Description |
|---|---|---|
muon_throughput_tool_input |
File |
DL1 data/file containing reconstructed muon events, with a table filled with MuonParametersContainer data for each event. |
configuration |
null | File | string |
Optional configuration File or string as path. |
log-level |
string? |
Log level for the process. Default is INFO. |
provenance_log_filename |
string |
file in which to write the local provenance. |
ID |
Type |
Description |
|---|---|---|
dl1_data_with_throughput |
File |
|
provenance_log |
File |
Camera Calibration#
Perform camera calibration#
Workflow: uc-120-2.20-perform-camera-calibration.cwl
When DPPS receives a new DL0 data product, the CalibPipe is triggered to process the calibration events. The CalibPipe performs charge integration and peak time extraction for the entire set of calibration events, and computes aggregated time-series statistics, including the mean, median, and standard deviation. Using these aggregated statistics, the CalibPipe identifies faulty camera pixels, such as those affected by starlight, by applying various outlier detection criteria. Time periods with a significant number of faulty pixels, exceeding a predefined threshold, are flagged as invalid. A refined treatment can then be applied to these time periods to account for the issues. Following this, pixel- and channel-wise camera calibration coefficients including the sky pedestal offsets per waveform sample, flat-fielding coefficients, and pixel timing corrections are calculated as a function of time. The workflow automatically merges DL1 outputs when multiple DL0 files are provided and skips merging when only one file is given.
Inputs:ID |
Type |
Description |
|---|---|---|
dl0_pedestal_data |
File[] |
DL0 data files containing pedestal calibration events. |
dl0_flatfield_data |
File[] |
DL0 data files containing flat-field calibration events. |
ped_process_config |
File[] |
Configuration file for pedestal event processing. |
ff_process_config |
File[] |
Configuration file for flat-field event processing. |
ped_img_pix_stats_config |
File |
Configuration file for the pixel statistics extraction of the charge for pedestal events. |
ff_img_pix_stats_config |
File |
Configuration file for the pixel statistics extraction of the charge for flat-field events. |
ff_time_pix_stats_config |
File |
Configuration file for the pixel statistics extraction of the peak arrival time for flat-field events. |
merge_config |
File? |
Configuration file for merging ctapipe HDF5 files. |
coeffs_camcalib_config |
File |
Configuration file for the camera calibration coefficient computation tool. |
output_filename |
string |
DL1/monitoring file name for the output data product containing the camera calibration coefficients. |
provenance_log_filename |
string |
Name of the file in which to write the local provenance. |
ID |
Type |
Description |
|---|---|---|
camcalib_dl1_mon_data |
File |
|
provenance_log |
File |
Camera Calibration Tool#
CommandLineTool: calibpipe-camcalib-tool.cwl
The calibpipe-calculate-camcalib-coefficients tool is a command line tool that calculates the camera calibration coefficients for the camera pixels. It is part of the calibpipe software package and is used to process data from the Cherenkov Telescope Array Observatory (CTAO).
Inputs:ID |
Type |
Description |
|---|---|---|
camcalib_tool_input |
File |
DL1 monitoring data containing aggregated pixel-wise statistics, detected pixel outliers, and defined faulty data periods. |
configuration |
null | File | string |
Optional configuration File or string as path. |
log-level |
string? |
|
provenance_log_filename |
string |
file in which to write the local provenance. |
ID |
Type |
Description |
|---|---|---|
dl1_mon_data |
File |
|
provenance_log |
File |
Pixel Statistics Tool#
CommandLineTool: ctapipe-pix-stats-tool.cwl
The ctapipe-calculate-pixel-statistics tool is a command line tool that calculates pixel-wise statistics from DL1 data. It is part of the ctapipe software package and is used to process data from the Cherenkov Telescope Array Observatory (CTAO).
Inputs:ID |
Type |
Description |
|---|---|---|
pix_stats_tool_input |
File |
DL1 data file including images. |
pix_stats_tool_output |
File | string |
DL1 monitoring data containing aggregated pixel-wise statistics, detected pixel outliers, and defined faulty data periods. |
configuration |
File |
|
log-level |
string? |
|
provenance_log_filename |
string |
file in which to write the local provenance. |
ID |
Type |
Description |
|---|---|---|
stats_agg_data |
File |
|
provenance_log |
File |