Index

A

add_header() (Report method) add_image() (Report method) add_table() (Report method) aeff_compare() (PerformancePoster method)

aeff_rat_compare() (PerformancePoster method) angres_compare() (PerformancePoster method) angres_rat_compare() (PerformancePoster method) AutoBenchmark (class in datapipe_testbench.auto_benchmark) axes (Metric property)

B

Benchmark (class in datapipe_testbench.benchmark) BenchmarkResult (class in datapipe_testbench.benchmark)

bkg_compare() (PerformancePoster method) bkg_rat_compare() (PerformancePoster method)

C

calc_log_fraction_of_spans() (in module datapipe_testbench.stat_helpers) category_dimensions() (Metric method) check_input_dataset() (Benchmark method) ClassifierBenchmark (class in datapipe_testbench.benchmarks.dl2) compare() (Metric method) compare_1d_metrics() (in module datapipe_testbench.compare_1d) compare_disp_with_lin() (CompareByCat2D method) compare_disp_with_req() (CompareByCat2D method) compare_rat_1d_metrics() (in module datapipe_testbench.compare_1d) compare_to_reference() (AutoBenchmark method) (Benchmark method) (ClassifierBenchmark method) (EnergyRecoBenchmark method) (IRFBenchmark method) (ResolutionBenchmark method)

CompareByCat1D (class in datapipe_testbench.compare_1d) CompareByCat2D (class in datapipe_testbench.compare_2d) ComparisonResult (class in datapipe_testbench.comparers) ComparisonStatus (class in datapipe_testbench.benchmark) compatible() (Metric method) contents() (Store method) crude_median_plot() (in module datapipe_testbench.plotting)

D

data_exists() (Store method) datapipe_testbench module datapipe_testbench.auto_benchmark module datapipe_testbench.benchmark module datapipe_testbench.benchmarks module datapipe_testbench.benchmarks.dl1 module datapipe_testbench.benchmarks.dl2 module datapipe_testbench.benchmarks.dl3 module datapipe_testbench.compare_1d module datapipe_testbench.compare_2d module datapipe_testbench.comparers module datapipe_testbench.constants module

datapipe_testbench.inputdataset module datapipe_testbench.metric module datapipe_testbench.plotting module datapipe_testbench.report module datapipe_testbench.requirements module datapipe_testbench.stat_helpers module datapipe_testbench.storable module datapipe_testbench.store module datapipe_testbench.visualization module distance_by_category() (CompareByCat1D method) domain (ReqReport attribute) dtypes (InputDataset property), [1]

E

e_bias_res_compare() (PerformancePoster method) e_bias_res_rat_compare() (PerformancePoster method)

EnergyRecoBenchmark (class in datapipe_testbench.benchmarks.dl2) EnergyResolutionBenchmark (class in datapipe_testbench.benchmarks.dl2)

F

FAILED (ComparisonStatus attribute) fill() (Metric method) find_line_segments_by_var_of_prop() (in module datapipe_testbench.stat_helpers)

find_positive_spans() (in module datapipe_testbench.stat_helpers) from_dict() (InputDataset class method), [1] from_path() (ResultStore method) from_path_and_input_dataset() (MetricsStore class method)

G

generate_all_metrics() (in module datapipe_testbench) generate_metrics() (AutoBenchmark method) (Benchmark method) (ClassifierBenchmark method) (EnergyRecoBenchmark method) (IRFBenchmark method) (ResolutionBenchmark method)

gernot_plot() (PerformancePoster method) get_identifier() (Metric method) get_inputdata() (MetricsStore method) get_transform() (SqrtScale method) graphviz_inputs_to_benchmarks() (in module datapipe_testbench.visualization)

H

has_key() (Metadata method)

HillasIntensityResolutionBenchmark (class in datapipe_testbench.benchmarks.dl1)

I

index_metrics() (MetricsStore method) InputDataset (class in datapipe_testbench) (class in datapipe_testbench.inputdataset)

IRFBenchmark (class in datapipe_testbench.benchmarks.dl3)

L

list_store() (ResultStore method) load() (Metric class method) (ReqReport class method) (Storable class method)

M

make_report() (AutoBenchmark method) (Benchmark method) make_table_rows() (in module datapipe_testbench.plotting) Metadata (class in datapipe_testbench.store) metadata_repr() (Store method) Metric (class in datapipe_testbench.metric) MetricsStore (class in datapipe_testbench.store) MetricStatus (class in datapipe_testbench.storable) missing_outputs() (Benchmark method) MissingInputError module datapipe_testbench datapipe_testbench.auto_benchmark datapipe_testbench.benchmark datapipe_testbench.benchmarks datapipe_testbench.benchmarks.dl1 datapipe_testbench.benchmarks.dl2 datapipe_testbench.benchmarks.dl3 datapipe_testbench.compare_1d datapipe_testbench.compare_2d datapipe_testbench.comparers datapipe_testbench.constants datapipe_testbench.inputdataset datapipe_testbench.metric datapipe_testbench.plotting datapipe_testbench.report datapipe_testbench.requirements datapipe_testbench.stat_helpers datapipe_testbench.storable datapipe_testbench.store datapipe_testbench.visualization

N

name (Benchmark property) (ResolutionBenchmark property) (Store property)

normalize_along_axis() (in module datapipe_testbench.stat_helpers) normalize_to_probability() (Metric method)

O

OTHER (ComparisonStatus attribute) output_path() (ResolutionBenchmark method)

outputs() (Benchmark method) (IRFBenchmark method) (ResolutionBenchmark method)

P

PASSED (ComparisonStatus attribute) PerformancePoster (class in datapipe_testbench.plotting) PixelIntensityResolutionBenchmark (class in datapipe_testbench.benchmarks.dl1) plot() (Metric method) plot_all() (AutoBenchmark method) plot_compare_1d() (Metric method) plot_compare_2dhist_mean() (CompareByCat2D method) plot_compare_2dhist_rms() (CompareByCat2D method) plot_compare_2dhist_rms_with_req() (CompareByCat2D method) plot_compare_by_category() (CompareByCat1D method) plot_compare_by_category_from_method() (CompareByCat1D method)

plot_compare_cut_disp_by_cat() (CompareByCat2D method) plot_compare_disp_by_category() (CompareByCat2D method) plot_compare_tuples_by_category_in_bins() (CompareByCat1D method) plot_complement_spans() (in module datapipe_testbench.plotting) plot_fail_spans() (in module datapipe_testbench.plotting) plot_irf_table() (in module datapipe_testbench.plotting) plot_linear_spans() (in module datapipe_testbench.plotting) plot_spans() (in module datapipe_testbench.plotting) print_benchmark_info() (in module datapipe_testbench) print_telescope_type_transforms() (in module datapipe_testbench) project() (Metric method)

R

rename_telescope_type() (in module datapipe_testbench) Report (class in datapipe_testbench.report) req_median() (in module datapipe_testbench.requirements) ReqReport (class in datapipe_testbench.storable) required_inputs (Benchmark property) (ClassifierBenchmark property) (IRFBenchmark property) (ResolutionBenchmark property)

RequirementStore (class in datapipe_testbench.store) ResolutionBenchmark (class in datapipe_testbench.benchmarks) ResultStore (class in datapipe_testbench.store) retrieve_data() (Store method) rms_profile_from_2d_hist() (in module datapipe_testbench.stat_helpers) run_comparison_study() (in module datapipe_testbench)

S

save() (Metric method) (ReqReport method) (Storable method) sens_compare() (PerformancePoster method) sens_rat_compare() (PerformancePoster method) set_default_locators_and_formatters() (SqrtScale method) set_inputdata() (MetricsStore method) setup() (Metric class method)

setup_profiledata_axes() (in module datapipe_testbench.plotting) split_by_category() (Metric method) SqrtScale (class in datapipe_testbench.plotting) stack() (Metric method) Storable (class in datapipe_testbench.storable) Store (class in datapipe_testbench.store) store() (ComparisonResult method) store_data() (Store method)

T

TelescopeEnergyResolutionBenchmark (class in datapipe_testbench.benchmarks.dl2)

to_dict() (InputDataset method), [1] to_numpy() (Metric method)

U

update() (Metadata method)

update_name_with_store() (Storable method)

V

visualize_comparison_study() (in module datapipe_testbench)

W

WARNING (ComparisonStatus attribute)