experiment_runner.main
Entry point for the xai4tsc experiment runner.
Run from the repository root as a module:
python -m experiment_runner.main --conf path/to/config.yaml
Orchestrates the full evaluation pipeline as a nested loop over datasets,
models, explainers, and metrics. Results are saved as metrics.csv files
at three granularity levels (global, per-dataset, per-model) under
results_rel_path.
Attributes
Functions
|
Expand archive wildcards and resolve per-member |
|
Run a complete XAI evaluation experiment from a YAML configuration file. |
|
Set up experiment as described in the given configuration file. |
Module Contents
- experiment_runner.main.logger
- experiment_runner.main.MASTER_CONFIG
- experiment_runner.main.expand_datasets(datasets: list[dict]) list[dict]
Expand archive wildcards and resolve per-member
overrides.Each entry is either a concrete dataset or an archive keyword (
UCR/UEA) that expands to all its member datasets. An entry’s inline settings apply to every member it produces; an optionaloverridesmap ({dataset_name: {setting: value}}) sets per-member exceptions that take precedence over the entry’s inline settings.- Parameters:
datasets (list[dict]) – Raw
data_config["datasets"]entries.- Returns:
Concrete dataset entries with
overridesresolved and stripped.- Return type:
list[dict]
- experiment_runner.main.main(config_path: str, debug: bool = False) None
Run a complete XAI evaluation experiment from a YAML configuration file.
Orchestrates the full pipeline as a nested loop over datasets → models → explainers → metrics. Results are saved as
metrics.csvat three granularity levels (global, per-dataset, per-model) underresults_rel_path.
- experiment_runner.main.initial_setup(config_path: str, debug: bool = False) dict
Set up experiment as described in the given configuration file.
- Parameters:
config_path (str) – Path to the experiment configuration.
debug (bool) – Enable debug-level logging.
- Returns:
The extracted configuration.
- Return type:
dict
- experiment_runner.main.parser