experiments.experiment_utils.setup_SA_spec_for_exp

setup_SA_spec_for_exp(spec, regime, results_dir, trial_i, data_frac, datagen_method, batch_epoch_dict, kwargs, perf_eval_kwargs)

Utility function for setting up the spec object to use for a Seldonian algorithm trial

Parameters:

• spec – A seldonian.spec.Spec object.

• regime – The category of ML problem.

• results_dir (str) – The directory in which results are saved for this trial

• trial_i (int) – Trial index for this data fraction

• data_frac (float) – data fraction

• datagen_method – Method for generating the trial datasets.

• batch_epoch_dict – A dictionary where keys are data fractions and values are [batch_size,num_epochs]

Returns:

spec_for_exp, the spec object ready for running this Seldonian trial.