experiments.experiment_utils.load_resampled_datasets

load_resampled_datasets(spec, results_dir, trial_i, data_frac, verbose=False)

Utility function for supervised learning to generate the resampled datasets to use in each trial. Resamples (with replacement) features, labels and sensitive attributes to create n_trials versions of these of the same shape as the inputs

Parameters:
  • spec – A seldonian.spec.Spec object.

  • results_dir (str) – The directory in which results are saved for this trial

  • trial_i (int) – Trial index

  • data_frac (float) – data fraction

  • verbose – boolean verbosity flag