seldonian.utils.hyperparam_utils¶
Functions
|
Bootstrap sample a dataset of size n_bootstrap_samples from the data points |
|
Computes a 1-alpha clopper pearson bound on the probability of passing. |
|
Create new dataset containing the same data as the given original dataset, |
|
Build new parse trees from existing spec, injecting new hyperparameter value. |
|
Update spec according to hyperparam_setting. |
|
Compute ttest bound on the probability of passing using the bootstrap data across |