seldonian.parse_tree.zhat_funcs.evaluate_statistic

evaluate_statistic(model, statistic_name, theta, data_dict, **kwargs)

Evaluate the mean of a statistical function over the whole sample provided.

Parameters:

• model – SeldonianModel instance

• statistic_name (str) – The name of the statistic to evaluate, e.g. ‘FPR’ for false positive rate

• theta (numpy ndarray) – The model weights

• data_dict (dict) – Contains the features and labels

Returns:

The mean value of the statistic evaluated over the whole sample

Return type:

float