seldonian.parse_tree.nodes.BaseNode¶
- class BaseNode(name, lower=-inf, upper=inf, conditional_columns=[], **kwargs)¶
Bases:
Node
- __init__(name, lower=-inf, upper=inf, conditional_columns=[], **kwargs)¶
Class for base variable leaf nodes in the parse tree.
- Parameters:
name (str) – The name of the node
lower (float) – Lower confidence bound
upper (float) – Upper confidence bound
conditional_columns (List(str)) – When calculating confidence bounds on a measure function, condition on these columns being == 1
- Variables:
node_type (str) – equal to ‘base_node’
delta_lower (float) – The share of the confidence put into calculating the lower bound on this node
delta_upper (float) – The share of the confidence put into calculating the upper bound on this node
infl_factor_lower (float) – The bound inflation factor for calculating the lower bound on this node during candidate selection
infl_factor_upper (float) – The bound inflation factor for calculating the upper bound on this node during candidate selection
measure_function_name (str) – str The name of the statistical measurement function that this node represents, e.g. “FPR”. Must be contained in measure_functions list in
operators
- __repr__()¶
Overrides Node.__repr__()
Methods
- calculate_bounds(**kwargs)¶
Calculate confidence bounds given a bound_method, such as t-test.
- Returns:
A dictionary mapping the bound name to its value, e.g., {“lower”:-1.0, “upper”: 1.0}
- calculate_data_forbound(**kwargs)¶
Prepare data inputs for confidence bound calculation.
- Returns:
data_dict, a dictionary containing the prepared data
- calculate_value(**kwargs)¶
Calculate the value of the node given model weights, etc. This is the expected value of the base variable, not the bound.
- compute_HC_lowerbound(data, datasize, delta, **kwargs)¶
Calculate high confidence lower bound Used in safety test
- Parameters:
data (numpy ndarray) – Vector containing base variable evaluated at each observation in dataset
datasize (int) – The number of observations in the safety dataset
delta (float) – Confidence level, e.g. 0.05
- Returns:
lower, the high-confidence lower bound
- compute_HC_upper_and_lowerbound(data, datasize, delta_lower, delta_upper, **kwargs)¶
Calculate high confidence lower and upper bounds Used in safety test. Confidence levels for lower and upper bound do not have to be equivalent.
Depending on the bound_method, this is not always equivalent to calling compute_HC_lowerbound() and compute_HC_upperbound() independently.
- Parameters:
data (numpy ndarray) – Vector containing base variable evaluated at each observation in dataset
datasize (int) – The number of observations in the safety dataset
delta_lower – Confidence level for the lower bound, e.g. 0.05
delta_upper – Confidence level for the upper bound, e.g. 0.05
- Returns:
(lower,upper) the high-confidence lower and upper bounds.
- compute_HC_upperbound(data, datasize, delta, **kwargs)¶
Calculate high confidence upper bound Used in safety test
- Parameters:
data (numpy ndarray) – Vector containing base variable evaluated at each observation in dataset
datasize (int) – The number of observations in the safety dataset
delta (float) – Confidence level, e.g. 0.05
- Returns:
upper, the high-confidence upper bound
- mask_data(dataset, conditional_columns)¶
Mask features and labels using a joint AND mask where each of the conditional columns is True.
- Parameters:
dataset (dataset.Dataset object) – The candidate or safety dataset
conditional_columns (List(str)) – List of columns for which to create the joint AND mask on the dataset
- Returns:
The masked dataframe
- Return type:
numpy ndarray
- predict_HC_lowerbound(data, datasize, delta, **kwargs)¶
Calculate high confidence lower bound that we expect to pass the safety test. Used in candidate selection
- Parameters:
data (numpy ndarray) – Vector containing base variable evaluated at each observation in dataset
datasize (int) – The number of observations in the safety dataset
delta (float) – Confidence level, e.g. 0.05
- Returns:
lower, the predicted high-confidence lower bound
- predict_HC_upper_and_lowerbound(data, datasize, delta_lower, delta_upper, **kwargs)¶
Calculate high confidence lower and upper bounds that we expect to pass the safety test. Used in candidate selection. Confidence levels for lower and upper bound do not have to be equivalent.
Depending on the bound_method, this is not always equivalent to calling predict_HC_lowerbound() and predict_HC_upperbound() independently.
- Parameters:
data (numpy ndarray) – Vector containing base variable evaluated at each observation in dataset
datasize (int) – The number of observations in the safety dataset
delta_lower – Confidence level for the lower bound, e.g. 0.05
delta_upper – Confidence level for the upper bound, e.g. 0.05
- Returns:
(lower,upper) the predicted high-confidence lower and upper bounds.
- predict_HC_upperbound(data, datasize, delta, **kwargs)¶
Calculate high confidence upper bound that we expect to pass the safety test. Used in candidate selection
- Parameters:
data (numpy ndarray) – Vector containing base variable evaluated at each observation in dataset
datasize (int) – The number of observations in the safety dataset
delta (float) – Confidence level, e.g. 0.05
- Returns:
upper, the predicted high-confidence upper bound
- zhat(model, theta, data_dict, sub_regime, **kwargs)¶
Calculate an unbiased estimate of the base variable node.
- Parameters:
model (models.SeldonianModel object) – The machine learning model
theta (numpy ndarray) – model weights
data_dict (dict) – Contains inputs to model, such as features and labels
- Returns:
A vector of unbiased estimates of the measure function