Connection
Base URL, credentials and a reachable server.
Model evaluation starts with the data boundary. Model Ledger helps you examine split logic and preprocessing code before drawing conclusions from a result.
train_groups, test_groups = split_groups(group_ids)
assert not set(train_groups) & set(test_groups)
train = rows_in_groups(data, train_groups)
test = rows_in_groups(data, test_groups)Base URL, credentials and a reachable server.
Keep each group on one side and fit preprocessing on training data before applying it to held-out rows.
Compare actual behavior with the expected result. If a check fails, investigate it before applying more changes.
train_groups, test_groups = split_groups(group_ids)
assert not set(train_groups) & set(test_groups)
train = rows_in_groups(data, train_groups)
test = rows_in_groups(data, test_groups)