MLComparability
Whether an earlier version's score can be read against the new one
Values
COMPARABLE
The scores can be read against each other
PIPELINE_CHANGED
Scored, but the earlier version read its rows through a different data pipeline
OVERLAP_RISK
Scored, but some of the earlier version's training rows may be in this holdout, which would flatter its score
INCOMPATIBLE
Not scored: the earlier version predicts something else or cannot read these rows
Referenced by (1)
Exact type SDL
"""Whether an earlier version's score can be read against the new one"""
enum MLComparability {
"""The scores can be read against each other"""
COMPARABLE
"""
Scored, but the earlier version read its rows through a different data pipeline
"""
PIPELINE_CHANGED
"""
Scored, but some of the earlier version's training rows may be in this holdout, which would flatter its score
"""
OVERLAP_RISK
"""
Not scored: the earlier version predicts something else or cannot read these rows
"""
INCOMPATIBLE
}