Question 8 of 10Pro Only
How do you design evaluation frameworks for ML systems where ground truth is delayed, expensive to obtain, or fundamentally subjective? Provide specific strategies for each case.
Sample answer preview
Evaluation in imperfect label conditions requires careful methodology design for each scenario. For delayed ground truth, such as predicting customer churn months in advance, I use several strategies.
delayed ground truthproxy metricsexpensive labelsactive learningsubjective evaluationmeta-evaluation