The new labels test checks if there are new labels in the validation set which are not present in the training set.
- Category: Consistency.
- Task types: Tabular classification, text classification.
- Availability: .
Why it matters
- If the validation set contains new labels which the model has not seen during training, it will never predict them correctly.