Definition
The new labels test checks if there are new labels in the validation set which are not present in the training set.Taxonomy
- Task types: Tabular classification, text classification.
- Availability: .
Why it matters
- If the validation set contains new labels which the model has not seen during training, it will never predict them correctly.
Test configuration examples
If you are writing atests.json
, here are a few valid configurations for the character length test: