The new labels test checks if there are new labels in the validation set which are not present in the training set.


  • Category: Consistency.
  • Task types: Tabular classification, text classification.
  • Availability: .

Why it matters

  • If the validation set contains new labels which the model has not seen during training, it will never predict them correctly.