New labels

​

Definition

The new labels test checks if there are new labels in the validation set which are not present in the training set.

​

Taxonomy

• Category: Consistency.
• Task types: Tabular classification, text classification.
• Availability: development.

​

Why it matters

• If the validation set contains new labels which the model has not seen during training, it will never predict them correctly.

​

Test configuration examples

If you are writing a tests.json, here are a few valid configurations for the character length test:

​

Related

• New categories test.