Skip to main content

​
Definition

The class imbalance ratio test allows you to set a threshold on the ratio between the number of rows from the most common class and the least common class.

​
Taxonomy

  • Task types: Tabular classification, text classification.
  • Availability: .

​
Why it matters

  • Class imbalance can significantly impact the performance of predictive models.
  • Measuring the class imbalance ratio helps select more appropriate evaluation metrics.
  • Awareness of the extent of class imbalance guides the choice of model and data preprocessing techniques.
  • While class imbalance is inherent to certain problems, it is important to continuously measure the class imbalance ratio to ensure that it does not go out of control.

​
Test configuration examples

If you are writing a tests.json, here are a few valid configurations for the character length test: 
[
  {
    "name": "Class imbalance ratio at most 1.5",
    "description": "Asserts that the ratio between the majority and minority classes is at most 1.5 (i.e. the classes are not heavily imbalanced)",
    "type": "integrity",
    "subtype": "classImbalanceRatio",
    "thresholds": [
      {
        "insightName": "classImbalance",
        "measurement": "classImbalanceRatio",
        "operator": "<=",
        "value": 1.5
      }
    ],
    "subpopulationFilters": null,
    "mode": "development",
    "usesValidationDataset": true,
    "usesTrainingDataset": false,
    "usesMlModel": false,
    "syncId": "b4dee7dc-4f15-48ca-a282-63e2c04e0689"
  }
]

[
  {
    "name": "Class imbalance ratio at most 1.5",
    "description": "Asserts that the ratio between the majority and minority classes is at most 1.5 (i.e. the classes are not heavily imbalanced)",
    "type": "integrity",
    "subtype": "classImbalanceRatio",
    "thresholds": [
      {
        "insightName": "classImbalance",
        "measurement": "classImbalanceRatio",
        "operator": "<=",
        "value": 1.5
      }
    ],
    "subpopulationFilters": null,
    "mode": "monitoring",
    "usesProductionData": true,
    "evaluationWindow": 3600,
    "delayWindow": 0,
    "syncId": "b4dee7dc-4f15-48ca-a282-63e2c04e0689"
  }
]