from openlayer import Openlayer
client = Openlayer()
client.commits.test_results.list(
project_version_id="182bd5e5-6e1a-4fe4-a799-aa6d9a6ab26e",
){
"items": [
{
"id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"projectVersionId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"inferencePipelineId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"dateCreated": "2024-03-22T11:31:01.185Z",
"dateUpdated": "2024-03-22T11:31:01.185Z",
"dateDataStarts": "2024-03-22T11:31:01.185Z",
"dateDataEnds": "2024-03-22T11:31:01.185Z",
"status": "passing",
"statusMessage": "Test successfully processed.",
"goal": {
"id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"number": 1,
"name": "No duplicate rows",
"dateCreated": "2024-03-22T11:31:01.185Z",
"dateUpdated": "2024-03-22T11:31:01.185Z",
"description": "This test checks for duplicate rows in the dataset.",
"type": "integrity",
"subtype": "duplicateRowCount",
"creatorId": "589ece63-49a2-41b4-98e1-10547761d4b0",
"originProjectVersionId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"thresholds": [
{
"measurement": "duplicateRowCount",
"insightName": "duplicateRowCount",
"insightParameters": [
{
"name": "column_name",
"value": "<unknown>"
}
],
"thresholdMode": "manual",
"operator": "<=",
"value": 0
}
],
"dateArchived": "2024-03-22T11:31:01.185Z",
"suggested": false,
"commentCount": 0,
"evaluationWindow": 3600,
"delayWindow": 0,
"archived": false,
"usesMlModel": false,
"usesValidationDataset": true,
"usesTrainingDataset": false,
"usesReferenceDataset": false,
"usesProductionData": false
},
"goalId": "3fa85f64-5717-4562-b3fc-2c963f66afa6"
}
]
}List commit test results
List the test results for a project commit (project version).
from openlayer import Openlayer
client = Openlayer()
client.commits.test_results.list(
project_version_id="182bd5e5-6e1a-4fe4-a799-aa6d9a6ab26e",
){
"items": [
{
"id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"projectVersionId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"inferencePipelineId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"dateCreated": "2024-03-22T11:31:01.185Z",
"dateUpdated": "2024-03-22T11:31:01.185Z",
"dateDataStarts": "2024-03-22T11:31:01.185Z",
"dateDataEnds": "2024-03-22T11:31:01.185Z",
"status": "passing",
"statusMessage": "Test successfully processed.",
"goal": {
"id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"number": 1,
"name": "No duplicate rows",
"dateCreated": "2024-03-22T11:31:01.185Z",
"dateUpdated": "2024-03-22T11:31:01.185Z",
"description": "This test checks for duplicate rows in the dataset.",
"type": "integrity",
"subtype": "duplicateRowCount",
"creatorId": "589ece63-49a2-41b4-98e1-10547761d4b0",
"originProjectVersionId": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
"thresholds": [
{
"measurement": "duplicateRowCount",
"insightName": "duplicateRowCount",
"insightParameters": [
{
"name": "column_name",
"value": "<unknown>"
}
],
"thresholdMode": "manual",
"operator": "<=",
"value": 0
}
],
"dateArchived": "2024-03-22T11:31:01.185Z",
"suggested": false,
"commentCount": 0,
"evaluationWindow": 3600,
"delayWindow": 0,
"archived": false,
"usesMlModel": false,
"usesValidationDataset": true,
"usesTrainingDataset": false,
"usesReferenceDataset": false,
"usesProductionData": false
},
"goalId": "3fa85f64-5717-4562-b3fc-2c963f66afa6"
}
]
}Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your workspace API key. See Find your API key for more information.
Path Parameters
The project version (commit) id.
Query Parameters
The page to return in a paginated query.
x >= 1Maximum number of items to return per page.
1 <= x <= 100Filter objects by test type. Available types are integrity, consistency, performance, fairness, and robustness.
integrity, consistency, performance, fairness, robustness Filter for archived tests.
Response
Status OK.
Show child attributes
Show child attributes
Project version (commit) id.
"3fa85f64-5717-4562-b3fc-2c963f66afa6"
The project version (commit) id.
"3fa85f64-5717-4562-b3fc-2c963f66afa6"
The inference pipeline id.
"3fa85f64-5717-4562-b3fc-2c963f66afa6"
The creation date.
"2024-03-22T11:31:01.185Z"
The last updated date.
"2024-03-22T11:31:01.185Z"
The data start date.
"2024-03-22T11:31:01.185Z"
The data end date.
"2024-03-22T11:31:01.185Z"
The status of the test.
running, passing, failing, skipped, error "passing"
The status message.
"Test successfully processed."
Show child attributes
Show child attributes
The test id.
"3fa85f64-5717-4562-b3fc-2c963f66afa6"
The test number.
1
The test name.
100"No duplicate rows"
The creation date.
"2024-03-22T11:31:01.185Z"
The last updated date.
"2024-03-22T11:31:01.185Z"
The test description.
"This test checks for duplicate rows in the dataset."
The test type.
integrity, consistency, performance "integrity"
The test subtype.
anomalousColumnCount, characterLength, classImbalanceRatio, expectColumnAToBeInColumnB, columnAverage, columnDrift, columnStatistic, columnValuesMatch, conflictingLabelRowCount, containsPii, containsValidUrl, correlatedFeatureCount, customMetricThreshold, duplicateRowCount, emptyFeature, emptyFeatureCount, driftedFeatureCount, featureMissingValues, featureValueValidation, greatExpectations, groupByColumnStatsCheck, illFormedRowCount, isCode, isJson, llmRubricThresholdV2, labelDrift, metricThreshold, newCategoryCount, newLabelCount, nullRowCount, rowCount, ppScoreValueValidation, quasiConstantFeature, quasiConstantFeatureCount, sqlQuery, dtypeValidation, sentenceLength, sizeRatio, specialCharactersRatio, stringValidation, trainValLeakageRowCount "duplicateRowCount"
The test creator id.
"589ece63-49a2-41b4-98e1-10547761d4b0"
The project version (commit) id where the test was created.
"3fa85f64-5717-4562-b3fc-2c963f66afa6"
Show child attributes
Show child attributes
The measurement to be evaluated.
"duplicateRowCount"
The insight name to be evaluated.
characterLength, classImbalance, expectColumnAToBeInColumnB, columnAverage, columnDrift, columnValuesMatch, confidenceDistribution, conflictingLabelRowCount, containsPii, containsValidUrl, correlatedFeatures, customMetric, duplicateRowCount, emptyFeatures, featureDrift, featureProfile, greatExpectations, groupByColumnStatsCheck, illFormedRowCount, isCode, isJson, llmRubricV2, labelDrift, metrics, newCategories, newLabels, nullRowCount, ppScore, quasiConstantFeatures, sentenceLength, sizeRatio, specialCharacters, stringValidation, trainValLeakageRowCount "duplicateRowCount"
The insight parameters. Required only for some test subtypes. For example, for tests that require a column name, the insight parameters will be [{'name': 'column_name', 'value': 'Age'}]
Whether to use automatic anomaly detection or manual thresholds
automatic, manual The operator to be used for the evaluation.
is, >, >=, <, <=, != "<="
The value to be compared.
0
The date the test was archived.
"2024-03-22T11:31:01.185Z"
Whether the test is suggested or user-created.
false
The number of comments on the test.
x >= 00
The evaluation window in seconds. Only applies to tests that use production data.
x <= 25920003600
The delay window in seconds. Only applies to tests that use production data.
0 <= x <= 25920000
Whether the test is archived.
false
Whether the test uses an ML model.
false
Whether the test uses a validation dataset.
true
Whether the test uses a training dataset.
false
Whether the test uses a reference dataset (monitoring mode only).
false
Whether the test uses production data (monitoring mode only).
false
The test id.
"3fa85f64-5717-4562-b3fc-2c963f66afa6"
Was this page helpful?