To monitor data quality, Openlayer needs access to the tables you want to track. You do this by connecting a data source (e.g., BigQuery, Snowflake, Databricks) and selecting the tables of interest. Once connected, Openlayer will run automated tests directly on top of those tables.

How to connect

Prerequisites:
  • An Openlayer project with monitoring mode enabled
  • Appropriate credentials for your data source (see the provider-specific guides)
1

Choose a provider

In your project, go to Data sources and click Connect a data source. Select your provider:Each provider has its own authentication flow (e.g. service account impersonation for BigQuery, key-pair auth for Snowflake). Follow the provider guide linked above for details.
2

Enter credentials

You will be prompted for connection details, such as:Configure BigQuery connectionOpenlayer stores these securely and uses them only to run queries on your behalf.
3

Select tables

Once credentials are verified, you can browse the available databases/schemas and choose which tables to monitor.For each table, you’ll also configure:
  • A timestamp column (to order data in monitoring windows)
  • An optional data source name (to label the connection in Openlayer)
4

Start monitoring

After saving, Openlayer will profile the table and begin running data quality tests. You can then add checks such as schema validation, drift detection, or anomaly detection.See the Tests overview for details on configuring tests.

Next steps