Vexdata.io Documentation
  • Vexdata Overview
  • Installation
    • System Requirements
    • Windows Installation
    • Linux Installation
    • Cloud Installation
      • GCP
      • Azure
      • AWS Cloud Deployment Architecture Diagram
        • Pre-requisites
        • Manual Install on ec2
        • Cloud Formation Scripts (command line)
    • Admin Post Installation Setup
    • User Post Installation Setup
    • Server Improvement (Optional)
  • Getting Started
    • Roles and Permissions
    • Managing Groups and Projects
      • Folders
      • Projects
    • Settings
      • Slack Integration
      • Integrations
      • Rules
      • Properties
      • Integrations
      • Email Template
      • Report Template
      • Create Data Connections
        • Databases/Warehouses
        • Run On
  • Creating and Executing Test Cases
    • Test Case
      • Create Test Cases
        • Define Data Source and Target
          • Configure Table/s from Database
          • Input SQL Data
          • Input Files
            • Excel/CSV
            • XML
            • JSON
            • Parquet/AVRO
          • API Input
          • Table Filter
          • Advance - Input
        • Data Compare
          • ETL Testing/Cell By Cell Compare
            • Data Compare Mapping
            • Data Compare Options
          • Schema Compare
          • Counts Compare
        • Schema Monitoring
        • Data Quality
          • SQL Rules
          • Column Level Rules
          • Duplicates
      • Executing Test Cases
      • Defining Test Case Settings
    • Test Runs
    • Variables
    • Note
    • Label
  • Reports
    • User Reports
    • Admin Report or Manager Reports
  • Current Limitations
Powered by GitBook
On this page
  1. Creating and Executing Test Cases
  2. Test Case
  3. Create Test Cases

Schema Monitoring

Schema Monitoring

PreviousCounts CompareNextData Quality

Last updated 5 months ago

Schema monitoring feature provides a robust solution for tracking and managing schema changes in your database environment. This feature is designed to capture the schema of one or more specified tables at a given point in time and continuously compare this snapshot with the current schema. Key functionalities include:

  • Snapshot Capturing: The feature takes a snapshot of the specified table(s) schema at a user-defined point in time. This snapshot serves as a reference for future comparisons.

  • Continuous Monitoring: It actively monitors the schema of the targeted table(s) and detects any alterations made after the initial snapshot. This includes changes in table structure, such as added or dropped columns, modified data types, changes in constraints, and more.

  • Change Detection and Notification: Upon detecting any schema changes, the system promptly notifies users. The notification details the specific alterations, providing a clear and concise overview of how the current schema differs from the original snapshot.

  • Error Reporting: In the event of unauthorized or unintended schema modifications, the feature flags these as errors. This immediate reporting allows for quick response and rectification, ensuring data integrity and consistency.

  • Use Case Adaptability: Ideal for environments where schema stability is crucial, such as in production databases or where regulatory compliance requires strict schema control.

This feature enhances the ability to maintain database integrity, comply with regulatory standards, and manage changes efficiently, making it an essential tool for database administrators and teams managing critical data assets.

Steps to create Schema Monitoring Test case

  1. Click on "New Test Case" on Top and select "Schema Monitoring"

  1. Select the connection name and schema name from the drop down.

  1. Select the tables that you wish to monitor and click on "Add Selected" at the bottom.

  2. Proceed to the next step by clicking "Next" at the bottom right corner of the screen.

  3. First time, we need to click on the button ("Get Latest Schema") to get the schema.

  4. You will see the schema of the tables selected and the time stamp at which the schema is collected.

  1. Click on the bottom right corner to proceed to the next step.

  2. Give a name to the test case and click on "Save and Execute"

  1. Optionally this test case can be scheduled to run at regular intervals to detect any changes in the schema and notify.

Video to create Schema Monitoring Test case