Vexdata.io Documentation
  • Vexdata Overview
  • Installation
    • System Requirements
    • Windows Installation
    • Linux Installation
    • Cloud Installation
      • GCP
      • Azure
      • AWS Cloud Deployment Architecture Diagram
        • Pre-requisites
        • Manual Install on ec2
        • Cloud Formation Scripts (command line)
    • Admin Post Installation Setup
    • User Post Installation Setup
    • Server Improvement (Optional)
  • Getting Started
    • Roles and Permissions
    • Managing Groups and Projects
      • Folders
      • Projects
    • Settings
      • Slack Integration
      • Integrations
      • Rules
      • Properties
      • Integrations
      • Email Template
      • Report Template
      • Create Data Connections
        • Databases/Warehouses
        • Run On
  • Creating and Executing Test Cases
    • Test Case
      • Create Test Cases
        • Define Data Source and Target
          • Configure Table/s from Database
          • Input SQL Data
          • Input Files
            • Excel/CSV
            • XML
            • JSON
            • Parquet/AVRO
          • API Input
          • Table Filter
          • Advance - Input
        • Data Compare
          • ETL Testing/Cell By Cell Compare
            • Data Compare Mapping
            • Data Compare Options
          • Schema Compare
          • Counts Compare
        • Schema Monitoring
        • Data Quality
          • SQL Rules
          • Column Level Rules
          • Duplicates
      • Executing Test Cases
      • Defining Test Case Settings
    • Test Runs
    • Variables
    • Note
    • Label
  • Reports
    • User Reports
    • Admin Report or Manager Reports
  • Current Limitations
Powered by GitBook
On this page
  1. Installation
  2. Cloud Installation
  3. AWS Cloud Deployment Architecture Diagram

Manual Install on ec2

Recommended for single server.

PreviousPre-requisitesNextCloud Formation Scripts (command line)

Last updated 5 months ago

Steps to create Vexdata server in AWS Cloud

  • Create ec2 instance of type T3.xlarge to support upto five concurrent jobs.(Select T3.2xlarge to support upto 10 concurrent jobs. )

  • OPTIONAL STEP : If jobs need to be processed in EMR cluster, create the role #grant-permission-to-ec2-instance-to-launch-emr-clusters and attache the role to the ec2 instance.

  • EC2 Instance should be launched in private subnet.

  • Follow the steps in Linux Installation for installing Vexdata server.

  • Create AWS Load Balancer and route http traffic to the ec2 instance created above.

  • and expose only HTTPS traffic to the load balancer.

Create Role for EC2 instance to launch EMR Clusters

  • Create a role and attache the policy below.

  • Create an S3 bucket so EMR cluster can write the logs.

  • Create an IAM policy from the . Update the sample with the account number and bucket name from the above step.

Create SSL Certificate
sample