AirByte Introduction

1. Airbyte is a tool to Migrate data from one source to other
   Ex: Postgres to MYSQL, S3 to Postgres…etc
   There ismultiple sources
   Some of sources:

   

2. With the Source(input) and Destination(output) it creates a pipeline between both source and destination called Connections
   Ex:

   

3. We can check status of Sync(Migrating)

   

4. Job History Here we can see History and Logs of the Migration process

   

5. EX Log:

   

6. Replication Here we can modify the destination format and we can modify the sync mode Overwrite or Append the data and can select the required fields(columns) to pull or migrate

   

   

7. Transfomation Normalization is the process which Transform JSON format source into a relational table format which uses the appropriate column types in the destination.

   

Normalization is only relevant for some relational database & warehouse destinations

• BigQuery
• Snowflake
• Redshift
• Postgres
• Oracle
• MySQL
• MSSQL

At Helical, with more than 10+ years of experience in the space of data domain, we have got extensive experience of implementing data solutions including modern data stack. We also provide consulting, implementation, maintenance and support services on top of Airbyte. Reach out to us on nikhilesh@Helicaltech.com to learn more about our services