Contract Data Pipeline Engineer

PLEASE READ:This role is paid hourly based on hours worked, not fixed salary. There will not be a PF contribution deducted from paychecks.We cannot work with a notice period of longer than 4 weeks for this role4+ Years of Experience in Data Engineering: Extensive experience in the field of data engineering.Experience with PySpark: Proficiency in using PySpark for data processing and analysis.SQL Expertise: Strong skills in SQL for querying and managing databases.MySQL Experience: Hands-on experience with MySQL server, including querying and stored procedures.Snowflake Knowledge: Proficiency in using Snowflake for data warehousing and modeling.ETL Migrations: Experience with ETL processes, specifically extracting and loading data.AWS Glue: Expertise in using AWS Glue for data replication and transformation tasks.Insight Global is looking to hire Mid and Senior level data engineers for one of our clients. The ideal candidate will be responsible for migrating data pipelines from multiple apps from 2 legacy databases (one is on-prem Oracle and the other is MsSQL) into Snowflake. These databases host core apps like Salesforce, NetSuite, Workday, etc. Additionally, the role involves replicating data in S3, performing modeling on 20% of the data, and developing new models. This role involves making API calls, querying databases, and handling data extraction and loading processes. The candidate should have experience with AWS Glue for data replication and modeling in Snowflake, as well as using Talend for ETL migrations. Proficiency in AWS Glue, Sparq, and Snowflake is essential. The role may require coding in PySpark and potentially SCALA. Experience with MySQL server, including querying and stored procedures, is also required.

Information :

• Company : Insight Global
• Position : Contract Data Pipeline Engineer
• Location : Karnātaka
• Country : IN