Verified Job
IT / Software / Data Analyst
Data Engineer
IT / Software / Data Analyst
#515900
Remote / WFH
Job Description
Role: Data Engineer
Hire type: Contract
Duration: 12+months, Likely long term
Notice period : Immediate to 30Days
Job Description: We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will have >5 years’ experience with >2 years experience working specifically with Data bricks. Databricks Certification is preferred. DBT Cloud development experience and exposure to data vault modeling techniques is good to have.
The client is migrating from Teradata / Informatica to Databricks / dbt. Any experience working on migrations to Data bricks is preferred.
Key Responsibilities:
Design, develop, and maintain scalable data pipelines and ETL processes using Databricks.
Learn dbt cloud quickly, onboard oneself with training courses and help from team members.
Utilize Data Vault methodology to design and build data warehouses.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Optimize and tune data processing workflows for performance and scalability.
Ensure data quality, integrity, and security across all data platforms.
Own and document data pipelines and data lineage.
Monitor and troubleshoot data pipeline issues to ensure timely and accurate data delivery.
Qualifications:
Bachelor's degree in computer science, Information Technology, or a related field.
Proven experience as a Data Engineer, with a strong focus on Databricks.
Strong programming skills in SQL, Python, or other relevant languages.
Experience with cloud platforms such as AWS, Azure, or GCP.
Ability to work on multiple areas like Data pipeline ETL, Data modeling & design, writing complex SQL queries etc.
Excellent problem-solving skills and attention to detail.
Effective communication and collaboration skills.
Preferred Qualifications:
Hands-on experience with dbt Cloud for data modeling and transformations is preferred.
Exposure to Data Vault methodology and data warehousing concepts is preferred
Experience with other data engineering tools and technologies (e.g., Apache Spark, Airflow).
Knowledge of data governance and data security best practices.
Familiarity with CI/CD pipelines and DevOps practices.
Hire type: Contract
Duration: 12+months, Likely long term
Notice period : Immediate to 30Days
Job Description: We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will have >5 years’ experience with >2 years experience working specifically with Data bricks. Databricks Certification is preferred. DBT Cloud development experience and exposure to data vault modeling techniques is good to have.
The client is migrating from Teradata / Informatica to Databricks / dbt. Any experience working on migrations to Data bricks is preferred.
Key Responsibilities:
Design, develop, and maintain scalable data pipelines and ETL processes using Databricks.
Learn dbt cloud quickly, onboard oneself with training courses and help from team members.
Utilize Data Vault methodology to design and build data warehouses.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Optimize and tune data processing workflows for performance and scalability.
Ensure data quality, integrity, and security across all data platforms.
Own and document data pipelines and data lineage.
Monitor and troubleshoot data pipeline issues to ensure timely and accurate data delivery.
Qualifications:
Bachelor's degree in computer science, Information Technology, or a related field.
Proven experience as a Data Engineer, with a strong focus on Databricks.
Strong programming skills in SQL, Python, or other relevant languages.
Experience with cloud platforms such as AWS, Azure, or GCP.
Ability to work on multiple areas like Data pipeline ETL, Data modeling & design, writing complex SQL queries etc.
Excellent problem-solving skills and attention to detail.
Effective communication and collaboration skills.
Preferred Qualifications:
Hands-on experience with dbt Cloud for data modeling and transformations is preferred.
Exposure to Data Vault methodology and data warehousing concepts is preferred
Experience with other data engineering tools and technologies (e.g., Apache Spark, Airflow).
Knowledge of data governance and data security best practices.
Familiarity with CI/CD pipelines and DevOps practices.
