Verified Job
IT / Software / Data Analyst
Data Engineer
IT / Software / Data Analyst
#798097
Remote / WFH
AllRecruits Ltd
Job Description
Data Engineer
Job Overview
We are seeking an experienced and highly motivated Data Engineer to design, build, and maintain scalable, reliable, and high-performing data platforms and pipelines. The ideal candidate will have experience working with large-scale data ecosystems and modern cloud-based data technologies, with a strong focus on data quality, validation, cleansing, and governance.
This role requires a self-directed individual who can work independently, partner with clients and stakeholders, and contribute to strategic initiatives. The successful candidate will be technology agnostic, adaptable to evolving technology landscapes, and passionate about continuously improving processes, standards, and ways of working.
Key Responsibilities
Data Engineering & Architecture
Design, develop, and maintain scalable data pipelines and ETL/ELT frameworks.
Build and optimize data solutions for processing large volumes of structured and unstructured data.
Design and implement modern data architectures that support analytics, reporting, machine learning, and business intelligence initiatives.
Ensure data platforms are secure, reliable, scalable, and maintainable.
Support real-time and batch data processing requirements.
Data Quality & Governance
Develop and maintain data validation, data quality, and data cleansing processes.
Implement monitoring, auditing, and alerting mechanisms to ensure data integrity.
Identify and resolve data anomalies, inconsistencies, and performance bottlenecks.
Establish best practices for data governance, lineage, and metadata management.
Platform Development
Develop and support solutions using:
Databricks
Snowflake
Azure Synapse Analytics
SQL Server
PostgreSQL
Cloud and hybrid data platforms
Optimize database performance, query execution, and storage strategies.
Support data migration, modernization, and integration initiatives.
Required Skills & Experience
Technical Skills
4 years of experience designing, building, and maintaining data platforms and solutions.
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
Experience with technologies like:
Databricks
Snowflake
Azure Synapse Analytics
Microsoft SQL Server
PostgreSQL
SQL development and optimization
Experience developing ETL/ELT pipelines and integrating data from multiple sources.
Strong understanding of data modelling, data warehousing, and lakehouse architectures.
Experience implementing data quality, validation, cleansing, and reconciliation processes.
Knowledge of cloud-based data platforms and modern data engineering practices.
Familiarity with CI/CD, DevOps, automation, and infrastructure-as-code principles is desirable.
Self-motivated and capable of working independently with minimal supervision.
Proven ability to support client initiatives and deliver business outcomes.
Comfortable working across diverse technologies and adapting to changing technical environments.
Positive, collaborative, and solutions-focused attitude.
Show less
Job Overview
We are seeking an experienced and highly motivated Data Engineer to design, build, and maintain scalable, reliable, and high-performing data platforms and pipelines. The ideal candidate will have experience working with large-scale data ecosystems and modern cloud-based data technologies, with a strong focus on data quality, validation, cleansing, and governance.
This role requires a self-directed individual who can work independently, partner with clients and stakeholders, and contribute to strategic initiatives. The successful candidate will be technology agnostic, adaptable to evolving technology landscapes, and passionate about continuously improving processes, standards, and ways of working.
Key Responsibilities
Data Engineering & Architecture
Design, develop, and maintain scalable data pipelines and ETL/ELT frameworks.
Build and optimize data solutions for processing large volumes of structured and unstructured data.
Design and implement modern data architectures that support analytics, reporting, machine learning, and business intelligence initiatives.
Ensure data platforms are secure, reliable, scalable, and maintainable.
Support real-time and batch data processing requirements.
Data Quality & Governance
Develop and maintain data validation, data quality, and data cleansing processes.
Implement monitoring, auditing, and alerting mechanisms to ensure data integrity.
Identify and resolve data anomalies, inconsistencies, and performance bottlenecks.
Establish best practices for data governance, lineage, and metadata management.
Platform Development
Develop and support solutions using:
Databricks
Snowflake
Azure Synapse Analytics
SQL Server
PostgreSQL
Cloud and hybrid data platforms
Optimize database performance, query execution, and storage strategies.
Support data migration, modernization, and integration initiatives.
Required Skills & Experience
Technical Skills
4 years of experience designing, building, and maintaining data platforms and solutions.
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
Experience with technologies like:
Databricks
Snowflake
Azure Synapse Analytics
Microsoft SQL Server
PostgreSQL
SQL development and optimization
Experience developing ETL/ELT pipelines and integrating data from multiple sources.
Strong understanding of data modelling, data warehousing, and lakehouse architectures.
Experience implementing data quality, validation, cleansing, and reconciliation processes.
Knowledge of cloud-based data platforms and modern data engineering practices.
Familiarity with CI/CD, DevOps, automation, and infrastructure-as-code principles is desirable.
Self-motivated and capable of working independently with minimal supervision.
Proven ability to support client initiatives and deliver business outcomes.
Comfortable working across diverse technologies and adapting to changing technical environments.
Positive, collaborative, and solutions-focused attitude.
Show less
