Verified Job
Back Office / Data Entry
Azure Data Engineer- Azure Databricks
Back Office / Data Entry
#14175
Remote / WFH
Tata Consultancy Services
Job Description
TCS Hiring for Azure Data Engineer- Azure Databricks
Experience Range: - 06 To 10 Years (Mandatory)
(Note: Candidates below 6 years of IT experience shall not be considered)
Job Locations : Mumbai
JOB DESCRIPTION
Must have Skills: Azure Data Factory, Azure Databricks
Good to have Skills: Python, Pyspark
Responsibilities or Expectations from the Role:
• Implementing highly performant, scalable and re-usable data ingestion and transformation pipelines across Azure components and services
• Strong experience using Logic Apps, Functions & Data Factory
• Strong experience of development using Microsoft Azure as well as experience of developing integrations for large, complex pieces of software.
• Strong understanding of the technical side of CI / CD
• Strong understanding of Agile
• Designing and implementing a data warehouse on Azure using Azure HDInsight, Azure Data Factory, ADLS, Databricks, SQL Server, SQL DWH, Analytics Service, Event Hubs, KeyVault and other Azure services
• Designing, orchestrating and implementing highly performant, scalable and re-usable data ingestion and transformation pipelines across Azure components and services
• Designing and implementing Event based and streaming data ingestion and processing using Azure PaaS services
• Data ingestion, data engineering and/or data curation using native Azure services or tools available in Azure Marketplace
• Designing and implementing data governance, data cataloguing and data lineage solutions using tools such as Azure Data Catalog/Informatica Data Catalog
• Developing physical data models in MongoDB, SQL DWH , ...etc.
• Developing APIs
• Have worked in agile delivery teams with DevOps ways of working to continuously deliver iterative deployments with experience in using Jira, Git Repositories, Confluence, or similar
• Have had experience in data migration activities in the past including migration strategy and approach, source and target system discovery, analysis, mapping, development and reconciliation
Minimum Qualification:
15 years of Full Time Education
Experience Range: - 06 To 10 Years (Mandatory)
(Note: Candidates below 6 years of IT experience shall not be considered)
Job Locations : Mumbai
JOB DESCRIPTION
Must have Skills: Azure Data Factory, Azure Databricks
Good to have Skills: Python, Pyspark
Responsibilities or Expectations from the Role:
• Implementing highly performant, scalable and re-usable data ingestion and transformation pipelines across Azure components and services
• Strong experience using Logic Apps, Functions & Data Factory
• Strong experience of development using Microsoft Azure as well as experience of developing integrations for large, complex pieces of software.
• Strong understanding of the technical side of CI / CD
• Strong understanding of Agile
• Designing and implementing a data warehouse on Azure using Azure HDInsight, Azure Data Factory, ADLS, Databricks, SQL Server, SQL DWH, Analytics Service, Event Hubs, KeyVault and other Azure services
• Designing, orchestrating and implementing highly performant, scalable and re-usable data ingestion and transformation pipelines across Azure components and services
• Designing and implementing Event based and streaming data ingestion and processing using Azure PaaS services
• Data ingestion, data engineering and/or data curation using native Azure services or tools available in Azure Marketplace
• Designing and implementing data governance, data cataloguing and data lineage solutions using tools such as Azure Data Catalog/Informatica Data Catalog
• Developing physical data models in MongoDB, SQL DWH , ...etc.
• Developing APIs
• Have worked in agile delivery teams with DevOps ways of working to continuously deliver iterative deployments with experience in using Jira, Git Repositories, Confluence, or similar
• Have had experience in data migration activities in the past including migration strategy and approach, source and target system discovery, analysis, mapping, development and reconciliation
Minimum Qualification:
15 years of Full Time Education
