Verified Job
Jobs
Sr Data Engineer Databricks
Jobs
#336691
Full Time
Job Description
Job Description
Position : Sr Data Engineer - Databricks
Experience : 4 - 6 Years
Company Profile :
Exponentia.ai is an AI tech organization with presence across India, Singapore, Middle East, and the UK. We are an innovative and disruptive organization, working on cutting edge technology to help our clients transform into the enterprises of the future.
We provide artificial intelligence-based products / platforms capable of automated cognitive decision making to improve productivity, quality, and economics of the underlying business processes.
Currently, we are transforming ourselves and rapidly expanding our business.
Exponentia.ai has developed long term relationships with world class clients such as PayPal, PayU, SBI Group, HDFC Life, Kotak Securities, Wockhardt and Adani Group amongst others.
One of the top partners of Cloudera (leading analytics player) and Qlik (leader in BI technologies), Exponentia.ai has recently been awarded 'Innovation Partner Award' by Qlik in 2017.
Get to know more about us on ourwebsite : and.
Roles & Responsibilities :
• Proficient in a source code control system such as GIT
• Experience with data warehousing architecture
• Good understanding and experience working on Delta Lake using Apache Delta in Azure Databricks Building Data Pipelines for File, Database, and API based ingestion using different activities within and also with Data flows for any Data Transformation
• Remain current with technology trends relevant to data and analytics.
• Record how data is moved around the virtual enterprise, including frequency of movement, source and destination of each step, transformation, and any aggregation or calculations.
Recommend any opportunities for efficiencies and improvement of data quality.
• Work with the business and application designers to identify and model integrative views of data and determine the quality-of-service requirements (data currency, availability, response times, and data volumes)
• Experience in Unity Catalog, Z order indexing, vacuum and optimize.
• Experience in ADF, ADLS Gen2
• Deployment experience through Azure DevOps in production environment.
BE / ME / MS / MCA
Position : Sr Data Engineer - Databricks
Experience : 4 - 6 Years
Company Profile :
Exponentia.ai is an AI tech organization with presence across India, Singapore, Middle East, and the UK. We are an innovative and disruptive organization, working on cutting edge technology to help our clients transform into the enterprises of the future.
We provide artificial intelligence-based products / platforms capable of automated cognitive decision making to improve productivity, quality, and economics of the underlying business processes.
Currently, we are transforming ourselves and rapidly expanding our business.
Exponentia.ai has developed long term relationships with world class clients such as PayPal, PayU, SBI Group, HDFC Life, Kotak Securities, Wockhardt and Adani Group amongst others.
One of the top partners of Cloudera (leading analytics player) and Qlik (leader in BI technologies), Exponentia.ai has recently been awarded 'Innovation Partner Award' by Qlik in 2017.
Get to know more about us on ourwebsite : and.
Roles & Responsibilities :
• Proficient in a source code control system such as GIT
• Experience with data warehousing architecture
• Good understanding and experience working on Delta Lake using Apache Delta in Azure Databricks Building Data Pipelines for File, Database, and API based ingestion using different activities within and also with Data flows for any Data Transformation
• Remain current with technology trends relevant to data and analytics.
• Record how data is moved around the virtual enterprise, including frequency of movement, source and destination of each step, transformation, and any aggregation or calculations.
Recommend any opportunities for efficiencies and improvement of data quality.
• Work with the business and application designers to identify and model integrative views of data and determine the quality-of-service requirements (data currency, availability, response times, and data volumes)
• Experience in Unity Catalog, Z order indexing, vacuum and optimize.
• Experience in ADF, ADLS Gen2
• Deployment experience through Azure DevOps in production environment.
BE / ME / MS / MCA
