Required Technical Skill Set**
• Should have experience in Big Query, Pub/ Sub, Dataflow, Composer DAGs and Air flow
• Strong SQL knowledge – able to translate complex scenarios into queries
• Experience with Data modeling and mapping.
• Experience with Google Cloud SDK & API Scripting
• Strong Programming experience in Python
• Experience in Agile processes and DevOps methodologies.
• Experience of Retail domain will be an added advantage
Responsibility of / Expectations from the Role
• Create and maintain optimal data pipeline architecture replicating the existing process.
• Analyze, explore and select the appropriate tools for data migration and transformation.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Keep data separated and secured using masking and encryption.
• Work with data and analytics experts to strive for greater functionality in data systems.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.