Lead I - Data Engineering

Role Description

Experience Range:

5-10 years in a similar role

Hiring Locations:

Noida, Pune, Hyderabad, Bangalore, Kochi, Trivandrum, Chennai

Must-Have Skills
• Hands-on experience with PySpark and GCP (or any other cloud platform)
• Strong proficiency in SQL
• Expertise in designing, implementing, and optimizing data pipelines using Spark, Hadoop, Hive
• Proven experience in monitoring and troubleshooting data pipelines to ensure minimal downtime and optimal performance
• Strong problem-solving skills and ability to work in a collaborative team environment
• Excellent communication skills (written and verbal)

Good-to-Have Skills
• Experience working closely with product managers and data stewards to understand data requirements
• Familiarity with data governance and data quality best practices
• Knowledge of big data architecture and distributed computing

Key Responsibilities
• Design, implement, and optimize scalable data pipelines using Spark, Hadoop, Hive, and other relevant technologies
• Collaborate with product managers and data stewards to translate data requirements into efficient data workflows
• Monitor and troubleshoot data pipelines, ensuring reliability and performance
• Work in a fast-paced, agile environment, solving complex data challenges
• Stay updated with the latest data engineering trends and technologies

Skills

Spark,Hadoop,Hive,Gcp