Verified Job
IT / Software / Data Analyst
Big Data amp GCP Lead Software Engineer
IT / Software / Data Analyst
#370651
Remote / WFH
Job Description
We are in search of an experienced Lead Engineer who possesses advanced skills in Big Data technologies and Google Cloud Platform (GCP). If you are an accomplished Lead Software Engineer with a robust background in Big Data technologies, GCP, and a passion for optimizing data pipelines, we encourage you to apply. Join our team and lead the design, development, and optimization of data solutions that power our cross-functional endeavors and drive excellence.
Responsibilities
• Design, developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehousing projects in GCP cloud, combined with other technologies
• Ensure the use of Big Query SQL, Java/Python/Scala and Spark reduces lead time to delivery and aligns to overall group strategic direction so that cross-functional development is usable
• Ownership of technical solutions from design and architecture perspective, ensure the right direction and propose resolution to potential data pipeline-related problems.
• Expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
• Provide technical guidance and support to a vibrant engineering team. Coaching and teaching your teammates how to do great data engineering.
• A deep understanding of data architecture principles and data warehouse methodologies specifically Kimball or Data Vault.
Requirements
• An expert in GCP, with at least 8 to 12 years of delivery experience with: Dataproc, Dataflow, Big Query, Compute, Pub/Sub, and Cloud Storage
• Highly knowledgeable in industry best practices for ETL Design, Principles, and Concepts
• Equipped with 3 years of experience with programming languages – Python
• A DevOps and Agile engineering practitioner with experience in a test-driven development
• Experienced in the following technologies: Google Cloud Platform, Dataproc, Dataflow, Spark SQL, Big Query SQL, PySpark and Python/Scala
• Experienced in the following BigData technologies: Spark, Hadoop, Kafka etc..
Technologies
• Big Data
• Spark
• Python/Scala
• GCP
We offer
• Insurance Coverage
• Paid Leaves – including maternity, bereavement, paternity, and special COVID-1+ leaves.
• Financial assistance for medical crisis
• Retiral Benefits – VPF and NPS
• Customized Mindfulness and Wellness programs
• EPAM Hobby Clubs
• Hybrid Work Model
• Soft loans to set up workspace at home
• Stable workload
• Relocation opportunities with ‘EPAM without Borders’ program
• Certification trainings for technical and soft skills
• Access to unlimited LinkedIn Learning platform
• Access to internal learning programs set up by world class trainers
• Community networking and idea creation platforms
• Mentorship programs
• Self-driven career progression tool
Responsibilities
• Design, developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehousing projects in GCP cloud, combined with other technologies
• Ensure the use of Big Query SQL, Java/Python/Scala and Spark reduces lead time to delivery and aligns to overall group strategic direction so that cross-functional development is usable
• Ownership of technical solutions from design and architecture perspective, ensure the right direction and propose resolution to potential data pipeline-related problems.
• Expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
• Provide technical guidance and support to a vibrant engineering team. Coaching and teaching your teammates how to do great data engineering.
• A deep understanding of data architecture principles and data warehouse methodologies specifically Kimball or Data Vault.
Requirements
• An expert in GCP, with at least 8 to 12 years of delivery experience with: Dataproc, Dataflow, Big Query, Compute, Pub/Sub, and Cloud Storage
• Highly knowledgeable in industry best practices for ETL Design, Principles, and Concepts
• Equipped with 3 years of experience with programming languages – Python
• A DevOps and Agile engineering practitioner with experience in a test-driven development
• Experienced in the following technologies: Google Cloud Platform, Dataproc, Dataflow, Spark SQL, Big Query SQL, PySpark and Python/Scala
• Experienced in the following BigData technologies: Spark, Hadoop, Kafka etc..
Technologies
• Big Data
• Spark
• Python/Scala
• GCP
We offer
• Insurance Coverage
• Paid Leaves – including maternity, bereavement, paternity, and special COVID-1+ leaves.
• Financial assistance for medical crisis
• Retiral Benefits – VPF and NPS
• Customized Mindfulness and Wellness programs
• EPAM Hobby Clubs
• Hybrid Work Model
• Soft loans to set up workspace at home
• Stable workload
• Relocation opportunities with ‘EPAM without Borders’ program
• Certification trainings for technical and soft skills
• Access to unlimited LinkedIn Learning platform
• Access to internal learning programs set up by world class trainers
• Community networking and idea creation platforms
• Mentorship programs
• Self-driven career progression tool
