Lead Big Data Developer

Job Description

To be successful in this role, you should possess a unique blend of technical expertise and leadership skills.
Key Responsibilities
• Collaborate closely with cross-functional teams to devise and build scalable solutions.
• Design and implement systems to cleanse, process, and analyze large data sets using distributed processing tools like Akka and Spark.
• Participate in design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.
• Understand and critically review existing data pipelines, and come up with ideas to improve upon current bottlenecks.
• Take initiatives to pick up new technologies and work as a Senior Individual contributor on multiple products and features.
Requirements
• 8+ years of experience in developing highly scalable Big Data pipelines.
• Hands-on experience in team leading and leading product or module development.
• In-depth understanding of the Big Data ecosystem including processing frameworks like Spark, Akka, Storm, and Hadoop.
• Experience with ETL and Data pipeline tools like Apache NiFi, Airflow etc.
• Excellent coding skills in Java or Scala, including the understanding to apply appropriate Design Patterns when required.
• Experience with Git and build tools like Gradle/Maven/SBT.
• Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization. Read more