Verified Job
IT / Software / Data Analyst
AWS Senior Software Engineer
IT / Software / Data Analyst
#312865
Remote / WFH
Job Description
Job Description
As a Senior Software Engineer, you will work on teams building a variety of big data analytics solutions including big data lakes. More specifically, you will work on:
• Scalable data ingestion pipelines to handle real-time streams, CDC events, and batch data
• High-performance data processing for structured and unstructured data, and data harmonization
• Scheduling, orchestrating and validating pipelines
• Exception handling and log monitoring for debugging
• Collaborate with business consultants, data scientists, engineers, and application developers to develop analytics solutions
Job Requirement
Required Experience, Skills & Competencies
• Hands-on experience with:
Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack, etc
Spark, Scala, Python, and core/advanced Java
NoSQL databases e.g. Hbase, Cassandra, MongoDB
Relevant AWS components required to build big data solutions
Good to know: Databricks, Snowflake
• Ability to develop and manage scalable Hadoop cluster environments
• Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL
• 3+ years of professional experience with at least 2 years in big data engineering
Designation will be commensurate with expertise/experience. Compensation packages are among the best in the industry
As a Senior Software Engineer, you will work on teams building a variety of big data analytics solutions including big data lakes. More specifically, you will work on:
• Scalable data ingestion pipelines to handle real-time streams, CDC events, and batch data
• High-performance data processing for structured and unstructured data, and data harmonization
• Scheduling, orchestrating and validating pipelines
• Exception handling and log monitoring for debugging
• Collaborate with business consultants, data scientists, engineers, and application developers to develop analytics solutions
Job Requirement
Required Experience, Skills & Competencies
• Hands-on experience with:
Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack, etc
Spark, Scala, Python, and core/advanced Java
NoSQL databases e.g. Hbase, Cassandra, MongoDB
Relevant AWS components required to build big data solutions
Good to know: Databricks, Snowflake
• Ability to develop and manage scalable Hadoop cluster environments
• Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL
• 3+ years of professional experience with at least 2 years in big data engineering
Designation will be commensurate with expertise/experience. Compensation packages are among the best in the industry
