▷ High Salary! Data Engineer
Job Description
Job Type: Full-Time
Location: Kolkata, IN
Experience: - 3+ to 10+ Years
Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step Function
Responsibilities:
Data Pipeline Development:
- Design and implement data ingestion and transformation workflows using AWS Glue.
- Develop and manage ETL processes utilizing AWS Lambda for serverless data processing.
Database Management:
- Deploy and maintain AWS RDS instances and DynamoDB tables, ensuring high availability, performance, and security.
- Monitor and troubleshoot database performance issues and implement best practices for tuning and scaling.
Data Storage Solutions:
- Utilize AWS S3 for data storage and retrieval, managing data lifecycle and access policies.
- Develop efficient data models and storage strategies to support various analytics use cases.
Serverless Architecture:
- Create and manage serverless workflows using AWS Step Functions to coordinate application components and data processes.
- Write and maintain Python and PySpark scripts for data transformation and processing tasks.
Collaboration and Support:
- Work closely with data analysts, data scientists, and application developers to support data-driven projects and initiatives.
- Provide technical support for database-related issues and assist in troubleshooting data pipeline failures.
Best Practices and Security:
- Implement data governance and security policies to ensure compliance with industry standards and best practices.
- Stay current with emerging AWS technologies and best practices for database management and data engineering.
Qualifications:
Bachelor’s degree in computer science, Information Technology, or a related field.
