Senior AI Data Engineer

Job Title: Senior AI Data Engineer

Location: Remote

Experience Level: 5 - 8 Years

Must-Have Skills:
• Generative AI
• Azure Tech Stack
• Python

Job Description:

We are seeking a talented and experienced Data Engineer with a strong background in AI to join our remote team. The ideal candidate will possess a deep understanding of Python programming and experience working with Azure services, along with expertise in various AI concepts and practices.

Key Responsibilities:
• Develop and maintain data pipelines and ETL processes using Python.
• Build and integrate REST APIs, Fast APIs, and Graph APIs for data access and manipulation.
• Utilize SQL Alchemy for database interactions and management.
• Work with Azure services including DataLake, Azure SQL, Function App, and Azure Cognitive Search.
• Implement and optimize techniques such as chunking, embeddings, vectorization, indexing, prompting, and addressing hallucinations in AI models.
• Employ Retrieval-Augmented Generation (RAG) strategies to enhance data retrieval and model performance.
• Collaborate with DevOps teams to create pull requests, maintain code repositories, and ensure smooth deployment processes.
• Communicate effectively with team members and stakeholders to align on project goals and deliverables.

Qualifications:
• Strong proficiency in Python and experience with data processing libraries.
• Familiarity with REST APIs, Fast APIs, Graph APIs, and SQL Alchemy.
• Hands-on experience with Azure services, particularly in data engineering contexts.
• Knowledge of generative AI concepts and their practical applications.
• Experience with DevOps practices and tools.
• Excellent communication and collaboration skills.