Verified Job
IT / Software / Data Analyst
AI Agent Deployment- QA Engineer
IT / Software / Data Analyst
#746266
Remote / WFH
Siemens · Bengaluru, Karnataka ·
Job Description
Job description
About The Role
Location : Electronic city, Bangalore
We operate a growing portfolio of purpose-built AI agents serving engineering, commercial, and operational teams in Asia Pacific — spanning various industries. As our AI Agent Deployment & QA Engineer, you will be the operational backbone of our Agent Factory: deploying, testing, maintaining, and scaling agents across the business. No domain expertise required — what matters is fluency in enterprise AI agent platforms, structured QA thinking, and the ability to keep agents accurate and continuously improving.
Key Responsibilities
• Deploy and configure AI agents on enterprise platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, or equivalent) — system instructions, knowledge base (KB) files, topic flows, connectors, and multi-agent orchestration
• Manage KB file architecture, versioned updates, licensing, and environment provisioning
• Design and execute structured test plans covering prompt coverage, edge cases, hallucination checks, and retrieval accuracy; maintain QA logs and run regression testing after every update
• Collect and triage user feedback; translate into change requests and coordinate KB updates with domain knowledge owners
• Maintain the agent registry (version history, owner, deployment status, KB sources) and support governance standards
• Drive rollout of agents to new users, teams, and geographies; produce onboarding documentation and user guides
Required Qualifications
• 5–10 years in software/platform deployment, technical operations, or QA roles
• Hands-on experience with one or more enterprise AI agent platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, AWS Bedrock Agents, or equivalent) — mandatory
• Cloud platform administration knowledge (Microsoft 365 / Azure or equivalent); identity and access management
• Familiarity with prompt engineering and LLM behaviour (grounding, retrieval, hallucination)
• Basic REST API / JSON integration exposure; version control awareness
• Detail-oriented, self-directed, and comfortable working with non-technical domain experts across time zones
Preferred
• Microsoft certifications (PL-100, PL-200, PL-600, AI-102) or equivalent cloud AI credentials
• Familiarity with Azure AI services (Azure OpenAI, AI Search) or equivalent
• Background in system integration, technology consulting, or industrial sectors (Oil & Gas, Marine, Energy, Data Centres)
Why Join Us
• Work on production-grade industrial AI — real deployments, not pilots
• Build deep expertise across enterprise agent platforms in a structured, multi-vertical programme
• Be part of a team designing what AI-native industrial services look like at scale
Who is Siemens Energy?
At Siemens Energy, we are more than just an energy technology company. With ~100,000 dedicated employees in more than 90 countries, we develop the energy systems of the future, ensuring that the growing energy demand of the global community is met reliably and sustainably. The technologies created in our research departments and factories drive the energy transition and provide the base for one sixth of the world's electricity generation.
About The Role
Location : Electronic city, Bangalore
We operate a growing portfolio of purpose-built AI agents serving engineering, commercial, and operational teams in Asia Pacific — spanning various industries. As our AI Agent Deployment & QA Engineer, you will be the operational backbone of our Agent Factory: deploying, testing, maintaining, and scaling agents across the business. No domain expertise required — what matters is fluency in enterprise AI agent platforms, structured QA thinking, and the ability to keep agents accurate and continuously improving.
Key Responsibilities
• Deploy and configure AI agents on enterprise platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, or equivalent) — system instructions, knowledge base (KB) files, topic flows, connectors, and multi-agent orchestration
• Manage KB file architecture, versioned updates, licensing, and environment provisioning
• Design and execute structured test plans covering prompt coverage, edge cases, hallucination checks, and retrieval accuracy; maintain QA logs and run regression testing after every update
• Collect and triage user feedback; translate into change requests and coordinate KB updates with domain knowledge owners
• Maintain the agent registry (version history, owner, deployment status, KB sources) and support governance standards
• Drive rollout of agents to new users, teams, and geographies; produce onboarding documentation and user guides
Required Qualifications
• 5–10 years in software/platform deployment, technical operations, or QA roles
• Hands-on experience with one or more enterprise AI agent platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, AWS Bedrock Agents, or equivalent) — mandatory
• Cloud platform administration knowledge (Microsoft 365 / Azure or equivalent); identity and access management
• Familiarity with prompt engineering and LLM behaviour (grounding, retrieval, hallucination)
• Basic REST API / JSON integration exposure; version control awareness
• Detail-oriented, self-directed, and comfortable working with non-technical domain experts across time zones
Preferred
• Microsoft certifications (PL-100, PL-200, PL-600, AI-102) or equivalent cloud AI credentials
• Familiarity with Azure AI services (Azure OpenAI, AI Search) or equivalent
• Background in system integration, technology consulting, or industrial sectors (Oil & Gas, Marine, Energy, Data Centres)
Why Join Us
• Work on production-grade industrial AI — real deployments, not pilots
• Build deep expertise across enterprise agent platforms in a structured, multi-vertical programme
• Be part of a team designing what AI-native industrial services look like at scale
Who is Siemens Energy?
At Siemens Energy, we are more than just an energy technology company. With ~100,000 dedicated employees in more than 90 countries, we develop the energy systems of the future, ensuring that the growing energy demand of the global community is met reliably and sustainably. The technologies created in our research departments and factories drive the energy transition and provide the base for one sixth of the world's electricity generation.
