EPAM Systems develops software and supports businesses with digital engineering.
Senior Automation Tester in Python (Agentic Gateway testing)
We are looking for a Senior Automation Tester in Python to join our team and build an Enterprise Agent Development Platform — a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The platform standardizes agent development across the organization using LangGraph and Strands…
3× plus de chances d’entretien avec un cold email
View original job listingInformation about EPAM Systems
- Official domain
- epam.com
- Open jobs
- 334
Job details
The full description published by EPAM Systems.
Description de l’offre
We are looking for a Senior Automation Tester in Python to join our team and build an Enterprise Agent Development Platform — a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The platform standardizes agent development across the organization using LangGraph and Strands Agents on AWS AgentCore Runtime.
The initiative spans agent framework design, runtime architecture, marketplace integration, CI/CD automation, and enterprise-grade observability — reducing agent development from months to days while enforcing consistent security, quality, and governance standards. You will own functional, security, and performance test suites for the agentic gateway.
responsibilities
Design and execute test suites for agentic workflows, including tool discovery, tool invocation, and multi-step agent workflows Validate MCP protocol behavior, including tool list aggregation, tool call routing, and streaming response handling Verify agent authorization mechanisms, including unauthorized tool access attempts and policy enforcement validation Conduct agent performance testing covering tool discovery latency, concurrent agent sessions, and agent-to-agent latency
Build Python-based test automation using pytest with async support, mock MCP servers, and agent workflow simulation Validate agentic observability, including trace completeness, agent step logging, and audit trail verification
Collaborate with engineering teams to define quality standards for agent framework design and runtime architecture
Support CI/CD automation efforts by integrating test suites into deployment pipelines requirements 3+ years of QA engineering experience for AI/ML or agent systems Hands-on experience testing AI agent systems in a production agentic AI project, such as MCP protocol testing, agent authorization/policy-enforcement testing, or multi-step agent workflow test automation Experience testing LLM agent workflows, including tool calling and multi-step reasoning Expertise in security testing for authorization and authentication Skills in performance benchmarking for cloud services nice to have Familiarity with MCP protocol testing
Background in agent framework testing (LangChain, LangGraph, Crew) Knowledge of AWS Bedrock Agents testing Understanding of chaos engineering for agentic systems Familiarity with audit log validation (CloudTrail, OpenTelemetry traces)
Apply for this job
How do I apply?
The job is published on EPAM Systems’s website. Open the original posting ↗ to submit your application. Screeningpass does not fill in a form for you.
Who should you write to at EPAM Systems about this role?
Start a contact search from this page. Screeningpass suggests up to three people connected to the role. Choose whom to write to, then Screeningpass looks for their professional email and prepares a message. You review it and send it yourself with Gmail. An email address is not always available, and a reply is never guaranteed.
How much does finding a contact cost?
A search costs 1 credit. Your credit is returned if the search fails. Signing up gives you 3 credits, enough for 3 searches.
What does Screeningpass do?
Screeningpass brings together internships, apprenticeships and jobs published by companies. For a job, Screeningpass finds someone to contact at the company, looks for their professional email and prepares a message using your CV. See how it works in detail.