SDET Contractor

Why Sony Interactive Entertainment? Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. SDET Contractor We are looking for an experienced Software Development Engineer in Test (SDET) to help ensure the quality, reliability, and resilience of Agentic AI systems and backend services. This role will design and implement automated testing strategies across AI/LLM-driven applications, APIs, microservices, and distributed systems. The ideal candidate brings strong Quality Engineering and test automation fundamentals, with experience testing Generative AI, LLM-based, or Agentic AI systems. They should be comfortable testing complex systems where behavior may be non-deterministic and traditional pass/fail testing alone may not be sufficient. Responsibilities Develop and execute comprehensive QE strategies and test plans for Agentic AI systems, backend services, APIs, and service integrations. Design and maintain scalable automated test frameworks across API, functional, integration, contract, regression, and end-to-end testing. Develop testing approaches for non-deterministic AI behavior and establish meaningful evaluation criteria. Identify quality risks early and apply risk-based, shift-left testing practices throughout the development lifecycle. Integrate automated testing into CI/CD pipelines and establish effective quality gates. Partner with Software Engineers, Product Managers, and other QE teams to improve testability, observability, and overall product quality. Analyze defects and production issues to identify root causes, testing gaps, and opportunities for continuous QE improvement. Establish quality metrics and provide visibility into test coverage, reliability, defects, and release readiness. What You'll Do Test Agentic AI workflows, including multi-step execution, tool selection and invocation, task completion, and failure handling. Validate AI-generated responses using appropriate measures for accuracy, relevance, groundedness, consistency, and adherence to expected behavior. Test AI guardrails, unexpected inputs, and failure scenarios, including incorrect tool usage and prompt-based attacks. Validate interactions between AI agents, APIs, tools, data sources, and downstream services. Develop reusable automation, test data, and evaluation scenarios for repeatable AI and services…