Position: Automation Engineer (AI Testing)
Location: Irving, TX (On-site/Hybrid)
Type: Full-time
Experience: 8+ Years
(Not open for C2C)
Job description:
Automation Engineer: AI Application testing, Java, Selenium, BDD (or Playwright preferably) for UI & API Automation
Key Responsibilities:
- Design and implement Test Automation Frameworks for testing Generative AI (GenAI) enabled applications.
- Build on existing Test Automation Frameworks (such as Selenium, Playwright) for testing of UI, API and AI components of applications.
- Engage with BAs / Product Owners / business stakeholders / other project stakeholders in understanding requirements and design to prepare test automation strategy and test plan.
- Automate and test GenAI applications implementing semantic search, automatic speech recognition (ASR / STT), text-to-speech (TTS), agents & workflows using Retrieval Augmented Generation (RAG), Knowledge Graph and Large Language Model (LLM) Frameworks.
- Automate and test UI, API components and integrate and perform end-to-end testing of the applications.
- Through implementation and adoption of Test Automation and Frameworks for inline and regression testing, ensure zero defect leakage and smooth go-live of GenAI applications under test.
- Lead offshore team and coordinate with program stakeholders.
Experience & Skillset
MUST-HAVE
- 9 – 12 of IT experience, primarily in Testing and Test Automation.
- Prior experience in testing GenAI -enabled applications.
- Experience in automation of AI features; Experience in ASR / STT, TTS and reversing such capability to test application features.
- Experience building Test Automation Frameworks and enhancing existing Frameworks.
- Experience in automation testing of UI and API components using Frameworks such as Selenium, Playwright using BDD / Gherkin irrespective of languages / technologies.
- Experience leading Automation and Testing teams and to increase adoption of Frameworks.
- Experience operating in onsite-offshore model and driving project delivery from onsite