AI Test Automation Engineer

We are seeking a highly skilled and motivated SDET to join our AI team, which focuses on developing cutting-edge AI features such as prompt engineering, generative AI, and more. This role is ideal for someone passionate about ensuring the quality and reliability of AI-driven products and who thrives in a fast-paced, collaborative environment. As an SDET, you will play a key role in test design, test methodologies, and test automation, while working closely with stakeholders, developers, and data scientists to deliver high-quality AI solutions.

Key ResponsibilitiesTest Design & Execution

• Design, develop, and execute comprehensive test plans and cases for AI-driven features, including prompt-based systems and generative AI models.
• Apply proven test methodologies (e. G., boundary value analysis, equivalence partitioning) to ensure robust test coverage.
• Identify edge cases and potential failure points, especially in complex AI/ML systems.

Test Automation

• Build and maintain scalable, reliable test automation frameworks, preferably using TypeScript (other languages are welcome too).
• Automate regression, API, and end-to-end tests for AI features.
• Integrate automated tests into CI/CD pipelines (e. G., GitHub Actions).

Collaboration & Communication

• Partner with developers, data scientists, and stakeholders to understand requirements and ensure testability.
• Effectively communicate test results, risks, and quality metrics across the team.

AI/ML Testing

• Develop testing strategies for AI/ML-based features, including validation of LLM outputs, prompt responses, and generative AI behaviors.
• Validate the accuracy, consistency, and performance of AI models.

Quality Ownership & Problem-Solving

• Take ownership of the quality of AI features and proactively suggest improvements.
• Troubleshoot and debug issues across the stack, driving timely resolutions.

Must-Have Skills

• Test Design & Methodologies:

Expertise in designing test cases with a strong grasp of industry-standard testing techniques.- Test Automation: Hands-on experience building and maintaining automation frameworks.- Tech Stack: Proficiency in tools like Playwright, Selenium, or similar for UI and end-to-end testing.- API Testing: Strong experience with RESTful API testing and contract validation.- CI/CD: Familiarity with integrating tests into pipelines using tools like GitHub Actions.- Communication: Excellent written and verbal communication skills.- AI/ML Awareness: Basic understanding of AI/ML concepts, especially LLMs and generative AI.- Problem-Solving:

Strong analytical mindset to identify potential risks and failure scenarios. Nice-to-Have Skills

• Experience testing AI/ML and LLM-based systems.
• Familiarity with prompt engineering and prompt-based testing.
• Experience with TypeScript or similar scripting languages.
• Exposure to agentic systems or AI-driven workflows.
• Background working in startup or fast-paced environments.

Key Traits

• Customer-Centric:

Quickly understand user contexts and prioritize end-user experience.- Curious & Growth-Oriented: Eager to learn and stay ahead in the evolving AI/ML landscape.- Detail-Oriented: Meticulous in testing complex systems and uncovering subtle issues.- Ownership: High sense of responsibility and accountability for delivering quality products.Ideal Background: Bachelors or Masters degree in Computer Science, Engineering, or a related technical field 3-6 years of experience in software testing, automation, and quality engineering Passion for AI/ML, testing complex systems, and building reliable automationWhat We OfferWere building something ambitious, and we want you to grow with us.Heres what youll get as part of the ride:- Competitive salary and chance to work on cutting-edge technology.- Opportunities for professional development and technical advancement.- A friendly, collaborative and supportive work environment.- Flexible working hours.

Information :

• Company : Regie
• Position : AI Test Automation Engineer
• Location : Karnātaka
• Country : IN