Senior QA Engineer

Location: Dubai - 2/3 days in office per week

Salary: Competitive + Benefits

Recruitment Partner: Searchability

About the Opportunity

Searchability is delighted to be supporting an innovative AI-driven technology business in the search for a Senior QA Engineer. This is an opportunity to join a team building sophisticated data products and conversational AI systems, where quality, reliability and responsible AI are central to product success.

We're looking for a highly analytical QA professional with strong automation experience who is passionate about testing modern AI applications, large language models (LLMs) and complex data workflows.

The Role

As a Senior QA Engineer, you will lead quality assurance efforts across AI-powered products, data platforms and conversational agents. You will be responsible for defining quality standards, building automated testing frameworks and ensuring AI systems behave reliably, safely and consistently in production environments.

Working closely with Engineering, Data Science, Machine Learning and Product teams, you'll help establish best practices for testing generative AI applications while driving automation across the wider software development lifecycle.

Key Responsibilities

Design and execute testing strategies for conversational AI and generative AI products.
Develop and maintain automated testing frameworks using JavaScript and Python.
Create and execute chatbot testing scenarios covering user intent, conversation flows, edge cases and behavioural consistency.
Design LLM testing approaches including prompt validation, grounding validation, golden datasets and non-deterministic testing methodologies.
Perform AI safety and quality testing, including hallucination detection, bias assessment, toxicity testing and PII leakage validation.
Validate structured and unstructured data outputs to ensure accuracy, consistency and compliance.
Establish testing approaches for real-time and streaming data systems.
Conduct API testing using both manual and automated techniques.
Collaborate with Machine Learning and NLP teams to define evaluation frameworks and performance metrics.
Leverage AI-assisted development tools such as GitHub Copilot, Claude and ChatGPT to enhance testing, documentation and defect analysis processes.
Drive QA best practices across automation, data quality and AI product validation.

Required Experience

8+ years experience in QA Engineering with a strong focus on automation testing.
5+ years experience testing data platforms, data products or data-intensive systems.
Strong automation experience using JavaScript and/or Python.
Proven experience testing AI-powered applications and leveraging AI tools within QA workflows.
Strong understanding of API testing methodologies and tooling.
Excellent analytical and problem-solving skills with exceptional attention to detail.
Experience identifying subtle inconsistencies in data quality, system behaviour and AI outputs.

Desirable Experience

Experience testing conversational AI, chatbots or virtual assistants.
Familiarity with Large Language Models (LLMs) and Generative AI systems.
Experience with prompt engineering validation, grounding techniques and AI evaluation frameworks.
Knowledge of AI safety testing, including hallucination detection, bias testing and PII validation.
Experience with tools such as PyTest, Postman, dbt Tests and modern automation frameworks.
Exposure to machine learning, NLP or data science environments.

Technology & Tools

JavaScript
Python
PyTest
Postman
API Testing
dbt Tests
LLMs & Generative AI
Conversational AI Platforms
AI-Assisted Development Tools (Copilot, Claude, ChatGPT)

What's on Offer

Opportunity to work on cutting-edge AI and conversational agent technologies.
Exposure to modern LLM evaluation and AI testing frameworks.
Collaborative environment working alongside ML, NLP and Data Engineering specialists.
Significant influence over QA strategy and testing standards.
Career growth within a rapidly evolving AI-focused organisation.

If you're passionate about quality engineering, AI systems and automation-first testing practices, we'd love to hear from you.

Senior Quality Assurance Engineer