QA Engineer - AI Systems (Senior Consultant) - AI Hub - Amman
EY
من LinkedIn الأردن
هذه الوظيفة منشورة على LinkedIn الأردن،
ومجمّعة هنا لتسهيل البحث. التقديم يتم مباشرة على موقع الناشر.
تفاصيل الوظيفة
Within Assurance, we assist our clients to address the accounting and financial reporting challenges facing their business. You will be part of a team that provides insight and services that accelerate analytics, decision-making and innovation to build a stronger and more efficient finance function. You will experience ongoing professional development through diverse experiences, world-class learning and individually tailored coaching.
That is how we develop outstanding leaders who team to deliver on our promises to all of our stakeholders, and in so doing, play a critical role in building a better working world for our people, for our clients and for our communities.
Sound interesting? Well this is just the beginning. Because whenever you join, however long you stay, the exceptional EY experience lasts a lifetime.
The opportunity
As a Senior QA Engineer - AI Systems in the AI Hub, you will test, evaluate, and improve AI products before they reach clients and production. You will validate end-to-end AI solutions (LLMs, agents, RAG, OCR/document intelligence, traditional ML, prompts/tools, and data pipelines) and the human workflows around them.
Your Key Responsibilities
You will partner with AI engineers, full stack/data/DevOps teams, product and security to define quality and risk, build evaluation approaches, surface failure modes, and ensure solutions are reliable, safe, explainable, and enterprise-ready.
Skills And Attributes For Success
• Define and execute AI QA strategies for PoCs, MVPs, and production (models, prompts, retrieval, agents/tools, data flows, user workflows, ops)
• Translate business needs into measurable quality criteria, evaluation metrics, acceptance tests, and release gates
• Build and maintain eval assets: golden answers, synthetic/edge-case libraries, and regression suites for LLM/RAG/OCR/agentic/ML systems
• LLM/GenAI testing: response quality, grounding, safety/refusals, bias, privacy leakage, and prompt adherence
• RAG
That is how we develop outstanding leaders who team to deliver on our promises to all of our stakeholders, and in so doing, play a critical role in building a better working world for our people, for our clients and for our communities.
Sound interesting? Well this is just the beginning. Because whenever you join, however long you stay, the exceptional EY experience lasts a lifetime.
The opportunity
As a Senior QA Engineer - AI Systems in the AI Hub, you will test, evaluate, and improve AI products before they reach clients and production. You will validate end-to-end AI solutions (LLMs, agents, RAG, OCR/document intelligence, traditional ML, prompts/tools, and data pipelines) and the human workflows around them.
Your Key Responsibilities
You will partner with AI engineers, full stack/data/DevOps teams, product and security to define quality and risk, build evaluation approaches, surface failure modes, and ensure solutions are reliable, safe, explainable, and enterprise-ready.
Skills And Attributes For Success
• Define and execute AI QA strategies for PoCs, MVPs, and production (models, prompts, retrieval, agents/tools, data flows, user workflows, ops)
• Translate business needs into measurable quality criteria, evaluation metrics, acceptance tests, and release gates
• Build and maintain eval assets: golden answers, synthetic/edge-case libraries, and regression suites for LLM/RAG/OCR/agentic/ML systems
• LLM/GenAI testing: response quality, grounding, safety/refusals, bias, privacy leakage, and prompt adherence
• RAG
