Job Description

Job Summary:1. The AI QA Specialist is responsible for ensuring the quality, reliability, and performance of generative AI products.
2. The role involves designing and implementing QA processes, conducting comprehensive testing, validating models, and collaborating with various teams.
3. Tasks include developing QA strategies, executing detailed test plans, conducting model testing and validation, implementing A/B testing, and assessing model performance.
4. The AI QA Specialist will also perform stress testing, validate models against adversarial attacks, define and monitor key quality metrics, and work closely with AI researchers, data scientists, software engineers, and product managers.
5. Other responsibilities include conducting full-stack testing, validating data pipelines and workflows, identifying and resolving quality issues, staying updated with generative AI advancements, and ensuring adherence to relevant regulatory requirements and industry standards.
6. Qualifications include proficiency in QA tools and frameworks, experience with full-stack development and data engineering tools, knowledge of machine learning libraries, and experience with model testing and validation methodologies.
7. The role requires exceptional attention to detail, strong problem-solving skills, excellent communication skills, and preferably experience with automated testing frameworks, regulatory requirements, and large-scale generative AI systems.
8. Candidates should have around 5-7 years of experience in AI.

MP DOMINIC AND CO