Quality Assurance Engineer

MasteryHive is seeking a highly skilled and detail-oriented QA Engineer to join our innovative team. The ideal candidate will be a seasoned professional with a minimum of 3 years of experience in software quality assurance. This role requires a deep understanding of both manual and automated testing practices within fast-paced, AI-driven product environments.

Country: Nigeria (Remote)

About MasteryHive:

At MasteryHive, we’re transforming the financial services industry with Agentic AI, our cutting-edge AI platform designed to automate core processes like claims processing, underwriting, fraud detection, compliance, and technical account reconciliation. Our mission is to empower financial institutions with the technology they need to improve efficiency, reduce costs, deliver exceptional customer experiences and drive growth. We are headquartered in the US and have presence in the UK, Canada and Nigeria.

Responsibilities:

• Design, develop, and maintain comprehensive test plans, test cases, and test scripts for web applications and AI-powered features.
• Collaborate with cross-functional teams — including software engineers, product managers, and designers — to understand requirements and define acceptance criteria.
• Build, maintain, and scale automated test suites to support continuous integration and continuous delivery (CI/CD) pipelines.
• Perform functional, regression, smoke, integration, and exploratory testing across product releases.
• Validate the behaviour and outputs of AI agents, LLM integrations, and API endpoints to ensure accuracy, reliability, and performance.
• Identify, document, and track defects through to resolution using project management and bug-tracking tools.
• Monitor and report on QA metrics to drive improvements in test coverage, release confidence, and overall product quality.
• Stay up-to-date with the latest advancements in software testing methodologies, tools, and AI quality assurance practices.

Required Skills:

• Test Automation: Proven experience with at least one automation framework such as Playwright, Cypress, or Selenium for building robust, maintainable test suites.
• API Testing: Proficiency in testing RESTful APIs using tools such as Postman or similar, with the ability to validate request/response structures and edge cases.
• Programming Languages: Working knowledge of JavaScript, TypeScript, or Python to write and maintain automated test scripts.
• CI/CD Integration: Hands-on experience integrating automated tests into CI/CD pipelines (e.g., GitHub Actions, CircleCI, or equivalent).
• AI Testing Tools: Experience with AI and LLM evaluation tools such as DeepEval, PromptFoo, LangSmith, Trulens, or Giskard for testing, evaluating, and monitoring the outputs of AI agents and language model-powered features.
• Cloud Platform: Familiarity with Google Cloud Platform (GCP) or similar cloud environments for testing cloud-deployed applications.
• Industry Knowledge: Experience in testing software built for financial institutions (Banks, FinTech, etc.) is a strong advantage.
• AI/ML Testing: Exposure to testing AI agents, LLM-powered features, or data pipelines is preferred.
• Other Technical Skills: Familiarity with tools such as Docker, BigQuery, or data processing environments for validating end-to-end workflows is an asset.

To qualify for the role you must have:

• At least a Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related technical field, with a minimum of 3 years of experience in software quality assurance or testing.

Soft Skills:

• Problem-solving: Ability to analyse complex systems and identify failure points, edge cases, and quality gaps with a structured approach.
• Collaboration: Strong teamwork and interpersonal skills to work effectively with cross-functional teams across multiple time zones.
• Communication: Excellent written and verbal communication skills to clearly convey defect details, test findings, and quality risks to both technical and non-technical audiences.
• Adaptability: Ability to quickly learn and adapt to new technologies, AI-driven features, and evolving product requirements.
• Attention to Detail: Meticulous approach to ensure high-quality, reliable, and consistent product deliverables.

The successful candidate will be a self-motivated and results-oriented individual with a strong foundation in software quality assurance and a keen interest in AI-powered products. They will be able to thrive in a fast-paced environment and contribute significantly to the reliability and excellence of the MasteryHive platform.

Type of Employment: 6–12 months initial contract with possibility of permanent employment

Requirements added by the job poster

• 3+ years of experience in Quality Assurance