QA Engineer — AI Quality Evaluation (Remote)

$90–$175/hour | Remote | Contract (30 Openings)

--------------------------------

Overview:

SourceBridge Co. is seeking experienced QA Engineers to contribute to a high-volume software quality and AI evaluation project.

 

In this role, you will combine your professional software testing expertise with experience evaluating human-generated or AI-generated content. Your work will help assess the quality, accuracy, completeness, and reliability of technical outputs used to improve next-generation AI systems.

 

AI experience is not required. However, prior paid experience with human data annotation, RLHF, AI/model output evaluation, or rubric-based grading is a firm project requirement.

 

Software QA experience alone, without a human-in-the-loop AI evaluation component, does not meet the project requirements.

 

Key Responsibilities:

• Evaluate and rate AI-generated technical outputs against defined quality criteria and evaluation rubrics.
• Identify responses that may appear correct but contain inaccuracies, omissions, inconsistencies, or incomplete reasoning.
• Design and assess comprehensive test cases covering functional, regression, edge-case, negative, and boundary scenarios.
• Review bug reports and test documentation for reproducibility, completeness, and appropriate severity classification.
• Identify, isolate, and document software defects with precise reproduction steps.
• Use structured bug-tracking and test-management processes to maintain high-quality documentation.
• Provide detailed, actionable written feedback and annotations that developers can use without additional clarification.
• Collaborate with project teams to improve evaluation guidelines, testing standards, and QA methodologies.
• Apply strong analytical judgment when evaluating both software behavior and technical outputs.

 

 

Required Skills:

• Quality assurance
• Software testing
• Test case design
• Automation testing
• Regression testing
• Bug tracking
• Test management
• Selenium or similar automation frameworks
• Manual and automated testing
• Bug reporting
• Quality evaluation
• Human data / AI evaluation experience

 

Preferred Qualifications:

• Professional experience as a QA Engineer, SDET, Test Engineer, QA Analyst, or similar role.
• Strong understanding of QA fundamentals and software testing methodologies.
• Experience designing functional, regression, negative, boundary, and edge-case tests.
• Experience with automation and testing tools such as Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, BrowserStack, or similar platforms.
• Prior paid human-data experience supporting AI training, including annotation, labeling, RLHF, AI response evaluation, model evaluation, or rubric-based grading.
• Excellent analytical and problem-solving skills.
• Exceptional attention to detail.
• Strong written English communication skills (B2 level or above).
• No formal degree required; practical and demonstrable experience is valued.
• Reliable internet connection and ability to begin promptly.

 

Important Project Requirement:

Candidates must have both:

1. Professional software QA/testing experience; and
2. Prior paid human-in-the-loop AI or human-data evaluation experience, such as annotation, RLHF, AI response evaluation, model evaluation, or rubric-based grading.

 

Candidates with software QA experience only, but no qualifying paid human-data/AI evaluation experience, will not meet this project's requirements.

 

Why Join SourceBridge Co?

• Work remotely from anywhere.
• Competitive compensation of $90–$175/hour.
• Apply your existing QA expertise to emerging AI technologies.
• Flexible contractor opportunity.
• No formal degree requirement.
• Contribute to projects focused on improving the quality and reliability of next-generation AI systems.

 

Application Process:

Qualified candidates can apply through the SourceBridge Co. job page. Candidates may be asked to provide information demonstrating both their professional QA background and previous paid human-data or AI evaluation experience.

 

Or contact me: amjad@sourcebridgeco.com
WhatsApp: 0092-311-4939154

 

Apply Now: