TalentVaults

Back to All Jobs

Software Engineer (Code QA)

Vetting Score

96%

Hourly Rate

$80-120/hour

Location

Remote

Strategic Opportunity

This role presents a distinctive chance to leverage your software engineering background to influence the advancement of cutting-edge AI systems. As a key contributor, you will collaborate with top-tier AI research institutions to develop evaluation datasets that scrutinize AI capabilities in reasoning, explanation, and technical assessment within coding contexts. Your work will directly impact the evolution of intelligent systems, making this an exceptional opportunity for those passionate about AI and software development.

Core Responsibilities

  • Design authentic developer prompts spanning various categories such as code review, debugging, error diagnosis, and configuration
  • Gather and modify content from actual pull requests to generate genuine scenarios
  • Produce precise, technically sound model responses that exhibit robust reasoning and explanation quality
  • Ensure all prompts are chat-pasteable and include essential context like code snippets, error messages, logs, or requirements
  • Contribute to the creation of datasets that evaluate natural-language reasoning and explanation quality in coding interactions

Required Expertise

  • A minimum of two years of experience in software engineering, technical research, or educational content development
  • A degree in Software Engineering, Computer Science, or a related field (Bachelor’s degree is the minimum requirement, with advanced degrees being preferred)
  • Expertise in programming languages such as Python, JavaScript, Java, or C++
  • Proven experience in debugging, testing, and validating code
  • Strong technical writing skills and meticulous attention to detail

Project & Compensation

  • The project involves developing a code question and answer dataset to assess AI capabilities in reasoning, explanation, and technical judgment
  • Tasks are structured as chat-pasteable prompts that reflect realistic developer questions and include all necessary context inline
  • The role is an hourly contract with a pay rate ranging from $80 to $120 per hour
  • Payments are made weekly through Stripe or Wise based on services rendered

Application Process

To apply, please upload your resume. The application process includes a brief, 15-minute AI interview to discuss your background, experience, and interest in the role. Following the interview, you will receive follow-up communication within a few days with next steps and onboarding details. This is a fully remote role that can be completed on your own schedule, with a project timeline of 1-2 months and a part-time commitment of 15–25 hours per week, with flexibility up to 40 hours per week. We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Are you interested?

Apply Now

AFFILIATE NOTICE: This button takes you to the Mercor website, which uses cookies for tracking to attribute referrals. TalentVaults earns a commission if you sign up and get hired for the job. For more information, see our privacy policy. AFFILIATE-HINWEIS: Diese Schaltfläche führt Sie zur Webseite von Mercor, wo Cookies für Tracking zur Zuordnung von Empfehlungen verwendet werden. TalentVaults erhält eine Provision, erst wenn Sie sich anmelden und diesen Job erhalten. Weitere Informationen finden Sie in unserer Datenschutzerklärung.