Audio Caption Evaluation Project

Independent Contractor

Role Overview

Do you hear tone, timing, and context, and notice right away when a caption misses a word or sounds unnatural in your language?

Agents Only Technologies Inc. is building a global community of language specialists for an Audio Caption Evaluation project. Members evaluate audio captions in their native language and deliver accurate, structured results that help improve how AI understands and describes audio.
‍

Target Language

  • French (FR)
  • Italian (IT)
  • Russian (RU)
  • Dutch (NL)
  • Polish (PL)
  • Turkish (TR)
  • Swedish (SV)
    ‍

Key Responsibilities

As an Audio Caption Evaluation Specialist, you will:

  • Evaluate audio captions for accuracy, completeness, and language quality.
  • Check that captions match what is actually in the audio.
  • Identify missing, incorrect, or unnatural content in the target language.
  • Follow detailed project specifications and annotation guidelines.
  • Produce clear, structured evaluations.
  • Complete cases consistently while meeting quality standards.
    ‍

What You Bring

  • Native speaker of one of the target languages.
  • Previous data annotation experience, including T2 Generalist projects.
  • Experience with large language model (LLM) projects.
  • The ability to understand complex instructions and produce structured text.
  • Availability of at least 4 hours a day, Monday to Friday.
  • Availability to start within the next four weeks.
  • Preferred: based in your target language market.
    ‍

How You'll Be Paid

  • You'll be paid per approved case.
  • A case must pass QA/client review to be eligible for payment.
  • The case rate is based on the agreed average handling time (AHT) and target productivity set with the client.
  • The final case rate is subject to client confirmation.
    ‍

Work Arrangement

  • Location: Remote
  • Work Type: Independent Contractor
  • Scope: Global, with a preference for specialists based in their target language market
  • Availability: At least 4 hours a day, Monday to Friday
  • Duration: Project-based
  • Start: Within the next four weeks
    ‍

How to Join

Ready to put your native language expertise to work?

Complete the application and indicate your target language and your annotation and LLM project experience.

Complete the application form
‍

We'll reach out to specialists selected for the project.

‍