Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP
Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP is an open role at Prolific Participants, available remotely.
Applications open on Prolific Participants’s own site. How we make money.
About this role
Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) Start date: Immediate / TBC End Date: TBC Location: Remote Type of contract: Freelance Languages required: English Hourly Rate: Include the rate you are comfortable with on your CV. The Role We are seeking a Queue Manager / Annotation Lead to join a high-priority initiative in partnership with a leading AI company. You will own day-to-day execution for one or more annotation queues, keeping work flowing, quality on target, and stakeholders unblocked - balancing throughput, SLAs, and accuracy in a live human-data pipeline. In short, the role involves owning day-to-day execution of one or more annotation queues - managing intake, prioritization, and SLAs, running QA and calibration to keep quality on target, training and supporting annotators, and tracking key metrics like throughput and rework rates. For this particular opening, we're specifically looking for candidates with a trust & safety / integrity background - someone who can tell when responses are shallow, low-effort, or phoned-in, and who can keep queues healthy on quality, not just catch bad actors. Think signal-quality analyst rather than a general queue lead. What you'll be doing Queue Operations & Task Management Manage work queue: intake, triage, prioritization, task assignment, and SLA delivery Monitor task queue and backlog control Identify and troubleshoot bottlenecks (unclear policy, tooling issues, supply gaps) Quality Assurance & Performance Management Perform QA: make corrections, provide annotator feedback, flag systematic confusion to Client Delivery Lead Monitor quality at project and individual annotator levels Drive guideline adherence, run calibration sessions, reduce rework Manage annotator performance: unassign underperformers, identify high-performers Training & Support Train new annotators on project guidelines Conduct live or recorded webinars as participants join a project Host "office hours” for participants
Pay
Not disclosed
Prolific Participants doesn’t publish a rate for this listing - it isn’t missing from our data.
About Prolific Participants
Prolific Participants's connection to Prolific: Direct participant marketplace and expert network. Research studies, behavioural data and AI evaluation/training tasks
Ownership confidence: Confirmed. See the full network profile →
Similar open roles
Frequently asked questions
How do I apply for the Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP role at Prolific Participants?
Applications go through Prolific Participants's own portal - HumanSourcer links to the listing and never collects applications or handles hiring. Prolific Participants's access model is "Waitlist" (Join waitlist / register). This listing was first seen here on July 31, 2026 and was still live at the last check.
Is the Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP role at Prolific Participants remote?
Yes - Prolific Participants lists this role as remote.
What does the Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP role at Prolific Participants pay?
Prolific Participants doesn't state a rate on this listing. HumanSourcer never fills that gap with an estimate, so the absence is the source's, not a hole in this page. Prolific Participants's profile shows what its rate-carrying listings do advertise.
What kind of work is Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP?
Data annotation / labeling. Research studies, behavioural data and AI evaluation/training tasks
Is Prolific Participants a legitimate AI-training platform?
Direct participant marketplace and expert network - and that relationship is rated "Confirmed" here because it can be checked against www.prolific.com rather than taken on Prolific Participants's word. Confidence describes how well the ownership is evidenced. It is not a rating of how the platform treats the people who work for it, which no public source covers reliably.
Get new AI-training roles by email
One weekly digest of newly listed roles across every tracked network - pay where it's disclosed, no spam, unsubscribe anytime.
Free. See how we make money.