Skip to content
HumanSourcer
Prolific Participants

Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP

Data annotation / labelingProlific ParticipantsSafetyRemote

Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP is an open role at Prolific Participants, available remotely.

Apply at Prolific Participants →

Applications open on Prolific Participants’s own site. How we make money.

About this role

Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) Start date: Immediate / TBC End Date: TBC Location: Remote Type of contract: Freelance Languages required: English Hourly Rate: Include the rate you are comfortable with on your CV. The Role We are seeking a Queue Manager / Annotation Lead to join a high-priority initiative in partnership with a leading AI company. You will own day-to-day execution for one or more annotation queues, keeping work flowing, quality on target, and stakeholders unblocked - balancing throughput, SLAs, and accuracy in a live human-data pipeline. In short, the role involves owning day-to-day execution of one or more annotation queues - managing intake, prioritization, and SLAs, running QA and calibration to keep quality on target, training and supporting annotators, and tracking key metrics like throughput and rework rates. For this particular opening, we're specifically looking for candidates with a trust & safety / integrity background - someone who can tell when responses are shallow, low-effort, or phoned-in, and who can keep queues healthy on quality, not just catch bad actors. Think signal-quality analyst rather than a general queue lead. What you'll be doing Queue Operations & Task Management Manage work queue: intake, triage, prioritization, task assignment, and SLA delivery Monitor task queue and backlog control Identify and troubleshoot bottlenecks (unclear policy, tooling issues, supply gaps) Quality Assurance & Performance Management Perform QA: make corrections, provide annotator feedback, flag systematic confusion to Client Delivery Lead Monitor quality at project and individual annotator levels Drive guideline adherence, run calibration sessions, reduce rework Manage annotator performance: unassign underperformers, identify high-performers Training & Support Train new annotators on project guidelines Conduct live or recorded webinars as participants join a project Host "office hours” for participants

Pay

Not disclosed

Prolific Participants doesn’t publish a rate for this listing — it isn’t missing from our data.

About Prolific Participants

Prolific Participants's connection to Prolific: Direct participant marketplace and expert network. Research studies, behavioural data and AI evaluation/training tasks

Ownership confidence: Confirmed. See the full network profile →

Similar open roles

Frequently asked questions

How do I apply for the Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP role at Prolific Participants?

Apply directly through Prolific Participants's own application process — HumanSourcer links out to the listing and doesn't handle applications or hiring directly.

Is the Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP role at Prolific Participants remote?

Yes — Prolific Participants lists this role as remote.

What does the Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP role at Prolific Participants pay?

Pay isn't publicly disclosed for this role by Prolific Participants — check the source listing for current compensation details.

What kind of work is Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) - DP?

Data annotation / labeling. Research studies, behavioural data and AI evaluation/training tasks

Is Prolific Participants a legitimate AI-training platform?

Prolific Participants's connection to Prolific: Direct participant marketplace and expert network. Ownership confidence: Confirmed — verified via www.prolific.com.

Get new AI-training roles by email

One weekly digest of newly listed roles across every tracked network — pay where it's disclosed, no spam, unsubscribe anytime.

Free. See how we make money.

Apply at Prolific Participants →