Government & Public Sector AI Training Specialist — Task Creation & Model Evaluation

About this role

About Rise Data Labs Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including public administration, policy, and government compliance. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data. Job Overview As a Government & Public Sector AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for public sector and government work. This role goes beyond traditional annotation and labeling — you'll author realistic, economically valuable government/policy tasks and rubrics based on real professional work, then grade AI-generated deliverables against them. What You'll Do Create realistic work scenarios based on your own professional experience — e.g., policy briefs, regulatory compliance reviews, public program reports, grant or budget documentation Supply the kinds of reference materials you'd normally work from (redacted reports, policy documents, program data) Write detailed rubrics specifying exactly what a correct, professional deliverable requires — accurate analysis, proper regulatory language, correct formatting Grade AI-generated deliverables (often policy documents or reports) against your rubric Join calibration sessions with other experts to ensure consistent scoring across the benchmark Preferred Qualifications Prior hands-on experience in public administration, policy analysis, regulatory affairs, or government program management Comfort reviewing detailed formal/regulatory documents Prior experience with AI model training, evaluation, or benchm