Biology PhD Reasoning Benchmark

About this role

We are developing a groundbreaking benchmark to rigorously evaluate the ability of AI systems to reason about complex biological systems and phenomena. This initiative sits at the frontier of AI evaluation, with the goal of shaping how next-generation models are trained and assessed in life sciences. Role Overview As a Biology PhD contractor, you will work closely with our team to design, draft, and review high-quality biology problem sets—questions that demand multi-step reasoning, conceptual integration, and real scientific insight. Your contributions will directly shape how leading AI models are measured and fine-tuned in biology-related domains. What You'll Do - Create and validate complex, research-level biology questions and answer keys. - Collaborate with other experts to review, refine, and standardize questions. - Identify conceptual traps, multi-step reasoning challenges, and edge cases that test true understanding. - Optionally, contribute ideas for experimental protocols or test data. What We're Looking For - PhD (or ABD) in Molecular Biology, Genetics, Biochemistry, Immunology, Cell Biology, Bioinformatics, or a related field. - Strong reasoning skills and ability to translate scientific insight into well-posed problems. - Excellent written communication—able to write clear, structured, and challenging questions and explanations. - Familiarity with biology curricula (undergrad or graduate) and scientific publishing is a plus. - Bonus: Experience designing educational material, exams, or interview questions. Compensation & Terms - Hourly contract role, with flexible hours and collaborative async workflows. - Pay is competitive and commensurate with experience and scope of work. - Remote — open to contractors globally.