Jr. Designer / Jr. Art Director - Quality & Judgement
Jr. Designer / Jr. Art Director - Quality & Judgement is an open role at TasteMakers.
Applications open on TasteMakers’s own site. How we make money.
About this role
We are building a team of designers to audit AI-generated questions about design work. The project works as a multiple choice QA of design observations. Raters will see an asset and a set of multiple choice questions and audit each one for quality. Your job is to decide whether the question is any good: whether it is clearly written, whether the answer marked correct is actually accurate, and whether it tests something a working designer would know rather than something anyone could guess. This is judgment work, not production design work. What matters is the accuracy of your eye and the consistency of your calls across a high volume of questions. What you'll do: Answer questions about the asset based on what you see is accurate. Compare your answer answer against the original expert critique that the question was generated from, and judge whether they actually agree. Run a set of checks on each question: is it clearly written, does it have one defensible answer, is the key right, does it match the source critique, and are the images intact. Flag broken, incomplete, or misleading renders, judged against the images rather than the critique text. Required skills: A portfolio showing craft-level attention to layout, spacing, hierarchy, and typography The ability to look at a design and articulate precisely what is wrong with it in plain language, without reaching for jargon Sound judgment about what separates an objective error from a matter of taste. A different font choice is a preference. A chart line running through a label is an error. You will be making this distinction constantly, on someone else's behalf Willingness to disagree with the answer key. The role only works if you trust your own read over what the system asserts Consistency. Two similar questions should get the same call from you on Monday and on Friday Fluent written English, and the ability to write a short, clear reason for each flag A reliable computer running Chrome, and around 10-12 hours a wee
Pay
Not disclosed
TasteMakers doesn’t publish a rate for this listing - it isn’t missing from our data.
About TasteMakers
TasteMakers's connection to Taste Labs: Direct AI-training/design-evaluation gig portal. Design/taste evaluation gig work (judging and critiquing website, web-app, and game designs) for AI training
Ownership confidence: Confirmed. See the full network profile →
Similar open roles
Frequently asked questions
How do I apply for the Jr. Designer / Jr. Art Director - Quality & Judgement role at TasteMakers?
Applications go through TasteMakers's own portal - HumanSourcer links to the listing and never collects applications or handles hiring. TasteMakers's access model is "Open / self-serve" (Open application). This listing was first seen here on August 21, 2026 and was still live at the last check.
Is the Jr. Designer / Jr. Art Director - Quality & Judgement role at TasteMakers remote?
TasteMakers left the location field empty on this listing, so there is nothing to report rather than something we've withheld. The constraint that still applies is TasteMakers's overall coverage: Remote.
What does the Jr. Designer / Jr. Art Director - Quality & Judgement role at TasteMakers pay?
TasteMakers doesn't state a rate on this listing. HumanSourcer never fills that gap with an estimate, so the absence is the source's, not a hole in this page. TasteMakers's profile shows what its rate-carrying listings do advertise.
What kind of work is Jr. Designer / Jr. Art Director - Quality & Judgement?
Uncategorized. Design/taste evaluation gig work (judging and critiquing website, web-app, and game designs) for AI training
Is TasteMakers a legitimate AI-training platform?
Direct AI-training/design-evaluation gig portal - and that relationship is rated "Confirmed" here because it can be checked against portal.tastelabs.com rather than taken on TasteMakers's word. Confidence describes how well the ownership is evidenced. It is not a rating of how the platform treats the people who work for it, which no public source covers reliably.
Get new AI-training roles by email
One weekly digest of newly listed roles across every tracked network - pay where it's disclosed, no spam, unsubscribe anytime.
Free. See how we make money.