Data Quality Contractor (AI Output Validation)
About the role
CrossVault builds AI tools that help Australian employers interpret Modern Awards and validate payroll against complex rules. Our answers have to be right — when we miss, customers underpay or overpay real people.
We're looking for a careful, detail-oriented contractor to review AI-generated outputs against reference material and grade them for accuracy, clarity, and reasoning quality. Your work directly feeds into how we evaluate and improve our models.
What you'll do
- Read AI-generated answers to questions about Modern Award rules and compare them against source material.
- Grade outputs on a simple rubric: factual accuracy, completeness, reasoning quality, and tone.
- Flag edge cases, hallucinations, and subtle reasoning errors — and leave short notes explaining why.
- Occasionally help us refine the rubric itself as we discover new failure modes.
Who we're looking for
You don't need a compliance or legal background — we'll give you the reference material. What matters is how you think.
- You can read something carefully and notice when an argument doesn't quite follow.
- You enjoy picking apart language — a philosophy, law, linguistics, or research background is a natural fit.
- You write clearly and concisely in English.
- You're comfortable working independently and asking questions when something's ambiguous.
Logistics
- Engagement: Contract, paid hourly.
- Time commitment: A few hours a week, flexible around your schedule.
- Location: Fully remote.
- Tools: A laptop and a careful eye. We'll supply the rest.
How to apply
Email us at team@crossvault.com.au with a short note about yourself and why this role caught your eye. A CV is welcome but not required.
If you'd rather use the contact form, that works too.