VBT Task Author

Requisitos

• Core Experience: 1+ years in investigative research, fact-checking, AI benchmark task authoring, red-teaming, or technical QA review
• Benchmark Familiarity: Proven experience authoring, testing, or reviewing tasks for AI benchmarks such as GAIA, BrowseComp, SimpleQA, SWE-bench, Terminal-Bench, or Humanity’s Last Exam (HLE)
• Analytical & OSINT Skills: Intermediate-to-advanced web search and Open Source Intelligence (OSINT) skills
• ability to navigate academic archives, local records, or obscure databases
• Model Trajectory Debugging: Strong analytical capability to inspect model reasoning chains, search logs, and source selection to diagnose root causes of failure
• Precision Writing: Ability to author clear, unambiguous benchmark prompts with bulletproof, primary-sourced answer keys

Desejáveis

• Bachelor or higher degree from relevant engineering domain is a must for this position
• Prior experience specifically designing prompt-injection or reasoning-trap tasks that break SOTA models
• Advanced OSINT capabilities or published investigative/academic research demonstrating deep source verification
• Niche domain expertise in areas rich with hard-to-find records (e.g., local government filings, regional sports history, legal archives, historical patents)
• Experience serving as a lead reviewer, benchmark auditor, or quality owner on AI evaluation projects