About This Role
HireArt is looking for Technology Domain Experts to help develop and evaluate AI tasks requiring engineering and systems-level reasoning. You’ll help assess model competency in real-world technical domains, debugging, architecture decisions, and system behavior analysis.
As a Technology Domain Expert, you will:
Design challenging, field-relevant problems based on visuals, prompts, datasets, or model outputs
Evaluate AI-generated responses using detailed rubrics
Write or improve evaluation rubrics for complex tasks
Stress-test model reasoning in software engineering contexts
Provide clear, structured feedback on model performance
Required Qualifications
5+ years’ relevant software engineering experience (e.g. backend, frontend, full-stack, mobile development, DevOps, distributed systems, etc.)
Experience evaluating or testing LLM outputs in technical domains
Strong writing, analysis, and reasoning skills
Comfortable working asynchronously with strong self-direction
Ability to deliver structured, precise, and logically sound evaluations
Reliable computer and internet connection
Nice to Have
Bachelor’s degree in computer science or related field