App
Senior Computational AI Architect
NEWIndiaContractorGlobal
š° USD 83,200 - 83,200/yr
š Executiveš Remote
ActivePosted within the last 30 days
Job Description
[AI-summarized by JobStash]
You will serve as a strategic advisor for language, reasoning, and evaluation-focused AI programs. Working alongside program managers, AI strategists, and stakeholders, you will provide early-stage guidance on task design, quality standards, multilingual considerations, and evaluation methodologies, helping shape project requirements and quality expectations before execution begins. This is a remote, flexible engagement contributing to frontier AI work.
Requirements
- āMaster's or PhD in Computational Linguistics, NLP, Linguistics, or Cognitive Science
- ā8+ years of experience
- āExpertise across NLP, LLM evaluation, human annotation systems, localization, multilingual AI, and quality frameworks
- āStrong written English and the ability to communicate complex ideas clearly
- āComfortable working independently in a remote environment
- āBased in India
Responsibilities
- āDevelop annotation guidelines
- āCreate reviewer handbooks
- āDesign evaluator training programs
- āEstablish escalation frameworks
- āDesign evaluation rubrics
- āBuild reasoning-assessment frameworks
- āCreate multilingual quality standards
- āDefine quality acceptance criteria
- āReview project instructions
- āIdentify ambiguity risks
- āImprove linguistic consistency
- āGuide localization efforts
- āAssess evaluator agreement
- āReview pilot outputs
- āIdentify systematic quality issues
- āRecommend rubric improvements
Tech Stack
Annotation GuidelinesBenchmark Designcontent reviewData annotationEvaluation RubricsHuman Annotationinterviewer trainingLarge language modelsLinguistic ConsistencyLLM evaluationproject:Braintrust