Reimagining real estate to make it easier than ever to move from one home to the next.

AI Applied Scientist – PhD Intern, Evaluation Systems and Metrics

Research ScientistResearch ScientistInternshipRemoteEntry LevelTeam 5,001-10,000Since 2006H1B SponsorCompany Site LinkedIn

Location

California + 6 more

Posted

167 days ago

Salary

$104K - $166K / year

Seniority

Entry Level

Postgraduate DegreeEnglishPyTorch

Job Description

• develop cutting-edge evaluation methodologies for AI systems • focus on creating robust, scalable metrics and frameworks to assess quality, consistency, and performance of generative models across multiple modalities • contribute in the following areas: • Develop innovative assessment methodologies for emerging AI capabilities, focusing on consistency and quality across complex multi-modal outputs • Design evaluation systems that learn and adapt from feedback • Design frameworks that incorporate domain-specific implementations of differential privacy • Develop scalable methodologies for assessing agentic systems

Job Requirements

Currently enrolled as a PhD student in computer science, machine learning, computer vision, or a related field, with strong publication record
Candidates should have a background in one or more of the following areas:
Evaluation methodologies for AI/ML systems
Computer vision metrics and 3D consistency assessment
Generative model evaluation (text, image, video, 3D)
Multi-modal assessment and automated feedback systems
Knowledge of data privacy methods (e.g., differential privacy, federated learning, secure ML) and their application
Single agent or multi-agent system evaluations
Familiarity with modern deep learning frameworks (e.g., PyTorch, Hugging Face Transformers)
Strong research mindset, with motivation to publish
Interest in applying AI to complex, multi-stakeholder domains
A record of publication in conferences, workshops, or journals is a plus