Role Description

We are looking for a Middle Prompt Engineer to join Cupid Media and take ownership of improving the quality of our AI moderation systems. In this role, you will work with high-scale user-generated content (100K+ photos and millions of messages daily) and continuously optimize LLM prompts used for automated moderation of photos, profiles, and conversations.

• Design and optimize prompts for LLMs used in moderation of user-generated content (UGC)
• Test and evaluate prompts across diverse scenarios to improve accuracy and reliability
• Analyze model outputs to identify hallucinations, errors, and moderation gaps
• Develop evaluation metrics and benchmarking pipelines (precision, false positives, false negatives)
• Create and maintain labeled datasets for evaluating moderation quality
• Run experiments with different LLMs to improve moderation performance
• Collaborate with engineering and moderation teams to improve AI moderation systems

Qualifications

• 2+ years of experience working with LLM systems or applied AI
• Experience with prompt engineering in production environments
• Strong understanding of prompting techniques (zero-shot, few-shot, chain-of-thought, role prompting)
• Experience evaluating LLM outputs and analyzing errors (false positives / false negatives)
• Experience working with labeled datasets and evaluation workflows
• Basic programming skills (Python, JavaScript, or TypeScript)
• Familiarity with Git
• Analytical mindset and strong problem-solving skills
• Ability to work independently and take ownership of results

Benefits

• REMOTE OPPORTUNITY to work full time
• Vacation: 28 calendar days per year
• 7 wellness days per year (time off) that can be used to deal with household issues, to lie down and recover without taking sick leave
• Bonuses up to $5000 for recommending successful applicants for positions in the company
• 50% payment for professional training, international conferences, and meetings
• Corporate discount for English lessons
• Health benefits: Up to $1,000 gross per year for health insurance or doctor's fees for yourself and close relatives (spouse, children)
• Workplace organization: Equipped workplace and necessary equipment provided in offices or co-working locations; reimbursement of workplace costs up to $1000 gross once every 3 years
• Internal gamified gratitude system: Receive bonuses from colleagues and exchange them for merchandise, team building activities, massage certificates, etc.