Generative AI Engineer Job Description Template

The generative AI engineer builds products that create text, images, audio or code. The engineering problems are distinctive: outputs are non deterministic, quality is hard to measure automatically, inference is expensive and the failure modes include producing something confident and wrong. The role requires both model fluency and careful product engineering around it.

Typical Duties and Responsibilities

• Build generative features across text, image, audio or code modalities
• Design prompting, conditioning and control mechanisms
• Build evaluation covering quality, safety and consistency
• Optimize inference cost and latency for generative workloads
• Implement safety filtering and content moderation
• Fine tune or adapt models where required
• Design user experiences that account for non deterministic output
• Monitor output quality and cost in production
• Investigate and mitigate failure modes including hallucination
• Track model developments and reassess technical choices

Education

• Bachelor’s or Master’s degree in computer science or a related field

Required Skills and Experience

• 2+ years building production generative AI systems
• Strong Python and machine learning engineering skills
• Experience with prompting, fine tuning or model adaptation
• Ability to design evaluation for subjective quality
• Understanding of inference cost drivers and optimization
• Experience implementing safety and moderation controls
• Awareness of intellectual property and content risk
• Good product judgment about non deterministic features

Preferred Qualifications

• Experience with diffusion models or multimodal systems
• Exposure to model serving optimization