Description and Requirements
Job Title: Gen AI Engineer
Location: Toronto, ON
Work Style: Hybrid (3 days per week – Tuesday, Wednesday, Thursday)
Job Type: 6-month contract
Pay Rate: $53-$58 per hour
Job Overview
Our top consultancy client is seeking a Gen AI Engineer to support the design, development, and deployment of Generative AI solutions. The role involves working closely with product owners, business stakeholders, and design teams to build LLM-based solutions aligned with approved RAG patterns while contributing to scalable GenAI applications and knowledge bots.
Role Responsibilities
• Understand GenAI use case requirements while working with product owners and business teams to design LLM solutions aligned with approved RAG patterns.
• Drive data requirement discussions and collaborate with the data office to obtain necessary data for use cases.
• Design efficient chunking and indexing strategies to support accurate answer generation.
• Develop and deploy inference APIs using frameworks such as LangChain and deploy them to AKS or function apps.
• Support front-end integration by collaborating with the UI team and contributing to UI development as needed.
• Support GenAI knowledge bots in production by monitoring user feedback and improving response quality through enhancements.
• Follow best practices and processes related to MLOps and coding standards.
• Optimize model accuracy through efficient prompt refinement techniques.
• Collaborate with team members and contribute to a reusable GenAI code base.
Essential Skills
• Minimum of 5 years of experience solving high-impact business problems using machine learning and the latest advancements in LLMs.
• Proven experience as a Machine Learning Engineer with a strong focus on generative AI, prompt engineering, and RAG applications.
• Hands-on experience using Azure AI Search, LangChain, and other vector stores. Experience with Azure OpenAI and open-source LLMs is a plus.
• Strong software development skills with proficiency in Python and PySpark, preferably using Databricks or Azure ML. Basic knowledge of React or similar UI frameworks is a plus.
• Strong experience supporting production applications post-development and continuously improving response quality.
• Strong collaboration skills with the ability to translate complex requirements into a technical backlog.
• Strong presentation and communication skills with the ability to balance urgency with delivering high-quality and pragmatic solutions.
• Experience productionizing code through DevOps pipelines such as Git, Jenkins pipelines, and code scanning tools.