This position is posted by Jobgether on behalf of a partner company. We are currently looking for a AI Platform Engineer, Applied AI in Canada.
This role sits at the intersection of cutting-edge AI and scalable production systems, focusing on building the infrastructure that powers high-performing, reliable AI applications. You will play a foundational role in shaping how AI systems are evaluated, monitored, and continuously improved in real-world environments. Working in a highly autonomous and distributed team, you’ll contribute to developing intelligent features such as AI agents and copilots while ensuring their quality, speed, and accuracy at scale. The position offers a unique opportunity to influence a growing AI platform from the ground up, combining experimentation with robust engineering practices. If you thrive in fast-paced, async environments and enjoy turning data into actionable insights, this role offers both ownership and impact.
Accountabilities:
- Design and build evaluation frameworks to measure AI system performance, including both offline development metrics and real-time production monitoring
- Develop observability tools and dashboards to track system quality, latency, and accuracy over time
- Investigate and diagnose performance issues across AI pipelines, identifying root causes such as retrieval, ranking, or prompt design flaws
- Experiment with different models, architectures, and agent configurations to optimize system outcomes
- Prototype and implement improvements to retrieval-augmented generation (RAG) pipelines, including chunking, retrieval, and re-ranking strategies
- Analyze user interactions with AI features to uncover opportunities for enhancement and innovation
- Collaborate closely with engineering teams to validate improvements and ensure system reliability
- Stay up to date with emerging AI tools, frameworks, and best practices to continuously evolve platform capabilities
Requirements:
- 6+ years of experience in software engineering, data science, or machine learning, with exposure to domains such as NLP, search, or recommendation systems
- Proven experience building and evaluating production-grade AI systems, including LLM-based applications and RAG pipelines
- Strong proficiency in Python for experimentation, prototyping, and data analysis
- Solid understanding of AI system architecture, including embeddings, retrieval mechanisms, and context management
- Experience designing evaluation pipelines, A/B testing frameworks, and performance measurement systems
- Ability to build internal tools and infrastructure such as dashboards and data processing pipelines
- Willingness to work with and learn additional technologies (e.g., Ruby on Rails) for system integration
- Strong analytical mindset with the ability to interpret complex data and communicate insights clearly
- Comfortable working in fast-paced, ambiguous environments with high autonomy and accountability
- Excellent collaboration and communication skills in a distributed, async team
- Full professional fluency in English
Benefits:
- Competitive salary package ranging from $130,000 to $140,000 USD annually, with regular compensation reviews
- Equity participation and performance-based bonus opportunities
- Fully remote work environment with flexibility to work from anywhere
- Generous paid time off (35 days annually) plus sabbatical opportunities after long-term tenure
- Comprehensive healthcare coverage for employees and their families (or equivalent reimbursement options)
- Parental leave to support growing families
- Home office setup allowance
- Learning and development stipend for continuous skill growth
- Biannual company retreats in international locations
- High-trust, outcome-driven culture with strong emphasis on autonomy and impact