Senior Software Engineer, AI

Job Description

Toast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto. They are looking for an experienced backend engineer who is excited to build and optimize LLM-powered systems that help users uncover meaningful business insights.

Responsibilities

• Design, build, and maintain backend systems that power LLM-driven and agentic workflows


• Develop retrieval pipelines, orchestration layers, and multi‑step agent architectures that support scalable AI‑powered search experiences


• Lead the evaluation of agentic systems using automated, offline, and human‑in‑the‑loop frameworks to measure relevance, quality, latency, and task success


• Improve retrieval and ranking systems across hybrid retrieval, re‑ranking, query rewriting, and post‑retrieval synthesis


• Optimize LLM‑powered workflows for speed, accuracy, reliability, and production readiness


• Own technical projects from concept through launch, including experimentation strategy, architecture decisions, and operational excellence


• Collaborate closely with product, infrastructure, and data teams to align technical solutions with user needs and business goals


• Stay current with advances in LLMs, retrieval systems, and agentic reasoning, and apply relevant developments to product and engineering work


• Contribute to engineering best practices that support maintainability, observability, testing, and continuous delivery

Requirements

• 5+ years of experience building and operating backend systems in production


• Strong experience in at least one of the following areas: search and retrieval, data pipelines, distributed systems, or API‑driven service architectures


• 2+ years of hands‑on experience working with search, retrieval, or ranking systems


• Experience building or evaluating LLM‑powered or agentic systems, including retrieval‑augmented generation or multi‑step workflows


• Strong software engineering fundamentals with the ability to write clean, maintainable, and well‑tested code


• Proficiency in Python and experience with backend frameworks, APIs, and production infrastructure


• Familiarity with vector databases and search platforms such as FAISS, PGVector, Pinecone, Weaviate, Elasticsearch, or OpenSearch


• Experience with cloud platforms such as AWS, GCP, or Azure in environments with scale, low‑latency requirements, and high availability


• Experience using AI coding tools to improve development workflows


• A customer‑focused mindset with the ability to connect technical decisions to user outcomes


• Demonstrated ability to lead projects, make sound architectural decisions, and support the growth of others on the team

Benefits

• Competitive compensation with a salary range of CA$145,000–CA$183,000, plus equity


• Extended health and dental coverage starting from day one


• Employee Stock Option Plan for full‑time employees


• Flexible vacation policy designed to support rest and balance


• Career development support through coaching, feedback, and performance reviews


• Access to high‑quality equipment and tooling


• Hybrid work model with in‑office collaboration in Toronto on designated days


• Opportunities to work closely with leadership and contribute to meaningful technical direction


• A workplace that values belonging, authenticity, accessibility, and professional growth


• An inclusive hiring approach that considers potential, transferable experience, and equivalent backgrounds