LLM & AI Platform Engineer

We are looking for AI Platform Engineers to build and maintain core LLM-powered services and APIs to power the next generation of online learning tools. On this team, you'll design and implement services and infrastructure that will allow our feature teams to rapidly develop and deploy LLM-powered features that improve the teaching and learning experience of tens of millions of people around the world while maintaining our high standards for performance, security, and reliability.

What You'll Do

Design and implement APIs and domain services that abstract the complexity of using an LLM and enable rapid feature development from our product teams;

Build scalable AWS infrastructure for LLM interactions, including prompt management, context handling, auditing, and response processing;

Create developer tooling and documentation that makes integration with your services intuitive and easy;

Establish best practices for AI and LLM use at Instructure, considering things like auditability, cost, and performance;

Collaborate with feature teams to understand their needs and solve them with platform capabilities;

Design, develop, and maintain scalable and performant APIs;

Write clean, maintainable, and well-documented code;

Participate in code reviews and provide and receive constructive feedback

Requirements

What You'll Need

• Prior software engineering experience with API design and distributed system development;
• Strong experience building backend services and REST or GraphQL APIs;
• Knowledge of API design best practices around security, performance monitoring, rate limiting, and more;
• Understanding of LLM integration and usage patterns;
• Strong collaboration and written and verbal communication skills;
• Past experience with cloud infrastructure, preferably on AWS;
• Experience with Node.js or a desire to learn;
• Experience with TypeScript or a desire to learn;
• Background in developer tooling and API documentation is preferred.