2026 ML Compiler Software Engineer PEY Co-op (12–16 months) – Amazon – Toronto, ON
Location: Toronto, ON | Company: Amazon
Amazon Web Services (AWS) is seeking a motivated ML Compiler Software Engineer Co-op for a 12–16 month PEY internship at the Amazon Development Centre Canada (Toronto, ON). This role is part of the AWS Neuron team within Annapurna Labs, building high-performance solutions for large-scale machine learning workloads.
As an intern, you will gain hands-on experience with deep learning compilers, performance optimization, and kernel development. This is a unique opportunity to work alongside experienced engineers, contribute to business-critical features, and develop skills in ML frameworks, compiler internals, and high-performance computing.
About the Role: ML Compiler Software Engineer Co-op
The AWS Neuron SDK is a full-stack solution including a compiler, runtime, debugger, and libraries integrated with PyTorch and TensorFlow. It powers AWS custom silicon—Inferentia and Trainium—designed to deliver cost-effective machine learning at scale.
As a Co-op Engineer, you will analyze ML workloads, develop compiler or kernel optimizations, and build performance modeling and profiling tools. You will directly support Neuron’s mission to provide best-in-class performance and usability for customers training and deploying large ML models on AWS.
Benefits and Salary
Amazon provides a world-class environment for professional growth, including:
- Competitive internship compensation
- Mentorship from senior engineers
- Exposure to cutting-edge cloud computing and custom silicon
- Career development within one of the fastest-growing teams at AWS
Job Details
📌 Job Type: PEY Co-op / Internship (12–16 months)
📍 Location: Toronto, ON, Canada
🏢 Company: Amazon Development Centre Canada ULC – Annapurna Labs
🆔 Job ID: 3081240
Requirements / Skills
- Currently enrolled in a Bachelor’s degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or a related field (graduation date May 2027 – May 2028).
- Must be physically enrolled in an academic program located in Canada.
- Strong interest and qualifications in at least two of the following areas:
- Code generation, compute graph optimization, resource scheduling
- Optimizing compilers (LLVM, clang, etc.)
- Machine Learning frameworks (PyTorch, JAX, TensorFlow, TVM, MLIR)
- Kernel development (CUDA, OpenCL, or ML-specific kernels)
- Available for a 12–16 month internship starting May 2026.
Preferred Qualifications
- Previous technical internship experience in related areas
- Knowledge of optimization mathematics (linear & nonlinear programming)
- Academic coursework in Compiler Design, Computer Architecture, Programming Languages, Advanced Algorithms
How to Apply
If you are passionate about machine learning, compilers, and high-performance computing, apply today to join Amazon AWS Neuron and gain career-defining experience:
Share This Opportunity
Know a student interested in compilers and ML? Share this opportunity and help them join Amazon AWS Neuron in Toronto!
Job Summary & Tips for Applying
To stand out for the ML Compiler Software Engineer Co-op role at AWS Neuron, highlight your academic focus on compiler design, machine learning frameworks, or kernel development. Show strong coding and analytical skills, as well as hands-on experience from coursework or projects.
Emphasize any internships, open-source contributions, or research in ML compilers, optimization, or performance engineering. Even student projects can demonstrate readiness to work on real-world problems at scale.
During the hiring process, showcase your ability to learn quickly, solve problems, and work collaboratively. Demonstrating enthusiasm for AWS’s mission to democratize deep learning will make you a stronger candidate.