Courses
Multi-day, guided programs to get real results
Lightning Lessons
Free, interactive sessions to explore new topics
Lightning Lesson1 hour
How to train your tiny MoE: Going from 60+ hours to 13
WATCH
Watch now Lightning Lesson30 minutes
How to Make High-Level Frameworks Work For You (Part 3)
WATCH
Watch now Lightning Lesson30 minutes
Why Low-Level Training Frameworks Save Us (Part 2)
WATCH
Watch now Lightning Lesson30 minutes
Why High-Level Training Frameworks are a Crutch (Part 1)
WATCH
Watch now Lightning Lesson45 minutes
The Distributed Training Taxonomy: DP, PP, and more
WATCH
Watch now Lightning Lesson45 minutes
How to Utilize a Cluster: All About SLURM
WATCH
Watch now Resources
Alumni reviews
Harshit
Live cohort
Lead Software Engineer II · CONFIDENTIAL
Scratch to Scale: Large-Scale Training in the Modern World
This the gold mine i was searching for more then a year.
Lalith
Live cohort
Senior System Software Designer · AMD
Scratch to Scale: Large-Scale Training in the Modern World
Loved every bit! Thanks for the generous credits
Amardeep
Live cohort
Founder · AIEdx
Scratch to Scale: Large-Scale Training in the Modern World
Best Course on distributed training
Nikhil
Live cohort
Sr deep learning engineer · Amazon
Scratch to Scale: Large-Scale Training in the Modern World
It was very informative and helped me transition from model inference to model training
Muhammad
Live cohort
PhD Student · Tennessee Tech University
Scratch to Scale: Large-Scale Training in the Modern World
Zach is an awesome teacher. Want to implement these techniques in my projects.