Wednesday, 26 February 2025
| 08:45 | Join in |
| 09:00 | Welcome, Motivation & Introduction |
| ===== | Distributed Training |
| 09:15 | SLURM |
| 09:30 | DDP |
| 10:00 | Huggingface Accelerate |
| 10:15 | Hands-on examples |
| 10:30 | -- BREAK -- |
| 10:45 | ZeRO & DeepSpeed, FSDP |
| 11:15 | Hands-on examples |
| 11:45 | Quanization, Lora & ZeRO |
| 12:00 | Metrics & Monitoring |
| 12:15 | Q & A |
| 12:30 | End of course |
