Large-scale trainingΒΆ

Ploomber pipelines can export to distributed workflow orchestrators for large-scale training. Check out our package Soopervisor, which allows you to export to:

  1. Kubernetes (via Argo workflows)

  2. AWS Batch

  3. Airflow

  4. SLURM