Roadmap

These are some of the features we have in the pipeline, sorted by priority. Please help us prioritize this list; go to the related GitHub issue and comment on it.

  1. Grid improvements (#522, #647)

  2. Plot color changes (#650)

  3. Better tracking of execution products (notebooks, models and artifacts).

  4. Improve documentation of git collaboration {{git}} (#615).

Done

  1. Better support for non-Jupyter editors like VSCode or PyCharm (available in 0.14). User guide.

  2. Export Ploomber pipelines to Slurm. (Note: this will be implemented in Soopervisor). (This is now in beta)

  3. CLI automatic suggestions on typos (#618)

  4. Scheduling via cron jobs (#422)

  5. Pipeline Monitoring (#583)

  6. Google Colab integration, documentation and a sample first-pipeline.

  7. Managed AWS Batch deployment through github actions CI.

To send general feedback, open an issue or send us a message on Slack.

Ideas

These are some ideas we have that we haven’t prioritized yet.

  • Deploying your model as an endpoint.

  • Artifacts reproducibility.

  • Integration with Databricks.

  • Integration with Great Expectations.

  • Integration with Streamlit.

  • Automated pipeline testing.

  • Integration with data versioning tools such as LakeFS. (#414)

  • Expand integration with Google Cloud (we only support uploading to Cloud Storage).

  • Expand integration with AWS (we only support S3 and AWS Batch).

  • Integration with Azure Machine Learning services.

  • Support for Julia.

To send general feedback, open an issue or send us a message on Slack.