Deploying DSPy¶
The tooling we ship for running DSPy programs in production: observability, reproducibility, deployment, and scalability.
Looking for who’s using DSPy?
DSPy is in production at Shopify, Databricks, Dropbox, JetBlue, Moody’s, Replit, AWS, Sephora, VMware, and dozens more. :octicons-arrow-right-24: See companies using DSPy
-
:material-magnify-expand:{ .lg .middle } Monitoring & Observability
Monitor your DSPy programs using MLflow Tracing, based on OpenTelemetry.
-
:material-ab-testing: Reproducibility
Log programs, metrics, configs, and environments for full reproducibility with DSPy’s native MLflow integration.
-
:material-rocket-launch: Deployment with MLflow
When it’s time to productionize, deploy your application easily with DSPy’s integration with MLflow Model Serving.
-
:material-arrow-up-right-bold: Scalability
DSPy is designed with thread-safety in mind and offers native asynchronous execution support for high-throughput environments.