Deploying DSPy¶
The tooling we ship for running DSPy programs in production: observability, reproducibility, deployment, and scalability.
Looking for who's using DSPy?
DSPy is in production at Shopify, Databricks, Dropbox, JetBlue, Moody's, Replit, AWS, Sephora, VMware, and dozens more. See companies using DSPy
-
Monitoring & Observability
Monitor your DSPy programs using MLflow Tracing, based on OpenTelemetry.
-
Reproducibility
Log programs, metrics, configs, and environments for full reproducibility with DSPy's native MLflow integration.
-
Deployment with MLflow
When it's time to productionize, deploy your application easily with DSPy's integration with MLflow Model Serving.
-
Scalability
DSPy is designed with thread-safety in mind and offers native asynchronous execution support for high-throughput environments.