mlflow

MLflow is the premier open-source AI engineering platform designed for Agents, LLMs, and ML models. It provides an end-to-end suite for teams to debug, evaluate, monitor, and optimize production-grade AI applications. Core features include OpenTelemetry-based observability and tracing, systematic evaluation with over 50 built-in metrics, prompt versioning and automated optimization, and a unified AI Gateway to manage provider routing, rate limits, and costs.

• LLM & Agent Observability and Tracing
• Systematic Evaluation & Monitoring
• Prompt Versioning & Automated Optimization
• Unified AI Gateway for LLM Providers
• End-to-End ML Lifecycle Tracking