higress

About

Higress is a cloud-native and AI-native API gateway open-sourced by Alibaba, built on Istio and Envoy. It unifies traffic, microservice, and security gateways into one architecture, extensible via multi-language Wasm plugins. Higress excels in AI scenarios by connecting seamlessly with mainstream LLMs, offering multi-model load balancing, token rate limiting, and AI observability. Furthermore, it natively hosts Remote MCP (Model Context Protocol) servers, empowering AI Agents to securely invoke tools with fine-grained limits.

Features

• AI-Native Gateway with Token Limiting
• Remote MCP Server Hosting
• 3-in-1 Unified API Gateway
• Wasm Plugin Extensibility
• Streaming Processing & Hot Updates

Supported Platforms