[EPIC] Production Kubernetes & Container Support

[gouravjshah]

Overview

This epic tracks all work needed for production-grade Kubernetes and container support in Open MCP Gateway.

Milestones

• v0.2.0 - Container Support (Docker/Podman)
• v0.3.0 - Kubernetes Runtimes (k8s-job, k8s-service)
• v0.3.0 - Multi-tenancy

Related Issues

v0.2.0 - Container Support

• feat: Implement Docker runtime for MCP servers #2 - Docker runtime implementation
• feat: Add Prometheus metrics endpoint #3 - Prometheus metrics endpoint
• feat: Support env-file for secrets injection #4 - Env-file secrets injection

v0.3.0 - Kubernetes Runtimes

• feat: Implement k8s-job runtime for ephemeral workloads #5 - k8s-job runtime implementation
• feat: Implement k8s-service runtime for long-running servers #6 - k8s-service runtime implementation
• feat: Add kube-rs client for Kubernetes API access #7 - Kubernetes client integration (kube-rs)

v0.3.0 - Multi-tenancy

• feat: Multi-tenant support with namespace isolation #8 - Multi-tenant support with namespace isolation

Future

• feat: Official Helm chart for gateway deployment #9 - Official Helm chart
• feat: Service mesh integration (Istio/Linkerd) #10 - Service mesh integration (Istio/Linkerd)

Success Criteria

• Gateway can spawn MCP servers as Docker containers
• Gateway can spawn MCP servers as Kubernetes Jobs
• Gateway can connect to MCP servers deployed as K8s Services
• Multi-tenant isolation with namespace separation
• Full observability with Prometheus metrics

Architecture

┌─────────────────────────────────────────────────────────┐
│                    Open MCP Gateway                      │
├─────────────────────────────────────────────────────────┤
│  Runtime Abstraction Layer                               │
│  ┌─────────────┬─────────────┬─────────────┬──────────┐ │
│  │local-process│   docker    │  k8s-job    │k8s-service│ │
│  │   (v0.1)    │   (v0.2)    │   (v0.3)    │  (v0.3)   │ │
│  └─────────────┴─────────────┴─────────────┴──────────┘ │
└─────────────────────────────────────────────────────────┘

Progress Tracking

Version	Issues	Status
v0.2.0	#2, #3, #4	🔲 Not Started
v0.3.0	#5, #6, #7, #8	🔲 Not Started
Future	#9, #10	🔲 Backlog