Contact Us

The enterprise-grade AI Gateway for security-conscious teams. Protect your data, govern spend, and account for usage.

Read Documentation→

Product

  • Features
  • Security
  • Pricing
  • Docs

Company

  • About Us
  • Blog
  • Playground
  • Contact Us

© 2026 Shim. All rights reserved.

Trust · Care · Precision
SecurityPrivacy PolicyTerms of Service
Contact Us

The enterprise-grade AI Gateway for security-conscious teams. Protect your data, govern spend, and account for usage.

Read Documentation→

Product

  • Features
  • Security
  • Pricing
  • Docs

Company

  • About Us
  • Blog
  • Playground
  • Contact Us

© 2026 Shim. All rights reserved.

Trust · Care · Precision
SecurityPrivacy PolicyTerms of Service
Contact Us
Back to Blog|Home
Comparison

MCP Proxy vs MCP Gateway: What Changes in Production

An MCP proxy handles transport and protocol routing. An MCP gateway enforces identity, consent, and authorization. Here is where the line falls in production.

July 2, 20267 min read

In a demo, an MCP proxy and an MCP gateway look the same. Both sit between your agents and your MCP servers. Both handle authentication. Both show up as a box in the middle of an architecture diagram. The difference only surfaces when something goes wrong in production and someone asks: "Why was this agent allowed to do that?"

An MCP proxy handles transport and connectivity. It forwards requests, normalizes access, hides topology. An MCP gateway handles identity, consent, authorization, and auditability. The proxy proves a request moved through the right path. The gateway proves an agent was authorized to act on a human's behalf at that moment. Every team building production MCP systems will eventually face the governance questions only a gateway can answer. The teams that learn this after an incident rather than before it built only a proxy.

The Spec Says "Proxy," the Market Says Something Else

Part of the confusion is terminological. The official MCP specification defines an MCP Proxy Server as an MCP server that connects clients to third-party APIs, acting as a single OAuth client to the third-party authorization server. That is a narrow, specific role: OAuth delegation.

The market uses "MCP proxy" to mean any transport intermediary between agents and tools. These are different scopes. A vendor calling their product an MCP proxy might mean anything from a stdio-to-HTTP bridge to a full governance layer. When evaluating tools, ignore the label. Look at what the system actually decides.

Why Direct MCP Connections Break at Scale

A direct client-to-server MCP architecture breaks down at enterprise scale because the protocol itself does not address security, governance, or observability. MCP defines how agents discover and call tools. It does not define who gets to call which tools, how to log that decision, or how to revoke access mid-session.

Without a central control plane, every tool must implement its own authentication and authorization logic. That is inconsistent and error-prone. Four risks compound quickly when you run MCP servers without an intermediary: tool poisoning attacks where compromised servers return malicious tool definitions, credential sprawl from agents holding static keys to multiple servers, no audit trail tying tool invocations to agent identities, and unbounded rate exposure where one misbehaving agent saturates backend services.

These are the problems that make an MCP proxy or gateway necessary. The question is which one solves the problems you actually have.

What an MCP Proxy Is Built to Do

An MCP proxy functions as both an MCP server (facing clients) and an MCP client (facing backends), creating a transparent dual-posture bridge. Your agents see a single MCP server. Your backend MCP servers see a single MCP client. The proxy handles the fan-out in between.

This is not a generic HTTP reverse proxy. An MCP proxy understands MCP-specific JSON-RPC methods: tools/list for discovery, tools/call for execution, resources/read for data access, initialize for session negotiation. It can decide whether agent A is allowed to invoke tools/call on read_invoice for resource customer/123. A generic HTTP proxy sees POST /mcp and nothing more.

Transport bridging. MCP defines three transports: stdio for local subprocess communication, SSE for one-way streaming over HTTP, and Streamable HTTP as the current spec direction for remote MCP servers. Real environments mix all three. A proxy must bridge between them.

Federation. A single MCP proxy can front many backend MCP servers and serve many agents simultaneously, with isolated sessions, namespaced tool catalogs, and per-agent policy. This eliminates the point-to-point sprawl that makes direct connections unmanageable.

Latency. An MCP proxy adds single-digit to low-double-digit milliseconds for authentication, policy evaluation, and logging. Response caching for deterministic tool calls can offset this and produce a net reduction for read-heavy workloads.

For protocol plumbing, transport normalization, and basic access control, a proxy is the right tool. But there is a class of problems it cannot solve.

The Delegated Authority Problem

When an agent acts on behalf of a human, something changes. The system is no longer routing a request. It is executing a decision that a human did not explicitly make, using permissions that a human granted in a different context, at a different time.

The moment an agent acts on behalf of a human, the architecture needs to bind the human identity, the agent session, the granted consent scope, and the requested tool action into one decision path. That is where a proxy stops and a gateway starts.

A production MCP gateway becomes the place where several concerns meet: delegated identity between human and agent, consent capture and consent scope, runtime authorization for each tool invocation, policy distribution and low-latency decisions, and audit trails that security and compliance teams can use later. None of these are transport features. They are governance features.

The proxy owns the transport path; the gateway owns the delegated trust decision and the evidence around it.

There is also a concrete security risk in proxy-only OAuth flows. MCP proxy servers face a "confused deputy" vulnerability when using static OAuth client IDs. Attackers can exploit the combination of static client IDs, dynamic client registration, and consent cookies to obtain authorization codes without proper user consent. A gateway that manages identity and consent at the session level closes this vector.

The Production Failure Mode

Teams that optimize for connection handling and miss the control path for identity, consent, policy evaluation, and audit evidence end up in a specific situation. The system works technically, but nobody can explain why an agent was allowed to do something sensitive.

This is not hypothetical. Agents discover tools, accumulate context, chain steps together, and can drift from a benign read to a risky action in the same session. A proxy that authenticated the agent at session start has no mechanism to re-evaluate authorization when the agent's behavior shifts from reading invoices to modifying payment records. Per-hop evaluation is what makes a gateway a gateway.

An MCP proxy facilitates direct connections or protocol translations for individual servers. An MCP gateway acts as a centralized control plane offering RBAC, unified tool discovery, and deep observability that proxies cannot natively provide.

The Same Lesson, One Protocol Layer Up

This is not a new pattern. Point-to-point agent-to-tool integrations repeat the anti-pattern API teams solved with gateways a decade ago, now one protocol layer up. The same forces that pushed API teams from direct service-to-service calls to centralized API gateways are pushing MCP deployments from direct connections to governed intermediaries.

The industry is converging on this. Microsoft's MCP Gateway provides session-aware stateful routing and lifecycle management of MCP servers in Kubernetes environments. Tyk frames the gateway as a centralized policy enforcement point for all AI-driven traffic. The pattern is consistent across vendors: a single layer that handles identity, policy, and audit for every agent-tool interaction.

Migration is practical. Most migrations from direct MCP connections to a proxy are configuration-only, with no changes required to the MCP servers themselves. Going from proxy to gateway adds governance configuration on top of routing you already have.

When a Proxy Is Enough, When a Gateway Is Required

MCP ProxyMCP Gateway
Primary jobTransport, protocol routing, federationIdentity, consent, authorization, audit
DecidesCan this request reach that server?Should this agent perform this action for this human right now?
State modelSession-level transport stateSession + identity + consent + policy state
Auth modelAPI keys, tokens at connection timeDelegated identity with per-tool runtime authorization
Audit outputRequest logs (what happened)Decision logs (why it was allowed)
LimitCannot bind identity to consent to actionCannot exist without the transport layer beneath it

A proxy is sufficient when:

  • You are in local or development environments
  • Agents do not act on behalf of humans with delegated permissions
  • You need protocol translation and transport bridging
  • Risk tolerance is high and audit requirements are low

A gateway is required when:

  • Agents act on behalf of humans and invoke tools with real consequences
  • Multiple teams share MCP servers and need RBAC
  • Compliance or security teams need audit trails that explain why an action was permitted
  • You need dynamic tool discovery with per-agent, per-tool authorization
  • The confused-deputy vulnerability in proxy-only OAuth flows is an unacceptable risk

Most teams start with a proxy because the transport problems are immediate and visible. The governance problems are invisible until an agent does something it should not have been allowed to do. By then, the proxy is load-bearing infrastructure and the gateway is a retrofit. Building the governance layer first, or at least planning for it, costs less than explaining to your security team why an agent modified production data using permissions a user granted for a read-only workflow three sessions ago.

Back to all articlesGet Started Free

The enterprise-grade AI Gateway for security-conscious teams. Protect your data, govern spend, and account for usage.

Read Documentation→

Product

  • Features
  • Security
  • Pricing
  • Docs

Company

  • About Us
  • Blog
  • Playground
  • Contact Us

© 2026 Shim. All rights reserved.

Trust · Care · Precision
SecurityPrivacy PolicyTerms of Service