API gateways are intermediary servers that provide a single entry point for clients to access multiple backend services, handling request routing, security(e.g., authentication), rate limiting, and other cross-cutting concerns.