LLM Gateway refers to the control layer between enterprise data and external language models. It manages how prompts are routed, transformed, and delivered so organizations can use multiple models in a more controlled and consistent way.