LLM Egress Monitoring: Inspecting the Prompt at the Boundary Before It Reaches the Model Provider
Traditional egress monitoring inspects outbound network traffic against a network-DLP catalog. The catalog was designed for file transfers, email attachments, and web form submissions. LLM prompts leave the enterprise as HTTPS request bodies to api.openai.com, api.anthropic.com, and the Bedrock and Vertex endpoints. The network DLP inspects the header but cannot inspect the body when the body is TLS-encrypted. Even where a proxy terminates TLS, the DLP pattern set does not recognize prompt content the way it recognizes credit card numbers or file signatures. This piece walks through the failure modes, the inspection-layer architecture, and the enforcement decisions the layer supports.