Latency of a gateway system that connects to downstream services can be measured using an external computer system. The gateway may route component requests to various downstream services in order to service a main request, and be part of an overall service where low latency is important. It may be desirable for the gateway system to have as little added latency as possible. Benchmarking the gateway by performing latency measurements can give an indication of how the gateway is performing. If software on the gateway changes, re-benchmarking the gateway can reveal if problematic code was introduced. A measurement system can employ a lightweight process so that minimal additional latency is incurred by the measuring process. Memory can be allocated as to avoid a garbage collection process so that the latency measurement is unaffected when garbage collection occurs, for example, and multiple buffers can measure latency for different request types.