Calculate latency introduced by NGINX

I'm using NGINX as a reverse proxy for my web server. What's the best way to calculate the additional latency introduced by NGINX?
Currently I'm looking at request_time - upstream_response_time but this gets skewed when the connection is slow.
Are there any other options for calculating NGINX latency?
Thank you.