deny directive on specific proxy_pass implementation

Hi,

I have two nginx servers:

First one is configured as upstream to the second one.

Second one is configured as proxy_pass with few virtual hosts.

All traffic incoming into 2'nd comes with 1'st public IP.

So in 2'nd directive deny in location of course don't work at all.

Do you have any idea how to get around this problem?