RTSP reverse proxy

I have 4 Samsung IP cameras (they only stream rtsp, no http) with the following internal URLs:

rtsp://username:password@cam0.domain.com/profile5/media.smp
rtsp://username:password@cam1.domain.com/profile5/media.smp
rtsp://username:password@cam2.domain.com/profile5/media.smp
rtsp://username:password@cam3.domain.com/profile5/media.smp

And I have my domain.com DNS record setup so that the following:

video0.domain.com
video1.domain.com
video2.domain.com
video3.domain.com

all point to the same external ip address (ip.domain.com) where port 554 is open.

I'm already successfully using nginx to host several web servers behind ip.domain.com.
Is there a way in nginx to do the same with rtsp?

If not, any recommendation how to tunnel rtsp over http?

Thanks,
---Mirco.