Most common USB GPS receivers come with a USB connector with a UART-to-USB chip built in. That means the GPS receiver itself provides serial UART output. So they can be used with Arduino by replacing it's USB connector with Rx/Tx and VCC/GND connectors. My practical test has proved that this works. What you need to make sure of is the baudrate of the GPS receiver.

Arduino working with modified GPS receiver