The confusion continues.. I tried the power supply from adafruit (https://www.adafruit.com/products/501
) AND I tried a 5V 2A power supply I had laying around..
With the 5V 2A power supply, I was able to successfully power the GPS with Raspberry Pi's 5V output ONCE without resetting the Pi. Each try after would reset the Pi.