When your clicking around on the map is also annoying.
But there is no reason to click on the map other than to place a blip... If you're moving around the map and it comes up, you let go of left click too fast. That is not to "auto-GPS"
Also you can change the key bind from "n" so that's not an excuse for this.
But it's not hard to add so I'm working on it now.