I've left my trunk rack on my car for months on end, and not had a problem, even in the city.
However, someone stole the (much more expensive) hitch mount rack off my husband's car when it was parked in our drive. We weren't too surprised, because years before someone had tried to peel the month-year sticker off my license plate.