It would worry me, for sure.

My Prius has a spoiler like that, and it's pretty flimsy, I can tell you. (Ask me how it stands up to a garage door. Wait, don't. ) The only trunk rack I've seen people put on Priūs is the Saris Bones rack, which is wider and spans the spoiler.