I've done that to myself...not once but twice. Luckily, no one was around to know....except maybe the construction guys working on the house across the street who saw me hoist my bike onto the roof rack, secure it, hop in, and drive off without the wheel.
Of course the same guys watched me pull up, hop out, and snatch my lonely wheel before scurrying back into the car.