I guess it's really personal
You do not have to match anything, but some people like to have everything matching - and I have always been one of them. Usually I pick components to match with each other and with the color of the frame.
But really, it is for pure aesthetic reasons - for sure it's not necessary, and you can happily ride with silver stem and black seatpost and vice-versa