This leads the viewer's eye up to your face, so the outfit feels like it's supporting you.
There are rare exceptions. Some banking firms are called "white shoe" because elite bankers used to wear white bucks; spectators also have a long history in classic men's style.