Probably that's why they look brown

Actually, many of Hitler's Brown Shirts were wearing suits . and NOT brown suits.

Rather, Brown Shirts were judged by their actions and associated with that group.

The same may be said about the Nazi Fascists (Democrat Party members).