Just the simple fact that you wear gear is good enough. It's the "stunters" that ride with just shorts and t that really should be hassled.
Just yesterday in a down pour I was passed by two guys with no gear, just shorts and t's; on the expressway. I felt a lot better even though I left my rain gear at home. I got soaked, Hate to see what they looked like when they got to wherever.