On Friday, I spent over an hour in a car with torrential rain hammering on the roof and pretty limited visibility.
It was less annoying than Minecraft rain, by far.
If it was brief showers, with less noise and rarely/never more than an in-game hour, that'd be fine - still cause snow in snowy places, without annoying everyone too much.