Rain, snow, storms?
Rain could speed up crops gradually when it does rain, snow slows down crops, storms can have high winds that damage buildings a little, or maybe even tornadoes/hurricanes that leave wreck in way.
It's definitely not a big priority to want to do, but it's nice to have visual and meaningful things.