Sure, but being distilled water, would have already gone through a sterilization process when it was being distilled. No?
If you don't wash your yeast, aren't you then putting all the impurities that would be in the yeast cake (dead yeast, trub, etc, etc) back into your next brew?