From Sahih Muslim (Hadith 2081):
This hadith has been narrated on the authority of Anas but with this addition:" Allah gathered the clouds and as we (were obliged) to stay back I saw that even the strong man, impelled by a desire to go to his family, (could not do so)
Reference: Muslim 2081