From Sahih Muslim (Hadith 987):
Sahl b. Sa'd reported:I saw men having tied (the ends) of their lower garments around their necks, like children, due to shortage of cloth and offering their prayers behind the Messenger of Allah (ﷺ). One of the proclaimers said: O womenfolk, do not lift your heads till men raise (them)
Reference: Muslim 987