From Sahih Muslim (Hadith 1958):
Aisha reported:The people came for Jumu'a prayer from their houses in the neighbouring villages dressed in woollen garments on which dust was settled and this emitted a foul smell. A person among them (those who were dressed so) came to the Messenger of Allah (ﷺ) while he was in my house. The Messenger of Allah (may peace he upon him) said to him: Were you to cleanse yourselves on this day
Reference: Muslim 1958