From Sahih Muslim (Hadith 5434):
Abdullah b. 'Amr b. al-As reported:Allah's Messenger (ﷺ) saw me wearing two clothes dyed in saffron. whereupon he said: These are the clothes (usually worn by) the non-believers, so do not wear them
Reference: Muslim 5434