From Sahih Muslim (Hadith 4259):
Ibn 'Umar heard Allah's Messenger (ﷺ) as saying:He who has to take an oath, he must not take oath but by Allah. The Quraish used to take oath by their fathers. So he (the Holy Prophet) said: Do not take oath by your fathers
Reference: Muslim 4259