From Sahih Muslim (Hadith 3541):
Abu Huraira (Allah he pleased with him) reported Allah's Messenger (may, peace be upon him) as saying:When a man invites his wife to his bed and she does not come, and he (the husband) spends the sight being angry with her, the angels curse her until morning
Reference: Muslim 3541