It is narrated by M’aad bin Jabal that when the Apostle of God sent him to Yemen, he gave him this advice: “O M’aad”, he said, “Avoid luxury. The chosen bondsmen of the Lord are not ease-loving and self-indulgent.”
-Musnad-i-Ahmad

Commentary:
Though it is not forbidden to lead a life of ease and luxury, it does not befit the worthy bondmen of the Lord. They would better abstain from it. O Lord! There is no joy other than the joy of Futurity denotes the ideal rule of conduct for them.

Source: Ma’riful Hadith