There are many reasons for men to lose their libido, and simple factors such as fatigue, stress, depression, certain drugs (antidepressants and hypertension drugs), excessive drinking, illegal drugs and low testosterone levels may all be among them Part.