Low libido may not be as common in men as it is in women. It occurs in about 15 to 16 percent of men, while it is about 30 percent of women, twice as common in men. Low libido can be more distressing in men than in women. The cause of this condition can be psychological or physical.