Why were Hannibal Lecter's patients all gay?

I just finished Hannibal and I've read The Silence of the Lambs and I noticed that Dr. Lecter's patients (Raspail, Gumb, Vulger, etc.) were all homosexuals and even Vulger tried to "seduce" him! So is there any reason why?