Okay, so I finally figured out something that's been bothering me. I thought I was demisexual, then I wasn't sure because there was some conflicting info. But now I have it figured out: I'm demisexual in relation to men, but not in relation to women. So... I don't know if there's a term for that specifically, but that's what I am.
For those who don't already know, demisexuality is when you don't get sexually attracted to someone unless you form an emotional connection with them first.