You can love people but it doesn't necessarily mean it's good for you to be around them. You will convince yourself that 'that's just how things are between us' or 'it's the dynamic'. I'm sorry to say this to you but that's tolerance. You see it as love but reality is, its never self-love. It's a disservice to you. Why stay when it's not what you want or are looking for? You feel lonely anyways.
Sound advice
How can someone expect you to treat others with kindness if you can't treat yourself with kindness?