You asked if you're bring selfish. Yes. You asked if you're wrong for not ending your current relationship. Yes.

You lie to the guy who you say is treating you well - and upset him - they guy who you say you don't love - so you can go spend time with the drunkard - the guy you say you do love. I suggest you don't participate in any relationships until you work out your own issues.