Was breaking up with him the right thing to do?

exactly what you did hun. Every woman deserves to be loved and if she's not getting it then she's not happy. Do what makes you happy! Move onn.