In relationships, you should always be with someone trying to build you up (and vice versa), never someone attempting to tear you down. The moment that the other person starts chipping away at you, it’s over whether you know or it not.
I learned that the hard way, unfortunately.