People, when it's time to say: i'll stop talking to this person bec he/she is affecting me negatively?

Do you even make a pause, say to yourself i must stop because this relationship is not balanced and it affects me badly, i gotta go on without them?