If God joins your enemies together you need to start running. Do not worry about what you have left behind. You have a start on them, and you need that advantage. Your enemies are those who disagree with you and especially those with whom you have disagreed. If you are a disagreeable person then they will be many, and when they join forces they will be more than you can handle.
We make judgments all day every day, and each one must be right and true. James tells us not to be many masters because the judgments are many and the likelihood of getting some wrong is high. Err on the side of compassion and it may help, but judgment that is wrong will not help at all. Practice to answer and get it right, and have many friends.