If you believe in liberty, I believe that must include giving other people the freedom to be wrong. To do the wrong things. To do things they have no right to do sometimes. Things that embarrass you.
I think that includes not demanding that they not v*te, not hold a government job, stay off welfare, or whatever.
Even if they are family members.
Liberty is never controlling.
Tell them where you stand, why you think they are wrong to do what they are doing. Then step aside.
Yes, you have the right to defend yourself, but you are not always required to do so. Weigh each situation. Are they directly archating?
You are also not required to let someone violate you. Again, weight the situation. Maybe you simply need to get away from certain people. Or to put your foot down if they want to make you go along with them. To say "you may not violate me" isn't controlling anyone- although I have heard people make that claim with a straight face.
Letting people be wrong is probably one of the hardest things I ever do. And one of the most essential, when dealing with statists.
Let people be wrong. Don't hide the consequences from them- let them see the connection between their poor choices and the results. Maybe, if they mention it later, suggest a better way. You don't know who it may get through to.