It is said that 50% of any joke we may tell others about ourselves is the truth. Sometimes, I think it's more like 80%.
The truth is, the only thing we can control is ourselves. One cannot control other people or live others' lives for them. One should not worry, either, about problems one cannot control.
I have thankfully reached the age where I do not want to control other people. It is quite enough to just to live my own life. What other people may think of me is their business and/or their problem.
Try it! This way of thinking is quite liberating! Be free and be happy with yourself, your own opinions and your own life.