What I do is use it as a smaller part of my diet. For example, I love the taste of almond Breeze almond milk and hemp milk, so I use those at least half the time and soymilk the other half. I use maybe a pound of tofu per week and small amounts here and there of miso. Generally speaking, I stay away from overly processed soy foods such as meat analogs, but do use them occasionally.
I have been doing this for around ten years and don't feel any ill effects from it, I try to make the bulk of my diet vegetables, fruits, grains, and beans and use soy as kind of a condiment.