One model that can help you figure out how to strike this balance in certain situations is the precautionary principle: when an action could possibly create harm of an unknown magnitude, you should proceed with extreme caution before enacting the policy. It's like the medical principle of "First, do no harm."
Chapter:
Anything That Can Go Wrong, Will
Section:
It's Getting Hot In Here