Ockham's Razor helps here. It advises that the simplest explanation is most likely to be true. When you encounter competing explanations that plausibly explain a set of data equally well, you probably want to choose the simplest one to investigate first.
Chapter:
Being Wrong Less
Section:
Keep It Simple Stupid