Advocates of investing in gold call it a “safe haven.” Still, experts caution against putting all your eggs in one basket.