If you actually own physical gold bars or coins, then it's yours. If you own a paper claim to gold, then you own a valueless piece of paper. If you take that paper to the bank, you will probably NOT be able to exchange it for real gold.
Same with silver.