You can usually find silver by looking around caves. You'll find other good resources in the same areas but the risk is higher so be careful out there.

Agree with DBond on the base building, you'll want to start building wall lockers inside a base as soon as possible so you don't have to rely on those floaty lockers anymore. You'll soon be accumulating a massive amount of stuff.