At what point should you focus on fences and a house?

I have a ton of stuff in my little piece of the world. My problem is that I have no house or fences setup. Of course I need level ground and paving to build on first, right?
The most silver I've had at any one time was about 300+ and that was recently stolen from me while I slept.
I guess I pretty much answered my own question
The most silver I've had at any one time was about 300+ and that was recently stolen from me while I slept.

I guess I pretty much answered my own question