Camouflage your settlement?

Is it possible to camouflage your settlement on the map so raiders dont spot it? I've noticed digging causes the the spot on the map to turn into the color brown. If you dont dig or lay stone but still build houses and farms, would you be invisible on the map? Note that i'm a noob atm and have not yet even build a house.