Most Artifacts appear underneath raised areas of ground, which can be dug up using a pickaxe — you get a Worn Pickaxe from an early quest in the mail, but can also craft better ones via Blacksmithing.