A good attitude (free), loose clothing or a gi (could be free) sweats or surgical scrubs also work well.
Eventually you will want to buy practice weapons and a Hakama (worn after your first test)
this will cost you as much as you want to spend, weapons can cost from $5 to $500, you choose.