Does it do anything in battle? Can you get them back once you do?

Potions or weapons?

You can equip and use potions for a battle. There's info on how you unequip potions here: have u ever seen a bug wear clothes? [5/21]

Weapons can still be equipped last I checked, but that's a completely useless option. You should stick your weapons in the armory.