Upgrades bought in battle last one run. The Armory lasts forever.