You can upgrade a Weapon using the Craft General Action. Most Weapons list two potential upgrade options and the cost of each upgrade in resources and Time. When you Craft a new Weapon, lay the new Weapon Sheet on top of the old one. You can upgrade a Weapon during the Battle Step, with the Time cost counting against the next Level (or paid in Small Effort, if Level IV).