If a player is directed to lose prosperity, mark the lost prosperity on the board.
The town can never be brought below the minimum prosperity for its current level (can't go down a level).
If they cannot lose prosperity because they do not have a sufficient amount to lose, they lose what they are able to lose.